Jul 31 01:35:14.514990 ip-10-0-133-91 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 31 01:35:14.515001 ip-10-0-133-91 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 31 01:35:14.515008 ip-10-0-133-91 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 31 01:35:14.515228 ip-10-0-133-91 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 31 01:35:24.631236 ip-10-0-133-91 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 31 01:35:24.631256 ip-10-0-133-91 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 90e1f32e52e241ea8b243e4a07fded0b --
Jul 31 01:37:19.295211 ip-10-0-133-91 systemd[1]: Starting Kubernetes Kubelet...
Jul 31 01:37:19.717718 ip-10-0-133-91 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 01:37:19.717718 ip-10-0-133-91 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 31 01:37:19.717718 ip-10-0-133-91 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 01:37:19.717718 ip-10-0-133-91 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 31 01:37:19.717718 ip-10-0-133-91 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 01:37:19.719316 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.719151    2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 31 01:37:19.723080 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723061    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 01:37:19.723080 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723080    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 01:37:19.723154 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723084    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 01:37:19.723154 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723088    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 01:37:19.723154 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723091    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 01:37:19.723154 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723095    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 01:37:19.723154 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723098    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 01:37:19.723154 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723101    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 01:37:19.723154 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723104    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 01:37:19.723154 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723107    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 01:37:19.723154 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723110    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 01:37:19.723154 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723113    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 01:37:19.723154 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723116    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 01:37:19.723154 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723119    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 01:37:19.723154 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723123    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 01:37:19.723154 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723126    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 01:37:19.723154 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723128    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 01:37:19.723154 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723131    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 01:37:19.723154 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723140    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 01:37:19.723154 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723143    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 01:37:19.723154 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723146    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 01:37:19.723154 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723149    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 01:37:19.723675 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723152    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 01:37:19.723675 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723155    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 01:37:19.723675 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723158    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 01:37:19.723675 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723161    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 01:37:19.723675 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723165    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 01:37:19.723675 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723168    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 01:37:19.723675 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723171    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 01:37:19.723675 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723174    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 01:37:19.723675 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723177    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 01:37:19.723675 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723180    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 01:37:19.723675 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723183    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 01:37:19.723675 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723186    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 01:37:19.723675 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723189    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 01:37:19.723675 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723192    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 01:37:19.723675 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723194    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 01:37:19.723675 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723197    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 01:37:19.723675 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723212    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 01:37:19.723675 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723216    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 01:37:19.723675 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723219    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 01:37:19.723675 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723221    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 01:37:19.724220 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723224    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 01:37:19.724220 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723227    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 01:37:19.724220 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723230    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 01:37:19.724220 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723233    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 01:37:19.724220 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723235    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 01:37:19.724220 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723238    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 01:37:19.724220 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723241    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 01:37:19.724220 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723245    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 01:37:19.724220 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723247    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 01:37:19.724220 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723250    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 01:37:19.724220 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723253    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 01:37:19.724220 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723256    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 01:37:19.724220 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723260    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 01:37:19.724220 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723264    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 01:37:19.724220 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723267    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 01:37:19.724220 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723271    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 01:37:19.724220 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723274    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 01:37:19.724220 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723277    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 01:37:19.724220 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723279    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 01:37:19.724711 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723282    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 01:37:19.724711 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723285    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 01:37:19.724711 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723289    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 01:37:19.724711 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723293    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 01:37:19.724711 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723296    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 01:37:19.724711 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723299    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 01:37:19.724711 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723302    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 01:37:19.724711 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723305    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 01:37:19.724711 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723309    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 01:37:19.724711 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723312    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 01:37:19.724711 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723316    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 01:37:19.724711 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723319    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 01:37:19.724711 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723321    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 01:37:19.724711 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723325    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 01:37:19.724711 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723328    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 01:37:19.724711 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723331    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 01:37:19.724711 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723335    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 01:37:19.724711 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723339    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 01:37:19.724711 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723342    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 01:37:19.724711 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723345    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 01:37:19.725285 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723348    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 01:37:19.725285 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723351    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 01:37:19.725285 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723354    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 01:37:19.725285 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723358    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 01:37:19.725285 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723361    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 01:37:19.725285 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723365    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 01:37:19.725285 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723368    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 01:37:19.725285 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723372    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 01:37:19.725285 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723375    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 01:37:19.725285 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723378    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 01:37:19.725285 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723381    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 01:37:19.725285 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723384    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 01:37:19.725285 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723387    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 01:37:19.725285 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723390    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 01:37:19.725285 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723393    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 01:37:19.725285 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723396    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 01:37:19.725285 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723398    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 01:37:19.725285 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.723401    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 01:37:19.725285 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724180    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 01:37:19.725801 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724188    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 01:37:19.725801 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724192    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 01:37:19.725801 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724195    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 01:37:19.725801 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724198    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 01:37:19.725801 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724201    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 01:37:19.725801 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724204    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 01:37:19.725801 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724208    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 01:37:19.725801 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724211    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 01:37:19.725801 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724214    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 01:37:19.725801 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724217    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 01:37:19.725801 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724219    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 01:37:19.725801 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724222    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 01:37:19.725801 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724226    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 01:37:19.725801 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724229    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 01:37:19.725801 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724233    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 01:37:19.725801 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724236    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 01:37:19.725801 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724238    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 01:37:19.725801 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724241    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 01:37:19.725801 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724244    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 01:37:19.725801 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724247    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 01:37:19.726361 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724251    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 01:37:19.726361 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724254    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 01:37:19.726361 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724256    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 01:37:19.726361 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724259    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 01:37:19.726361 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724262    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 01:37:19.726361 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724265    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 01:37:19.726361 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724267    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 01:37:19.726361 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724272    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 01:37:19.726361 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724276    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 01:37:19.726361 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724278    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 01:37:19.726361 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724281    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 01:37:19.726361 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724284    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 01:37:19.726361 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724286    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 01:37:19.726361 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724289    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 01:37:19.726361 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724292    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 01:37:19.726361 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724294    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 01:37:19.726361 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724297    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 01:37:19.726361 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724303    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 01:37:19.726361 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724307    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 01:37:19.726860 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724310    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 01:37:19.726860 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724313    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 01:37:19.726860 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724316    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 01:37:19.726860 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724320    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 01:37:19.726860 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724323    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 01:37:19.726860 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724326    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 01:37:19.726860 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724329    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 01:37:19.726860 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724332    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 01:37:19.726860 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724335    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 01:37:19.726860 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724337    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 01:37:19.726860 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724340    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 01:37:19.726860 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724343    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 01:37:19.726860 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724346    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 01:37:19.726860 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724349    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 01:37:19.726860 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724352    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 01:37:19.726860 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724355    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 01:37:19.726860 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724358    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 01:37:19.726860 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724361    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 01:37:19.726860 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724363    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 01:37:19.726860 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724366    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 01:37:19.727467 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724369    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 01:37:19.727467 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724372    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 01:37:19.727467 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724376    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 01:37:19.727467 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724380    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 01:37:19.727467 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724383    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 01:37:19.727467 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724386    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 01:37:19.727467 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724390    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 01:37:19.727467 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724393    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 01:37:19.727467 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724395    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 01:37:19.727467 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724398    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 01:37:19.727467 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724401    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 01:37:19.727467 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724410    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 01:37:19.727467 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724413    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 01:37:19.727467 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724416    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 01:37:19.727467 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724419    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 01:37:19.727467 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724422    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 01:37:19.727467 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724424    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 01:37:19.727467 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724427    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 01:37:19.727467 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724430    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 01:37:19.728191 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724433    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 01:37:19.728191 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724435    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 01:37:19.728191 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724438    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 01:37:19.728191 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724441    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 01:37:19.728191 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724444    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 01:37:19.728191 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724447    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 01:37:19.728191 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724450    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 01:37:19.728191 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724454    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 01:37:19.728191 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724456    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 01:37:19.728191 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724459    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 01:37:19.728191 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724462    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 01:37:19.728191 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724465    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 01:37:19.728191 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724468    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 01:37:19.728191 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724470    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 01:37:19.728191 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724473    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 01:37:19.728191 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724476    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 01:37:19.728191 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724479    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 01:37:19.728191 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724482    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 01:37:19.728191 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724485    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 01:37:19.728191 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724488    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 01:37:19.728873 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724907    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 01:37:19.728873 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724913    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 01:37:19.728873 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724916    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 01:37:19.728873 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724919    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 01:37:19.728873 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724923    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 01:37:19.728873 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724926    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 01:37:19.728873 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724929    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 01:37:19.728873 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724933    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 01:37:19.728873 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724936    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 01:37:19.728873 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724939    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 01:37:19.728873 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724941    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 01:37:19.728873 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724944    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 01:37:19.728873 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724947    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 01:37:19.728873 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724950    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 01:37:19.728873 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724953    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 01:37:19.728873 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724956    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 01:37:19.728873 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724958    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 01:37:19.728873 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724961    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 01:37:19.728873 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724964    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 01:37:19.728873 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724982    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 01:37:19.729429 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724985    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 01:37:19.729429 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724989    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 01:37:19.729429 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724991    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 01:37:19.729429 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724995    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 01:37:19.729429 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.724998    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 01:37:19.729429 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725001    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 01:37:19.729429 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725006    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 01:37:19.729429 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725009    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 01:37:19.729429 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725012    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 01:37:19.729429 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725016    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 01:37:19.729429 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725018    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 01:37:19.729429 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725021    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 01:37:19.729429 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725027    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 01:37:19.729429 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725030    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 01:37:19.729429 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725033    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 01:37:19.729429 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725036    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 01:37:19.729429 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725039    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 01:37:19.729429 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725043    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 01:37:19.729429 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725045    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 01:37:19.730076 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725049    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 01:37:19.730076 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725051    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 01:37:19.730076 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725054    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 01:37:19.730076 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725057    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 01:37:19.730076 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725060    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 01:37:19.730076 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725062    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 01:37:19.730076 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725065    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 01:37:19.730076 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725068    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 01:37:19.730076 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725071    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 01:37:19.730076 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725074    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 01:37:19.730076 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725076    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 01:37:19.730076 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725079    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 01:37:19.730076 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725083    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 01:37:19.730076 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725085    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 01:37:19.730076 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725088    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 01:37:19.730076 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725091    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 01:37:19.730076 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725094    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 01:37:19.730076 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725097    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 01:37:19.730076 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725099    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 01:37:19.730076 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725102    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 01:37:19.730634 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725105    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 01:37:19.730634 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725107    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 01:37:19.730634 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725110    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 01:37:19.730634 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725113    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 01:37:19.730634 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725116    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 01:37:19.730634 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725120    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 01:37:19.730634 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725123    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 01:37:19.730634 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725126    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 01:37:19.730634 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725129    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 01:37:19.730634 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725131    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 01:37:19.730634 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725134    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 01:37:19.730634 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725137    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 01:37:19.730634 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725140    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 01:37:19.730634 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725143    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 01:37:19.730634 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725146    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 01:37:19.730634 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725148    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 01:37:19.730634 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725151    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 01:37:19.730634 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725154    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 01:37:19.730634 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725157    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 01:37:19.730634 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725159    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 01:37:19.731244 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725162    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 01:37:19.731244 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725164    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 01:37:19.731244 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725167    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 01:37:19.731244 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725170    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 01:37:19.731244 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725172    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 01:37:19.731244 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725175    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 01:37:19.731244 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725178    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 01:37:19.731244 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725181    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 01:37:19.731244 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725183    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 01:37:19.731244 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725186    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 01:37:19.731244 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725189    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 01:37:19.731244 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725192    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 01:37:19.731244 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725194    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 01:37:19.731244 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725197    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 01:37:19.731244 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725200    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 01:37:19.731244 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725203    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 01:37:19.731244 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725205    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 01:37:19.731244 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725211    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 01:37:19.731244 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725216    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 01:37:19.731730 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.725220    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 01:37:19.731730 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725309    2571 flags.go:64] FLAG: --address="0.0.0.0"
Jul 31 01:37:19.731730 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725321    2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 31 01:37:19.731730 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725333    2571 flags.go:64] FLAG: --anonymous-auth="true"
Jul 31 01:37:19.731730 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725339    2571 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 31 01:37:19.731730 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725345    2571 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 31 01:37:19.731730 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725349    2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 31 01:37:19.731730 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725354    2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 31 01:37:19.731730 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725359    2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 31 01:37:19.731730 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725363    2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 31 01:37:19.731730 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725366    2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 31 01:37:19.731730 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725370    2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 31 01:37:19.731730 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725374    2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 31 01:37:19.731730 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725377    2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 31 01:37:19.731730 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725380    2571 flags.go:64] FLAG: --cgroup-root=""
Jul 31 01:37:19.731730 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725383    2571 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 31 01:37:19.731730 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725387    2571 flags.go:64] FLAG: --client-ca-file=""
Jul 31 01:37:19.731730 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725390    2571 flags.go:64] FLAG: --cloud-provider="external"
Jul 31 01:37:19.731730 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725393    2571 flags.go:64] FLAG: --cluster-dns="[]"
Jul 31 01:37:19.731730 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725398    2571 flags.go:64] FLAG: --cluster-domain=""
Jul 31 01:37:19.731730 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725401    2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 31 01:37:19.731730 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725405    2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 31 01:37:19.731730 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725408    2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 31 01:37:19.731730 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725412    2571 flags.go:64] FLAG: --container-log-max-files="5"
Jul 31 01:37:19.732372 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725416    2571 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 31 01:37:19.732372 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725419    2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 31 01:37:19.732372 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725422    2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 31 01:37:19.732372 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725428    2571 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 31 01:37:19.732372 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725432    2571 flags.go:64] FLAG: --contention-profiling="false"
Jul 31 01:37:19.732372 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725435    2571 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 31 01:37:19.732372 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725439    2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 31 01:37:19.732372 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725443    2571 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 31 01:37:19.732372 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725446    2571 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 31 01:37:19.732372 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725451    2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 31 01:37:19.732372 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725455    2571 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 31 01:37:19.732372 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725458    2571 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 31 01:37:19.732372 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725461    2571 flags.go:64] FLAG: --enable-load-reader="false"
Jul 31 01:37:19.732372 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725464    2571 flags.go:64] FLAG: --enable-server="true"
Jul 31 01:37:19.732372 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725468    2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 31 01:37:19.732372 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725473    2571 flags.go:64] FLAG: --event-burst="100"
Jul 31 01:37:19.732372 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725476    2571 flags.go:64] FLAG: --event-qps="50"
Jul 31 01:37:19.732372 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725480    2571 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 31 01:37:19.732372 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725483    2571 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 31 01:37:19.732372 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725486    2571 flags.go:64] FLAG: --eviction-hard=""
Jul 31 01:37:19.732372 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725491    2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 31 01:37:19.732372 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725494    2571 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 31 01:37:19.732372 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725497    2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 31 01:37:19.732372 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725500    2571 flags.go:64] FLAG: --eviction-soft=""
Jul 31 01:37:19.732372 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725503    2571 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 31 01:37:19.733086 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725506    2571 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 31 01:37:19.733086 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725510    2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 31 01:37:19.733086 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725513    2571 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 31 01:37:19.733086 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725516    2571 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 31 01:37:19.733086 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725519    2571 flags.go:64] FLAG: --fail-swap-on="true"
Jul 31 01:37:19.733086 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725522    2571 flags.go:64] FLAG: --feature-gates=""
Jul 31 01:37:19.733086 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725527    2571 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 31 01:37:19.733086 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725530    2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 31 01:37:19.733086 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725533    2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 31 01:37:19.733086 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725537    2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 31 01:37:19.733086 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725542    2571 flags.go:64] FLAG: --healthz-port="10248"
Jul 31 01:37:19.733086 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725545    2571 flags.go:64] FLAG: --help="false"
Jul 31 01:37:19.733086 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725549    2571 flags.go:64] FLAG: --hostname-override="ip-10-0-133-91.ec2.internal"
Jul 31 01:37:19.733086 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725552    2571 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 31 01:37:19.733086 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725556    2571 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 31 01:37:19.733086 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725559    2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 31 01:37:19.733086 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725563    2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 31 01:37:19.733086 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725567    2571 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 31 01:37:19.733086 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725570    2571 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 31 01:37:19.733086 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725573    2571 flags.go:64] FLAG: --image-service-endpoint=""
Jul 31 01:37:19.733086 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725576    2571 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 31 01:37:19.733086 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725579    2571 flags.go:64] FLAG: --kube-api-burst="100"
Jul 31 01:37:19.733086 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725583    2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 31 01:37:19.733757 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725587    2571 flags.go:64] FLAG: --kube-api-qps="50"
Jul 31 01:37:19.733757 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725590    2571 flags.go:64] FLAG: --kube-reserved=""
Jul 31 01:37:19.733757 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725593    2571 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 31 01:37:19.733757 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725597    2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 31 01:37:19.733757 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725600    2571 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 31 01:37:19.733757 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725603    2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 31 01:37:19.733757 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725606    2571 flags.go:64] FLAG: --lock-file=""
Jul 31 01:37:19.733757 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725609    2571 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 31 01:37:19.733757 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725612    2571 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 31 01:37:19.733757 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725615    2571 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 31 01:37:19.733757 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725622    2571 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 31 01:37:19.733757 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725625    2571 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 31 01:37:19.733757 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725628    2571 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 31 01:37:19.733757 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725631    2571 flags.go:64] FLAG: --logging-format="text"
Jul 31 01:37:19.733757 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725634    2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 31 01:37:19.733757 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725637    2571 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 31 01:37:19.733757 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725641    2571 flags.go:64] FLAG: --manifest-url=""
Jul 31 01:37:19.733757 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725644    2571 flags.go:64] FLAG: --manifest-url-header=""
Jul 31 01:37:19.733757 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725648    2571 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 31 01:37:19.733757 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725654    2571 flags.go:64] FLAG: --max-open-files="1000000"
Jul 31 01:37:19.733757 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725658    2571 flags.go:64] FLAG: --max-pods="110"
Jul 31 01:37:19.733757 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725662    2571 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 31 01:37:19.733757 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725665    2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 31 01:37:19.733757 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725669    2571 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 31 01:37:19.733757 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725672    2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 31 01:37:19.734476 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725676    2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 31 01:37:19.734476 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725679    2571 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 31 01:37:19.734476 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725682    2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 31 01:37:19.734476 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725690    2571 flags.go:64] FLAG: --node-status-max-images="50"
Jul 31 01:37:19.734476 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725693    2571 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 31 01:37:19.734476 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725697    2571 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 31 01:37:19.734476 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725700    2571 flags.go:64] FLAG: --pod-cidr=""
Jul 31 01:37:19.734476 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725704    2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Jul 31 01:37:19.734476 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725710    2571 flags.go:64] FLAG: --pod-manifest-path=""
Jul 31 01:37:19.734476 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725713    2571 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 31 01:37:19.734476 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725717    2571 flags.go:64] FLAG: --pods-per-core="0"
Jul 31 01:37:19.734476 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725720    2571 flags.go:64] FLAG: --port="10250"
Jul 31 01:37:19.734476 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725723    2571 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 31 01:37:19.734476 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725727    2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-068a28b84df66b1d9"
Jul 31 01:37:19.734476 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725730    2571 flags.go:64] FLAG: --qos-reserved=""
Jul 31 01:37:19.734476 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725733    2571 flags.go:64] FLAG: --read-only-port="10255"
Jul 31 01:37:19.734476 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725736    2571 flags.go:64] FLAG: --register-node="true"
Jul 31 01:37:19.734476 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725739    2571 flags.go:64] FLAG: --register-with-taints=""
Jul 31 01:37:19.734476 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725743    2571 flags.go:64] FLAG: --registry-burst="10"
Jul 31 01:37:19.734476 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725746    2571 flags.go:64] FLAG: --registry-qps="5"
Jul 31 01:37:19.734476 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725749    2571 flags.go:64] FLAG: --reserved-cpus=""
Jul 31 01:37:19.734476 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725752    2571 flags.go:64] FLAG: --reserved-memory=""
Jul 31 01:37:19.734476 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725756    2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 31 01:37:19.734476 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725760    2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 31 01:37:19.734476 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725763    2571 flags.go:64] FLAG: --rotate-certificates="false"
Jul 31 01:37:19.735188 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725766    2571 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 31 01:37:19.735188 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725771    2571 flags.go:64] FLAG: --runonce="false"
Jul 31 01:37:19.735188 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725775    2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 31 01:37:19.735188 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725778    2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 31 01:37:19.735188 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725781    2571 flags.go:64] FLAG: --seccomp-default="false"
Jul 31 01:37:19.735188 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725785    2571 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 31 01:37:19.735188 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725788    2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 31 01:37:19.735188 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725791    2571 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 31 01:37:19.735188 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725795    2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 31 01:37:19.735188 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725798    2571 flags.go:64] FLAG: --storage-driver-password="root"
Jul 31 01:37:19.735188 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725801    2571 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 31 01:37:19.735188 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725804    2571 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 31 01:37:19.735188 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725808    2571 flags.go:64] FLAG: --storage-driver-user="root"
Jul 31 01:37:19.735188 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725811    2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 31 01:37:19.735188 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725814    2571 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 31 01:37:19.735188 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725818    2571 flags.go:64] FLAG: --system-cgroups=""
Jul 31 01:37:19.735188 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725822    2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 31 01:37:19.735188 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725828    2571 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 31 01:37:19.735188 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725831    2571 flags.go:64] FLAG: --tls-cert-file=""
Jul 31 01:37:19.735188 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725834    2571 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 31 01:37:19.735188 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725838    2571 flags.go:64] FLAG: --tls-min-version=""
Jul 31 01:37:19.735188 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725841    2571 flags.go:64] FLAG: --tls-private-key-file=""
Jul 31 01:37:19.735188 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725844    2571 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 31 01:37:19.735188 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725847    2571 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 31 01:37:19.735188 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725850    2571 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 31 01:37:19.735852 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725854    2571 flags.go:64] FLAG: --v="2"
Jul 31 01:37:19.735852 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725858    2571 flags.go:64] FLAG: --version="false"
Jul 31 01:37:19.735852 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725863    2571 flags.go:64] FLAG: --vmodule=""
Jul 31 01:37:19.735852 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725867    2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 31 01:37:19.735852 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.725870    2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 31 01:37:19.735852 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726020    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 01:37:19.735852 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726024    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 01:37:19.735852 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726028    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 01:37:19.735852 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726033    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 01:37:19.735852 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726036    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 01:37:19.735852 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726039    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 01:37:19.735852 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726042    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 01:37:19.735852 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726047    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 01:37:19.735852 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726050    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 01:37:19.735852 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726054    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 01:37:19.735852 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726057    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 01:37:19.735852 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726059    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 01:37:19.735852 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726062    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 01:37:19.735852 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726065    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 01:37:19.735852 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726068    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 01:37:19.735852 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726071    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 01:37:19.736447 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726074    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 01:37:19.736447 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726077    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 01:37:19.736447 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726080    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 01:37:19.736447 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726083    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 01:37:19.736447 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726086    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 01:37:19.736447 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726089    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 01:37:19.736447 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726092    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 01:37:19.736447 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726094    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 01:37:19.736447 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726097    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 01:37:19.736447 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726100    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 01:37:19.736447 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726103    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 01:37:19.736447 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726106    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 01:37:19.736447 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726109    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 01:37:19.736447 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726112    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 01:37:19.736447 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726114    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 01:37:19.736447 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726117    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 01:37:19.736447 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726120    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 01:37:19.736447 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726123    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 01:37:19.736447 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726125    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 01:37:19.737025 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726130    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 01:37:19.737025 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726133    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 01:37:19.737025 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726135    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 01:37:19.737025 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726138    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 01:37:19.737025 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726143    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 01:37:19.737025 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726145    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 01:37:19.737025 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726148    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 01:37:19.737025 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726151    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 01:37:19.737025 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726154    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 01:37:19.737025 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726157    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 01:37:19.737025 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726161    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 01:37:19.737025 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726164    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 01:37:19.737025 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726166    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 01:37:19.737025 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726169    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 01:37:19.737025 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726172    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 01:37:19.737025 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726176    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 01:37:19.737025 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726180    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 01:37:19.737025 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726183    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 01:37:19.737025 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726187    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 01:37:19.737025 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726189    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 01:37:19.737559 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726192    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 01:37:19.737559 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726195    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 01:37:19.737559 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726198    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 01:37:19.737559 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726200    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 01:37:19.737559 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726203    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 01:37:19.737559 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726206    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 01:37:19.737559 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726209    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 01:37:19.737559 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726212    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 01:37:19.737559 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726214    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 01:37:19.737559 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726217    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 01:37:19.737559 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726221    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 01:37:19.737559 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726225    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 01:37:19.737559 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726229    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 01:37:19.737559 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726233    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 01:37:19.737559 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726236    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 01:37:19.737559 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726240    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 01:37:19.737559 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726245    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 01:37:19.737559 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726248    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 01:37:19.737559 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726250    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 01:37:19.738075 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726254    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 01:37:19.738075 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726257    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 01:37:19.738075 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726260    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 01:37:19.738075 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726264    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 01:37:19.738075 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726267    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 01:37:19.738075 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726270    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 01:37:19.738075 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726273    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 01:37:19.738075 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726275    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 01:37:19.738075 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726278    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 01:37:19.738075 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726281    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 01:37:19.738075 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726284    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 01:37:19.738075 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726287    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 01:37:19.738075 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726290    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 01:37:19.738075 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726293    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 01:37:19.738075 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726296    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 01:37:19.738075 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726298    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 01:37:19.738075 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726301    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 01:37:19.738075 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726304    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 01:37:19.738075 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726307    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 01:37:19.738075 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726309    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 01:37:19.738075 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726312    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 01:37:19.738619 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726315    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 01:37:19.738619 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726318    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 01:37:19.738619 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726320    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 01:37:19.738619 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.726324    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 01:37:19.738619 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.727175    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 01:37:19.738619 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.734743    2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 31 01:37:19.738619 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.734764    2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 31 01:37:19.738619 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.734800    2571 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 31 01:37:19.738619 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.734806    2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 31 01:37:19.738619 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734872    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 01:37:19.738619 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734878    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 01:37:19.738619 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734882    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 01:37:19.738619 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734885    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 01:37:19.738619 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734889    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 01:37:19.739022 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734893    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 01:37:19.739022 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734896    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 01:37:19.739022 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734899    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 01:37:19.739022 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734902    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 01:37:19.739022 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734906    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 01:37:19.739022 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734909    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 01:37:19.739022 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734911    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 01:37:19.739022 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734915    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 01:37:19.739022 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734918    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 01:37:19.739022 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734921    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 01:37:19.739022 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734923    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 01:37:19.739022 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734926    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 01:37:19.739022 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734929    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 01:37:19.739022 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734932    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 01:37:19.739022 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734935    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 01:37:19.739022 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734937    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 01:37:19.739022 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734940    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 01:37:19.739022 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734943    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 01:37:19.739022 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734945    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 01:37:19.739521 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734948    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 01:37:19.739521 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734951    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 01:37:19.739521 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734953    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 01:37:19.739521 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734957    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 01:37:19.739521 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734959    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 01:37:19.739521 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734963    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 01:37:19.739521 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734966    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 01:37:19.739521 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734984    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 01:37:19.739521 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734987    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 01:37:19.739521 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734990    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 01:37:19.739521 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734993    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 01:37:19.739521 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734996    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 01:37:19.739521 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.734999    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 01:37:19.739521 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735002    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 01:37:19.739521 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735004    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 01:37:19.739521 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735007    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 01:37:19.739521 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735010    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 01:37:19.739521 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735015    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 01:37:19.739521 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735018    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 01:37:19.740038 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735021    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 01:37:19.740038 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735024    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 01:37:19.740038 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735027    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 01:37:19.740038 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735030    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 01:37:19.740038 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735033    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 01:37:19.740038 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735036    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 01:37:19.740038 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735039    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 01:37:19.740038 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735041    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 01:37:19.740038 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735044    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 01:37:19.740038 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735047    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 01:37:19.740038 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735050    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 01:37:19.740038 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735053    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 01:37:19.740038 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735056    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 01:37:19.740038 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735059    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 01:37:19.740038 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735062    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 01:37:19.740038 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735065    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 01:37:19.740038 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735067    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 01:37:19.740038 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735070    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 01:37:19.740038 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735074    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 01:37:19.740038 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735077    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 01:37:19.740578 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735080    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 01:37:19.740578 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735084    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 01:37:19.740578 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735086    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 01:37:19.740578 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735089    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 01:37:19.740578 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735093    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 01:37:19.740578 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735095    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 01:37:19.740578 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735098    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 01:37:19.740578 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735101    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 01:37:19.740578 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735104    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 01:37:19.740578 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735106    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 01:37:19.740578 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735109    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 01:37:19.740578 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735112    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 01:37:19.740578 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735115    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 01:37:19.740578 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735118    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 01:37:19.740578 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735120    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 01:37:19.740578 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735123    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 01:37:19.740578 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735126    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 01:37:19.740578 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735131    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 01:37:19.740578 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735135    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 01:37:19.740578 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735138    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 01:37:19.741142 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735141    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 01:37:19.741142 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735145    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 01:37:19.741142 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735148    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 01:37:19.741142 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735153    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 01:37:19.741142 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735156    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 01:37:19.741142 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735159    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 01:37:19.741142 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735162    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 01:37:19.741142 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735165    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 01:37:19.741142 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735168    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 01:37:19.741142 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735170    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 01:37:19.741142 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735174    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 01:37:19.741142 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735177    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 01:37:19.741142 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735179    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 01:37:19.741142 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735182    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 01:37:19.741142 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735185    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 01:37:19.741142 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735188    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 01:37:19.741574 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.735195    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 01:37:19.741574 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735327    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 01:37:19.741574 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735333    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 01:37:19.741574 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735336    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 01:37:19.741574 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735340    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 01:37:19.741574 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735343    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 01:37:19.741574 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735345    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 01:37:19.741574 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735348    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 01:37:19.741574 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735352    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 01:37:19.741574 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735357    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 01:37:19.741574 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735361    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 01:37:19.741574 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735364    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 01:37:19.741574 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735367    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 01:37:19.741574 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735371    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 01:37:19.741937 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735373    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 01:37:19.741937 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735376    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 01:37:19.741937 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735379    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 01:37:19.741937 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735382    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 01:37:19.741937 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735385    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 01:37:19.741937 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735388    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 01:37:19.741937 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735390    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 01:37:19.741937 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735393    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 01:37:19.741937 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735396    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 01:37:19.741937 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735398    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 01:37:19.741937 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735401    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 01:37:19.741937 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735404    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 01:37:19.741937 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735407    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 01:37:19.741937 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735410    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 01:37:19.741937 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735412    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 01:37:19.741937 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735415    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 01:37:19.741937 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735418    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 01:37:19.741937 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735421    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 01:37:19.741937 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735424    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 01:37:19.741937 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735426    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 01:37:19.742615 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735429    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 01:37:19.742615 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735432    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 01:37:19.742615 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735435    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 01:37:19.742615 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735437    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 01:37:19.742615 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735440    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 01:37:19.742615 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735443    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 01:37:19.742615 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735445    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 01:37:19.742615 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735448    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 01:37:19.742615 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735451    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 01:37:19.742615 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735454    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 01:37:19.742615 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735457    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 01:37:19.742615 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735460    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 01:37:19.742615 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735463    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 01:37:19.742615 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735466    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 01:37:19.742615 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735469    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 01:37:19.742615 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735471    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 01:37:19.742615 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735474    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 01:37:19.742615 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735477    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 01:37:19.742615 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735480    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 01:37:19.743177 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735483    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 01:37:19.743177 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735485    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 01:37:19.743177 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735488    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 01:37:19.743177 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735491    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 01:37:19.743177 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735494    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 01:37:19.743177 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735497    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 01:37:19.743177 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735500    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 01:37:19.743177 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735502    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 01:37:19.743177 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735505    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 01:37:19.743177 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735508    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 01:37:19.743177 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735511    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 01:37:19.743177 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735514    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 01:37:19.743177 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735516    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 01:37:19.743177 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735519    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 01:37:19.743177 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735522    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 01:37:19.743177 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735525    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 01:37:19.743177 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735528    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 01:37:19.743177 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735530    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 01:37:19.743177 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735533    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 01:37:19.743177 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735535    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 01:37:19.744058 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735538    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 01:37:19.744058 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735541    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 01:37:19.744058 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735545    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 01:37:19.744058 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735549    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 01:37:19.744058 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735552    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 01:37:19.744058 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735555    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 01:37:19.744058 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735558    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 01:37:19.744058 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735561    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 01:37:19.744058 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735564    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 01:37:19.744058 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735566    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 01:37:19.744058 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735569    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 01:37:19.744058 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735572    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 01:37:19.744058 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735574    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 01:37:19.744058 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735577    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 01:37:19.744058 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735579    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 01:37:19.744058 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735582    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 01:37:19.744058 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735585    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 01:37:19.744058 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735588    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 01:37:19.744058 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735591    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 01:37:19.744058 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735594    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 01:37:19.744736 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735596    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 01:37:19.744736 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735599    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 01:37:19.744736 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735602    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 01:37:19.744736 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735604    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 01:37:19.744736 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735607    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 01:37:19.744736 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735609    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 01:37:19.744736 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:19.735612    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 01:37:19.744736 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.735617    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 01:37:19.744736 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.735742    2571 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 31 01:37:19.744736 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.737953    2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 31 01:37:19.744736 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.739641    2571 server.go:1019] "Starting client certificate rotation"
Jul 31 01:37:19.744736 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.739746    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 31 01:37:19.744736 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.739787    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 31 01:37:19.745131 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.742394    2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 31 01:37:19.748483 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.748462    2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 31 01:37:19.759428 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.759406    2571 log.go:25] "Validated CRI v1 runtime API"
Jul 31 01:37:19.761626 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.761608    2571 log.go:25] "Validated CRI v1 image API"
Jul 31 01:37:19.762442 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.762427    2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 31 01:37:19.765187 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.765164    2571 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 865538c3-f955-49b2-b0cd-8532d687b042:/dev/nvme0n1p3 fd117b80-a38f-4fbd-85a5-e4c91966c99e:/dev/nvme0n1p4]
Jul 31 01:37:19.765277 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.765187    2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 31 01:37:19.770646 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.770521    2571 manager.go:216] Machine: {Timestamp:2026-07-31 01:37:19.769173959 +0000 UTC m=+0.349414948 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103398 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a8e00368ac9db000a2cc460b3101f SystemUUID:ec2a8e00-368a-c9db-000a-2cc460b3101f BootID:90e1f32e-52e2-41ea-8b24-3e4a07fded0b Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5a:3c:43:8e:8b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5a:3c:43:8e:8b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:eb:38:9b:bb:64 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 31 01:37:19.770646 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.770641    2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 31 01:37:19.770764 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.770747    2571 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 31 01:37:19.772926 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.772891    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 31 01:37:19.774144 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.774112    2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 31 01:37:19.774310 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.774146    2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-91.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 31 01:37:19.774858 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.774848    2571 topology_manager.go:138] "Creating topology manager with none policy"
Jul 31 01:37:19.774891 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.774861    2571 container_manager_linux.go:309] "Creating device plugin manager"
Jul 31 01:37:19.774891 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.774869    2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 31 01:37:19.775540 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.775529    2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 31 01:37:19.776900 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.776889    2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 31 01:37:19.781494 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.781475    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 31 01:37:19.781644 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.781634    2571 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 31 01:37:19.781686 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.781669    2571 kubelet.go:486] "Attempting to sync node with API server"
Jul 31 01:37:19.781686 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.781684    2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 31 01:37:19.781758 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.781706    2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 31 01:37:19.781758 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.781719    2571 kubelet.go:398] "Adding apiserver pod source"
Jul 31 01:37:19.781758 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.781729    2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 31 01:37:19.782271 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.782257    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 31 01:37:19.782312 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.782279    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 31 01:37:19.785070 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.785046    2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 31 01:37:19.786662 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.786648    2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 31 01:37:19.786719 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.786680    2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 31 01:37:19.787405 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.787389    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 31 01:37:19.787405 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.787409    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 31 01:37:19.787544 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.787420    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 31 01:37:19.787544 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.787427    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 31 01:37:19.787544 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.787436    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 31 01:37:19.787544 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.787442    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 31 01:37:19.787544 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.787450    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 31 01:37:19.787544 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.787456    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 31 01:37:19.787544 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.787463    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 31 01:37:19.787544 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.787468    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 31 01:37:19.787544 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.787490    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 31 01:37:19.787544 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.787496    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 31 01:37:19.789159 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.789147    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 31 01:37:19.789159 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.789159    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 31 01:37:19.792852 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.792835    2571 server.go:1268] "Started kubelet"
Jul 31 01:37:19.793027 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.792967    2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 31 01:37:19.793093 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.793057    2571 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 31 01:37:19.793316 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.793284    2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 31 01:37:19.797996 ip-10-0-133-91 systemd[1]: Started Kubernetes Kubelet.
Jul 31 01:37:19.798361 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.798337    2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 31 01:37:19.799935 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.799754    2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-91.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 31 01:37:19.800337 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:19.800288    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-91.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 31 01:37:19.800519 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:19.800488    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 31 01:37:19.800596 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.800527    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lh9cq"
Jul 31 01:37:19.800845 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.800825    2571 server.go:310] "Adding debug handlers to kubelet server"
Jul 31 01:37:19.800998 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:19.800932    2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 31 01:37:19.803297 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:19.802183    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-91.ec2.internal.18c73c1560ddae54  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-91.ec2.internal,UID:ip-10-0-133-91.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-91.ec2.internal,},FirstTimestamp:2026-07-31 01:37:19.792811604 +0000 UTC m=+0.373052593,LastTimestamp:2026-07-31 01:37:19.792811604 +0000 UTC m=+0.373052593,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-91.ec2.internal,}"
Jul 31 01:37:19.806964 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.806944    2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 31 01:37:19.806964 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.806951    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 31 01:37:19.807137 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:19.807115    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-91.ec2.internal\" not found"
Jul 31 01:37:19.807577 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.807555    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lh9cq"
Jul 31 01:37:19.807720 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.807707    2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 31 01:37:19.807810 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.807707    2571 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 31 01:37:19.807888 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.807871    2571 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 31 01:37:19.808021 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.808001    2571 reconstruct.go:97] "Volume reconstruction finished"
Jul 31 01:37:19.808021 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.808018    2571 reconciler.go:29] "Reconciler: start to sync state"
Jul 31 01:37:19.808180 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.808162    2571 factory.go:55] Registering systemd factory
Jul 31 01:37:19.808240 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.808184    2571 factory.go:223] Registration of the systemd container factory successfully
Jul 31 01:37:19.808434 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.808417    2571 factory.go:153] Registering CRI-O factory
Jul 31 01:37:19.808434 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.808433    2571 factory.go:223] Registration of the crio container factory successfully
Jul 31 01:37:19.808583 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.808480    2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 31 01:37:19.808583 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.808502    2571 factory.go:103] Registering Raw factory
Jul 31 01:37:19.808583 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.808528    2571 manager.go:1196] Started watching for new ooms in manager
Jul 31 01:37:19.809149 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.809133    2571 manager.go:349] Starting recovery of all containers
Jul 31 01:37:19.810722 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:19.810695    2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-91.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 31 01:37:19.810828 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:19.810807    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 31 01:37:19.821346 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.821317    2571 manager.go:354] Recovery completed
Jul 31 01:37:19.823300 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:19.823271    2571 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 31 01:37:19.826550 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.826537    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 01:37:19.828645 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.828624    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 01:37:19.828753 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.828660    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 01:37:19.828753 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.828679    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-91.ec2.internal" event="NodeHasSufficientPID"
Jul 31 01:37:19.829220 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.829206    2571 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 31 01:37:19.829220 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.829218    2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 31 01:37:19.829220 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.829218    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 01:37:19.829403 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.829233    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 31 01:37:19.830186 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.830166    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 01:37:19.830229 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.830204    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 01:37:19.830229 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.830219    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-91.ec2.internal" event="NodeHasSufficientPID"
Jul 31 01:37:19.831405 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.831391    2571 policy_none.go:49] "None policy: Start"
Jul 31 01:37:19.831453 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.831409    2571 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 31 01:37:19.831453 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.831420    2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 31 01:37:19.833418 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.833407    2571 policy_none.go:47] "Start"
Jul 31 01:37:19.879890 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.879636    2571 manager.go:337] "Starting Device Plugin manager"
Jul 31 01:37:19.879890 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:19.879877    2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 31 01:37:19.879890 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.879894    2571 server.go:87] "Starting device plugin registration server"
Jul 31 01:37:19.880247 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.880235    2571 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 31 01:37:19.880288 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.880254    2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 31 01:37:19.880431 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.880390    2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 31 01:37:19.880520 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.880481    2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 31 01:37:19.880520 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.880489    2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 31 01:37:19.881142 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:19.881117    2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 31 01:37:19.881223 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:19.881182    2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-91.ec2.internal\" not found"
Jul 31 01:37:19.981682 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.981648    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 01:37:19.983953 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.982955    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 01:37:19.983953 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.982987    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 01:37:19.983953 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.983004    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-91.ec2.internal" event="NodeHasSufficientPID"
Jul 31 01:37:19.983953 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.983033    2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-91.ec2.internal"
Jul 31 01:37:19.983953 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.983707    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 31 01:37:19.985129 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.985109    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 31 01:37:19.985173 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.985163    2571 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 31 01:37:19.985219 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.985188    2571 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 31 01:37:19.985267 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:19.985229    2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 31 01:37:19.987321 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.987294    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 01:37:19.991449 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:19.991432    2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-91.ec2.internal"
Jul 31 01:37:19.991547 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:19.991455    2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-91.ec2.internal\": node \"ip-10-0-133-91.ec2.internal\" not found"
Jul 31 01:37:20.037154 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:20.037118    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-91.ec2.internal\" not found"
Jul 31 01:37:20.089150 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.089096    2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-91.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-91.ec2.internal"]
Jul 31 01:37:20.089237 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.089209    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 01:37:20.090369 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.090351    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 01:37:20.090453 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.090384    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 01:37:20.090453 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.090395    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-91.ec2.internal" event="NodeHasSufficientPID"
Jul 31 01:37:20.092952 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.092937    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 01:37:20.093096 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.093079    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-91.ec2.internal"
Jul 31 01:37:20.093141 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.093119    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 01:37:20.093700 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.093676    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 01:37:20.093806 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.093712    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 01:37:20.093806 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.093724    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-91.ec2.internal" event="NodeHasSufficientPID"
Jul 31 01:37:20.093806 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.093723    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 01:37:20.093806 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.093799    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 01:37:20.093970 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.093810    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-91.ec2.internal" event="NodeHasSufficientPID"
Jul 31 01:37:20.096122 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.096103    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-91.ec2.internal"
Jul 31 01:37:20.096205 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.096130    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 01:37:20.096874 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.096854    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-91.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 01:37:20.096953 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.096888    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-91.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 01:37:20.096953 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.096905    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-91.ec2.internal" event="NodeHasSufficientPID"
Jul 31 01:37:20.109963 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.109943    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f05a7e3d33391cf18a6238fa486d743-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-91.ec2.internal\" (UID: \"8f05a7e3d33391cf18a6238fa486d743\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-91.ec2.internal"
Jul 31 01:37:20.110066 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.109973    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b1da00732300b353fe684ed60474f6b-config\") pod \"kube-apiserver-proxy-ip-10-0-133-91.ec2.internal\" (UID: \"2b1da00732300b353fe684ed60474f6b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-91.ec2.internal"
Jul 31 01:37:20.110066 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.109996    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8f05a7e3d33391cf18a6238fa486d743-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-91.ec2.internal\" (UID: \"8f05a7e3d33391cf18a6238fa486d743\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-91.ec2.internal"
Jul 31 01:37:20.122945 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:20.122919    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-91.ec2.internal\" not found" node="ip-10-0-133-91.ec2.internal"
Jul 31 01:37:20.126704 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:20.126682    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-91.ec2.internal\" not found" node="ip-10-0-133-91.ec2.internal"
Jul 31 01:37:20.137283 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:20.137235    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-91.ec2.internal\" not found"
Jul 31 01:37:20.210438 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.210404    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8f05a7e3d33391cf18a6238fa486d743-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-91.ec2.internal\" (UID: \"8f05a7e3d33391cf18a6238fa486d743\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-91.ec2.internal"
Jul 31 01:37:20.210438 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.210438    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f05a7e3d33391cf18a6238fa486d743-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-91.ec2.internal\" (UID: \"8f05a7e3d33391cf18a6238fa486d743\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-91.ec2.internal"
Jul 31 01:37:20.210619 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.210457    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b1da00732300b353fe684ed60474f6b-config\") pod \"kube-apiserver-proxy-ip-10-0-133-91.ec2.internal\" (UID: \"2b1da00732300b353fe684ed60474f6b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-91.ec2.internal"
Jul 31 01:37:20.210619 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.210509    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b1da00732300b353fe684ed60474f6b-config\") pod \"kube-apiserver-proxy-ip-10-0-133-91.ec2.internal\" (UID: \"2b1da00732300b353fe684ed60474f6b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-91.ec2.internal"
Jul 31 01:37:20.210619 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.210513    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8f05a7e3d33391cf18a6238fa486d743-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-91.ec2.internal\" (UID: \"8f05a7e3d33391cf18a6238fa486d743\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-91.ec2.internal"
Jul 31 01:37:20.210619 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.210527    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f05a7e3d33391cf18a6238fa486d743-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-91.ec2.internal\" (UID: \"8f05a7e3d33391cf18a6238fa486d743\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-91.ec2.internal"
Jul 31 01:37:20.238695 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:20.238652    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-91.ec2.internal\" not found"
Jul 31 01:37:20.341096 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:20.341053    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-91.ec2.internal\" not found"
Jul 31 01:37:20.424850 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.424774    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-91.ec2.internal"
Jul 31 01:37:20.430561 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.430375    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-91.ec2.internal"
Jul 31 01:37:20.441950 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:20.441927    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-91.ec2.internal\" not found"
Jul 31 01:37:20.544191 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:20.544132    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-91.ec2.internal\" not found"
Jul 31 01:37:20.644839 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:20.644799    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-91.ec2.internal\" not found"
Jul 31 01:37:20.738456 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.738375    2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 31 01:37:20.738957 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.738537    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 31 01:37:20.740894 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.740877    2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 01:37:20.745996 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:20.745978    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-91.ec2.internal\" not found"
Jul 31 01:37:20.813797 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.813762    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-30 01:32:20 +0000 UTC" deadline="2028-04-17 20:16:06.130301412 +0000 UTC"
Jul 31 01:37:20.813797 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:20.813790    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15042h38m45.316514913s"
Jul 31 01:37:20.846761 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:20.846710    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-91.ec2.internal\" not found"
Jul 31 01:37:20.946913 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:20.946867    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-91.ec2.internal\" not found"
Jul 31 01:37:21.047047 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:21.046968    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-91.ec2.internal\" not found"
Jul 31 01:37:21.110338 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:21.110300    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f05a7e3d33391cf18a6238fa486d743.slice/crio-680cfe57b17625dcf92c42fe4cd8dc96c9440703430edd752332aa50b0a77088 WatchSource:0}: Error finding container 680cfe57b17625dcf92c42fe4cd8dc96c9440703430edd752332aa50b0a77088: Status 404 returned error can't find the container with id 680cfe57b17625dcf92c42fe4cd8dc96c9440703430edd752332aa50b0a77088
Jul 31 01:37:21.116342 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.116319    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 01:37:21.122139 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:21.122113    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b1da00732300b353fe684ed60474f6b.slice/crio-c7cd9cd4793a2081c21f1be6600e66db616ca18d01fccb32e340498fe2fcc231 WatchSource:0}: Error finding container c7cd9cd4793a2081c21f1be6600e66db616ca18d01fccb32e340498fe2fcc231: Status 404 returned error can't find the container with id c7cd9cd4793a2081c21f1be6600e66db616ca18d01fccb32e340498fe2fcc231
Jul 31 01:37:21.124430 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.124355    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 01:37:21.211570 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.211529    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-91.ec2.internal"
Jul 31 01:37:21.223281 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.223261    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 31 01:37:21.224458 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.224444    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-91.ec2.internal"
Jul 31 01:37:21.231173 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.231158    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 31 01:37:21.244450 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.244428    2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 01:37:21.784593 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.784556    2571 apiserver.go:52] "Watching apiserver"
Jul 31 01:37:21.794091 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.794059    2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 31 01:37:21.794626 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.794601    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-91.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx","openshift-cluster-node-tuning-operator/tuned-th4tz","openshift-dns/node-resolver-l4gcr","openshift-image-registry/node-ca-5vkv9","openshift-multus/multus-additional-cni-plugins-g97dz","openshift-multus/multus-krg4k","openshift-multus/network-metrics-daemon-dbn98","kube-system/global-pull-secret-syncer-5sd9h","kube-system/konnectivity-agent-kxjk7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-91.ec2.internal","openshift-network-diagnostics/network-check-target-78xx9","openshift-network-operator/iptables-alerter-4vfkb","openshift-ovn-kubernetes/ovnkube-node-6r5df"]
Jul 31 01:37:21.797390 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.797363    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.800036 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.800014    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4vfkb"
Jul 31 01:37:21.802112 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.802089    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 31 01:37:21.802367 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.802346    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jmrmw\""
Jul 31 01:37:21.802576 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.802552    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 31 01:37:21.802860 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.802840    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7dktv\""
Jul 31 01:37:21.803167 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.803151    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 31 01:37:21.803450 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.803432    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 31 01:37:21.803748 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.803731    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 31 01:37:21.804003 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.803988    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 31 01:37:21.804226 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.804209    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 31 01:37:21.804550 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.804532    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.805226 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.805206    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l4gcr"
Jul 31 01:37:21.807003 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.806968    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 31 01:37:21.807003 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.806994    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 31 01:37:21.807273 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.807242    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-965cs\""
Jul 31 01:37:21.808325 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.807431    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5vkv9"
Jul 31 01:37:21.808325 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.807520    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 31 01:37:21.808325 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.807811    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 31 01:37:21.808325 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.808142    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 31 01:37:21.808325 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.808320    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-n6nsp\""
Jul 31 01:37:21.810744 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.809711    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g97dz"
Jul 31 01:37:21.810744 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.810256    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 31 01:37:21.810744 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.810286    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 31 01:37:21.810744 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.810265    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 31 01:37:21.810744 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.810411    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fmdz4\""
Jul 31 01:37:21.812455 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.812049    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:21.812455 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:21.812128    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sd9h" podUID="d7a3c161-fb9a-48d4-b150-58fe365b2a6c"
Jul 31 01:37:21.812732 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.812615    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 31 01:37:21.812945 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.812853    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mjqm5\""
Jul 31 01:37:21.813420 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.813395    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 31 01:37:21.815185 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.815134    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:21.817755 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.817456    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx"
Jul 31 01:37:21.817755 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.817656    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 31 01:37:21.819454 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.819429    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gr4v\" (UniqueName: \"kubernetes.io/projected/ee0ad41b-adbe-4764-ab09-a9c0f058082d-kube-api-access-8gr4v\") pod \"multus-additional-cni-plugins-g97dz\" (UID: \"ee0ad41b-adbe-4764-ab09-a9c0f058082d\") " pod="openshift-multus/multus-additional-cni-plugins-g97dz"
Jul 31 01:37:21.819549 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.819474    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b02ea9cd-e292-44df-8d6a-113fd9848370-multus-daemon-config\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.819549 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.819525    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwtkf\" (UniqueName: \"kubernetes.io/projected/ccac2337-37fd-4a50-b0da-8179fafdd6d2-kube-api-access-lwtkf\") pod \"iptables-alerter-4vfkb\" (UID: \"ccac2337-37fd-4a50-b0da-8179fafdd6d2\") " pod="openshift-network-operator/iptables-alerter-4vfkb"
Jul 31 01:37:21.819668 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.819580    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-etc-sysconfig\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.819668 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.819622    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-etc-sysctl-d\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.819668 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.819651    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-lib-modules\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.819819 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.819684    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-host\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.819819 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.819729    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-host-var-lib-cni-bin\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.819819 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.819762    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ee0ad41b-adbe-4764-ab09-a9c0f058082d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g97dz\" (UID: \"ee0ad41b-adbe-4764-ab09-a9c0f058082d\") " pod="openshift-multus/multus-additional-cni-plugins-g97dz"
Jul 31 01:37:21.819819 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.819796    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/09fec214-2f3f-4166-8687-3c1c822794c3-serviceca\") pod \"node-ca-5vkv9\" (UID: \"09fec214-2f3f-4166-8687-3c1c822794c3\") " pod="openshift-image-registry/node-ca-5vkv9"
Jul 31 01:37:21.820158 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.819830    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee0ad41b-adbe-4764-ab09-a9c0f058082d-cnibin\") pod \"multus-additional-cni-plugins-g97dz\" (UID: \"ee0ad41b-adbe-4764-ab09-a9c0f058082d\") " pod="openshift-multus/multus-additional-cni-plugins-g97dz"
Jul 31 01:37:21.820158 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.819869    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-etc-systemd\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.820158 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.819901    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vnbr\" (UniqueName: \"kubernetes.io/projected/522b6666-22de-4d13-9794-07680e2375d6-kube-api-access-9vnbr\") pod \"node-resolver-l4gcr\" (UID: \"522b6666-22de-4d13-9794-07680e2375d6\") " pod="openshift-dns/node-resolver-l4gcr"
Jul 31 01:37:21.820158 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.819933    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee0ad41b-adbe-4764-ab09-a9c0f058082d-cni-binary-copy\") pod \"multus-additional-cni-plugins-g97dz\" (UID: \"ee0ad41b-adbe-4764-ab09-a9c0f058082d\") " pod="openshift-multus/multus-additional-cni-plugins-g97dz"
Jul 31 01:37:21.820158 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.819964    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-system-cni-dir\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.820158 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.820023    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-os-release\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.820158 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.820083    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b02ea9cd-e292-44df-8d6a-113fd9848370-cni-binary-copy\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.820158 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.820140    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-host-var-lib-cni-multus\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.820583 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.820173    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-host-run-multus-certs\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.820583 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.820204    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5c45f8a-a655-4813-8c7c-f26041b4f19f-tmp\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.823212 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.821938    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrwqj\" (UniqueName: \"kubernetes.io/projected/a5c45f8a-a655-4813-8c7c-f26041b4f19f-kube-api-access-hrwqj\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.823212 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.822032    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ee0ad41b-adbe-4764-ab09-a9c0f058082d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g97dz\" (UID: \"ee0ad41b-adbe-4764-ab09-a9c0f058082d\") " pod="openshift-multus/multus-additional-cni-plugins-g97dz"
Jul 31 01:37:21.823212 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.822066    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09fec214-2f3f-4166-8687-3c1c822794c3-host\") pod \"node-ca-5vkv9\" (UID: \"09fec214-2f3f-4166-8687-3c1c822794c3\") " pod="openshift-image-registry/node-ca-5vkv9"
Jul 31 01:37:21.823212 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.822105    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-multus-cni-dir\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.823212 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.822194    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-cnibin\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.823212 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.822249    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-hostroot\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.823212 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.821182    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 31 01:37:21.823212 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.821788    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 31 01:37:21.823212 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.821318    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 31 01:37:21.823212 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.822863    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-etc-kubernetes\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.823212 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.822919    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-etc-modprobe-d\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.823212 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.823015    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-sys\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.823212 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.823180    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-multus-conf-dir\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.823908 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.823228    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-etc-kubernetes\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.823908 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.820791    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l7qbr\""
Jul 31 01:37:21.823908 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.823363    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 31 01:37:21.823908 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.820865    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 31 01:37:21.823908 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.823266    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/522b6666-22de-4d13-9794-07680e2375d6-hosts-file\") pod \"node-resolver-l4gcr\" (UID: \"522b6666-22de-4d13-9794-07680e2375d6\") " pod="openshift-dns/node-resolver-l4gcr"
Jul 31 01:37:21.823908 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.823694    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 31 01:37:21.823908 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.823701    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee0ad41b-adbe-4764-ab09-a9c0f058082d-system-cni-dir\") pod \"multus-additional-cni-plugins-g97dz\" (UID: \"ee0ad41b-adbe-4764-ab09-a9c0f058082d\") " pod="openshift-multus/multus-additional-cni-plugins-g97dz"
Jul 31 01:37:21.823908 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.823750    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee0ad41b-adbe-4764-ab09-a9c0f058082d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g97dz\" (UID: \"ee0ad41b-adbe-4764-ab09-a9c0f058082d\") " pod="openshift-multus/multus-additional-cni-plugins-g97dz"
Jul 31 01:37:21.823908 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.823822    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-multus-socket-dir-parent\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.823908 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.823834    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 31 01:37:21.823908 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.823866    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kdr9\" (UniqueName: \"kubernetes.io/projected/b02ea9cd-e292-44df-8d6a-113fd9848370-kube-api-access-4kdr9\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.823908 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.823910    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ccac2337-37fd-4a50-b0da-8179fafdd6d2-host-slash\") pod \"iptables-alerter-4vfkb\" (UID: \"ccac2337-37fd-4a50-b0da-8179fafdd6d2\") " pod="openshift-network-operator/iptables-alerter-4vfkb"
Jul 31 01:37:21.824584 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.823950    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a5c45f8a-a655-4813-8c7c-f26041b4f19f-etc-tuned\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.824584 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.824002    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 31 01:37:21.824584 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.823992    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5z8f\" (UniqueName: \"kubernetes.io/projected/09fec214-2f3f-4166-8687-3c1c822794c3-kube-api-access-m5z8f\") pod \"node-ca-5vkv9\" (UID: \"09fec214-2f3f-4166-8687-3c1c822794c3\") " pod="openshift-image-registry/node-ca-5vkv9"
Jul 31 01:37:21.824584 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.824238    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5bj4r\""
Jul 31 01:37:21.824584 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.824273    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ee0ad41b-adbe-4764-ab09-a9c0f058082d-os-release\") pod \"multus-additional-cni-plugins-g97dz\" (UID: \"ee0ad41b-adbe-4764-ab09-a9c0f058082d\") " pod="openshift-multus/multus-additional-cni-plugins-g97dz"
Jul 31 01:37:21.824584 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.824342    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-host-run-k8s-cni-cncf-io\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.824584 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.824403    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-host-run-netns\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.824584 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.824456    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-host-var-lib-kubelet\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.824584 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.824487    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ccac2337-37fd-4a50-b0da-8179fafdd6d2-iptables-alerter-script\") pod \"iptables-alerter-4vfkb\" (UID: \"ccac2337-37fd-4a50-b0da-8179fafdd6d2\") " pod="openshift-network-operator/iptables-alerter-4vfkb"
Jul 31 01:37:21.824584 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.824521    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-etc-sysctl-conf\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.824584 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.824557    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-var-lib-kubelet\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.825184 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.824760    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-run\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.825184 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.824838    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/522b6666-22de-4d13-9794-07680e2375d6-tmp-dir\") pod \"node-resolver-l4gcr\" (UID: \"522b6666-22de-4d13-9794-07680e2375d6\") " pod="openshift-dns/node-resolver-l4gcr"
Jul 31 01:37:21.825355 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.825334    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kxjk7"
Jul 31 01:37:21.826029 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.826003    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 31 01:37:21.828155 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.828136    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qvj9l\""
Jul 31 01:37:21.828365 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.828349    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 31 01:37:21.828668 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.828632    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 31 01:37:21.831472 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.831103    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:21.831472 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:21.831221    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbn98" podUID="2eeb74ea-3868-467e-ac82-a476ddfaf787"
Jul 31 01:37:21.837201 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.837181    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:37:21.837300 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:21.837257    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78xx9" podUID="1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb"
Jul 31 01:37:21.840871 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.840843    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xknpj"
Jul 31 01:37:21.845779 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.845757    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xknpj"
Jul 31 01:37:21.909419 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.909393    2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 31 01:37:21.926050 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926020    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-original-pull-secret\") pod \"global-pull-secret-syncer-5sd9h\" (UID: \"d7a3c161-fb9a-48d4-b150-58fe365b2a6c\") " pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:21.926224 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926059    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ee0ad41b-adbe-4764-ab09-a9c0f058082d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g97dz\" (UID: \"ee0ad41b-adbe-4764-ab09-a9c0f058082d\") " pod="openshift-multus/multus-additional-cni-plugins-g97dz"
Jul 31 01:37:21.926224 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926080    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09fec214-2f3f-4166-8687-3c1c822794c3-host\") pod \"node-ca-5vkv9\" (UID: \"09fec214-2f3f-4166-8687-3c1c822794c3\") " pod="openshift-image-registry/node-ca-5vkv9"
Jul 31 01:37:21.926224 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926110    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-etc-modprobe-d\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.926224 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926127    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-dbus\") pod \"global-pull-secret-syncer-5sd9h\" (UID: \"d7a3c161-fb9a-48d4-b150-58fe365b2a6c\") " pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:21.926224 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926145    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-etc-openvswitch\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:21.926224 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926161    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-multus-conf-dir\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.926224 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926177    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-etc-kubernetes\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.926224 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926193    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/652076b0-3ea5-413f-8e40-396b7decfd5e-agent-certs\") pod \"konnectivity-agent-kxjk7\" (UID: \"652076b0-3ea5-413f-8e40-396b7decfd5e\") " pod="kube-system/konnectivity-agent-kxjk7"
Jul 31 01:37:21.926224 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926210    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee0ad41b-adbe-4764-ab09-a9c0f058082d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g97dz\" (UID: \"ee0ad41b-adbe-4764-ab09-a9c0f058082d\") " pod="openshift-multus/multus-additional-cni-plugins-g97dz"
Jul 31 01:37:21.926224 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926226    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a5c45f8a-a655-4813-8c7c-f26041b4f19f-etc-tuned\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.926740 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926241    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rs7dx\" (UID: \"5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx"
Jul 31 01:37:21.926740 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926257    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5z8f\" (UniqueName: \"kubernetes.io/projected/09fec214-2f3f-4166-8687-3c1c822794c3-kube-api-access-m5z8f\") pod \"node-ca-5vkv9\" (UID: \"09fec214-2f3f-4166-8687-3c1c822794c3\") " pod="openshift-image-registry/node-ca-5vkv9"
Jul 31 01:37:21.926740 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926277    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-host-run-k8s-cni-cncf-io\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.926740 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926298    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-host-run-netns\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.926740 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926315    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-host-var-lib-kubelet\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.926740 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926344    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-etc-sysctl-conf\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.926740 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926361    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-run-openvswitch\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:21.926740 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926381    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe-socket-dir\") pod \"aws-ebs-csi-driver-node-rs7dx\" (UID: \"5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx"
Jul 31 01:37:21.926740 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926399    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/522b6666-22de-4d13-9794-07680e2375d6-tmp-dir\") pod \"node-resolver-l4gcr\" (UID: \"522b6666-22de-4d13-9794-07680e2375d6\") " pod="openshift-dns/node-resolver-l4gcr"
Jul 31 01:37:21.926740 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926414    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/652076b0-3ea5-413f-8e40-396b7decfd5e-konnectivity-ca\") pod \"konnectivity-agent-kxjk7\" (UID: \"652076b0-3ea5-413f-8e40-396b7decfd5e\") " pod="kube-system/konnectivity-agent-kxjk7"
Jul 31 01:37:21.926740 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926430    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-host-kubelet\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:21.926740 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926454    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1e39601f-4171-4ed9-81ff-e5ba5786c967-env-overrides\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:21.926740 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926469    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1e39601f-4171-4ed9-81ff-e5ba5786c967-ovnkube-script-lib\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:21.926740 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926486    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwtkf\" (UniqueName: \"kubernetes.io/projected/ccac2337-37fd-4a50-b0da-8179fafdd6d2-kube-api-access-lwtkf\") pod \"iptables-alerter-4vfkb\" (UID: \"ccac2337-37fd-4a50-b0da-8179fafdd6d2\") " pod="openshift-network-operator/iptables-alerter-4vfkb"
Jul 31 01:37:21.926740 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926524    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-etc-sysconfig\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.926740 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926541    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-lib-modules\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.926740 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926558    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs\") pod \"network-metrics-daemon-dbn98\" (UID: \"2eeb74ea-3868-467e-ac82-a476ddfaf787\") " pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:21.927688 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926591    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1e39601f-4171-4ed9-81ff-e5ba5786c967-ovnkube-config\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:21.927688 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926610    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ee0ad41b-adbe-4764-ab09-a9c0f058082d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g97dz\" (UID: \"ee0ad41b-adbe-4764-ab09-a9c0f058082d\") " pod="openshift-multus/multus-additional-cni-plugins-g97dz"
Jul 31 01:37:21.927688 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926626    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee0ad41b-adbe-4764-ab09-a9c0f058082d-cnibin\") pod \"multus-additional-cni-plugins-g97dz\" (UID: \"ee0ad41b-adbe-4764-ab09-a9c0f058082d\") " pod="openshift-multus/multus-additional-cni-plugins-g97dz"
Jul 31 01:37:21.927688 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926645    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vnbr\" (UniqueName: \"kubernetes.io/projected/522b6666-22de-4d13-9794-07680e2375d6-kube-api-access-9vnbr\") pod \"node-resolver-l4gcr\" (UID: \"522b6666-22de-4d13-9794-07680e2375d6\") " pod="openshift-dns/node-resolver-l4gcr"
Jul 31 01:37:21.927688 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926661    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-kubelet-config\") pod \"global-pull-secret-syncer-5sd9h\" (UID: \"d7a3c161-fb9a-48d4-b150-58fe365b2a6c\") " pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:21.927688 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926678    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-systemd-units\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:21.927688 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926724    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1e39601f-4171-4ed9-81ff-e5ba5786c967-ovn-node-metrics-cert\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:21.927688 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926813    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-etc-sysconfig\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.927688 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926832    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-host-var-lib-kubelet\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.927688 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926872    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee0ad41b-adbe-4764-ab09-a9c0f058082d-cni-binary-copy\") pod \"multus-additional-cni-plugins-g97dz\" (UID: \"ee0ad41b-adbe-4764-ab09-a9c0f058082d\") " pod="openshift-multus/multus-additional-cni-plugins-g97dz"
Jul 31 01:37:21.927688 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926941    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-host-var-lib-cni-multus\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.927688 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.926969    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-host-run-multus-certs\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.927688 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.927000    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrwqj\" (UniqueName: \"kubernetes.io/projected/a5c45f8a-a655-4813-8c7c-f26041b4f19f-kube-api-access-hrwqj\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.927688 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.927037    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-run-systemd\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:21.927688 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.927063    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-host-cni-netd\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:21.927688 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.927086    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kg4w\" (UniqueName: \"kubernetes.io/projected/5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe-kube-api-access-8kg4w\") pod \"aws-ebs-csi-driver-node-rs7dx\" (UID: \"5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx"
Jul 31 01:37:21.927688 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.927113    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-multus-cni-dir\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.928620 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.927151    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-cnibin\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.928620 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.927191    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-hostroot\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.928620 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.927464    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-multus-cni-dir\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.928620 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.927474    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-lib-modules\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.928620 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.927530    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-cnibin\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.928620 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.927600    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ee0ad41b-adbe-4764-ab09-a9c0f058082d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g97dz\" (UID: \"ee0ad41b-adbe-4764-ab09-a9c0f058082d\") " pod="openshift-multus/multus-additional-cni-plugins-g97dz"
Jul 31 01:37:21.928620 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.927604    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ee0ad41b-adbe-4764-ab09-a9c0f058082d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g97dz\" (UID: \"ee0ad41b-adbe-4764-ab09-a9c0f058082d\") " pod="openshift-multus/multus-additional-cni-plugins-g97dz"
Jul 31 01:37:21.928620 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.927669    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-etc-sysctl-conf\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.928620 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.927815    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-etc-kubernetes\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.928620 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.927840    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-multus-conf-dir\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.928620 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.927906    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-host-run-netns\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.928620 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.927967    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee0ad41b-adbe-4764-ab09-a9c0f058082d-cni-binary-copy\") pod \"multus-additional-cni-plugins-g97dz\" (UID: \"ee0ad41b-adbe-4764-ab09-a9c0f058082d\") " pod="openshift-multus/multus-additional-cni-plugins-g97dz"
Jul 31 01:37:21.928620 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.928092    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee0ad41b-adbe-4764-ab09-a9c0f058082d-cnibin\") pod \"multus-additional-cni-plugins-g97dz\" (UID: \"ee0ad41b-adbe-4764-ab09-a9c0f058082d\") " pod="openshift-multus/multus-additional-cni-plugins-g97dz"
Jul 31 01:37:21.928620 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.928120    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/522b6666-22de-4d13-9794-07680e2375d6-tmp-dir\") pod \"node-resolver-l4gcr\" (UID: \"522b6666-22de-4d13-9794-07680e2375d6\") " pod="openshift-dns/node-resolver-l4gcr"
Jul 31 01:37:21.928620 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.928166    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-host-run-k8s-cni-cncf-io\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.928620 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.928379    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-host-var-lib-cni-multus\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.928620 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.928487    2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 31 01:37:21.928620 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.928545    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-etc-kubernetes\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.929645 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.928594    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09fec214-2f3f-4166-8687-3c1c822794c3-host\") pod \"node-ca-5vkv9\" (UID: \"09fec214-2f3f-4166-8687-3c1c822794c3\") " pod="openshift-image-registry/node-ca-5vkv9"
Jul 31 01:37:21.929645 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.928690    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-etc-modprobe-d\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.929645 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.928724    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-hostroot\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.929645 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.928752    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-sys\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.929645 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.928770    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/522b6666-22de-4d13-9794-07680e2375d6-hosts-file\") pod \"node-resolver-l4gcr\" (UID: \"522b6666-22de-4d13-9794-07680e2375d6\") " pod="openshift-dns/node-resolver-l4gcr"
Jul 31 01:37:21.929645 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.928779    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-etc-kubernetes\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.929645 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.928805    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fv8g\" (UniqueName: \"kubernetes.io/projected/2eeb74ea-3868-467e-ac82-a476ddfaf787-kube-api-access-9fv8g\") pod \"network-metrics-daemon-dbn98\" (UID: \"2eeb74ea-3868-467e-ac82-a476ddfaf787\") " pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:21.929645 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.928857    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee0ad41b-adbe-4764-ab09-a9c0f058082d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g97dz\" (UID: \"ee0ad41b-adbe-4764-ab09-a9c0f058082d\") " pod="openshift-multus/multus-additional-cni-plugins-g97dz"
Jul 31 01:37:21.929645 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.928439    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-host-run-multus-certs\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.929645 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.928962    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/522b6666-22de-4d13-9794-07680e2375d6-hosts-file\") pod \"node-resolver-l4gcr\" (UID: \"522b6666-22de-4d13-9794-07680e2375d6\") " pod="openshift-dns/node-resolver-l4gcr"
Jul 31 01:37:21.929645 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.929125    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe-device-dir\") pod \"aws-ebs-csi-driver-node-rs7dx\" (UID: \"5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx"
Jul 31 01:37:21.929645 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.929182    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-host-run-ovn-kubernetes\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:21.929645 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.929267    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee0ad41b-adbe-4764-ab09-a9c0f058082d-system-cni-dir\") pod \"multus-additional-cni-plugins-g97dz\" (UID: \"ee0ad41b-adbe-4764-ab09-a9c0f058082d\") " pod="openshift-multus/multus-additional-cni-plugins-g97dz"
Jul 31 01:37:21.929645 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.929328    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-multus-socket-dir-parent\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.929645 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.929379    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee0ad41b-adbe-4764-ab09-a9c0f058082d-system-cni-dir\") pod \"multus-additional-cni-plugins-g97dz\" (UID: \"ee0ad41b-adbe-4764-ab09-a9c0f058082d\") " pod="openshift-multus/multus-additional-cni-plugins-g97dz"
Jul 31 01:37:21.929645 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.928910    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-sys\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.929645 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.929442    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-multus-socket-dir-parent\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.930582 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.929446    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kdr9\" (UniqueName: \"kubernetes.io/projected/b02ea9cd-e292-44df-8d6a-113fd9848370-kube-api-access-4kdr9\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.930582 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.929485    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ccac2337-37fd-4a50-b0da-8179fafdd6d2-host-slash\") pod \"iptables-alerter-4vfkb\" (UID: \"ccac2337-37fd-4a50-b0da-8179fafdd6d2\") " pod="openshift-network-operator/iptables-alerter-4vfkb"
Jul 31 01:37:21.930582 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.929505    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-node-log\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:21.930582 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.929524    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:21.930582 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.929564    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe-registration-dir\") pod \"aws-ebs-csi-driver-node-rs7dx\" (UID: \"5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx"
Jul 31 01:37:21.930582 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.929595    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ee0ad41b-adbe-4764-ab09-a9c0f058082d-os-release\") pod \"multus-additional-cni-plugins-g97dz\" (UID: \"ee0ad41b-adbe-4764-ab09-a9c0f058082d\") " pod="openshift-multus/multus-additional-cni-plugins-g97dz"
Jul 31 01:37:21.930582 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.929590    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ccac2337-37fd-4a50-b0da-8179fafdd6d2-host-slash\") pod \"iptables-alerter-4vfkb\" (UID: \"ccac2337-37fd-4a50-b0da-8179fafdd6d2\") " pod="openshift-network-operator/iptables-alerter-4vfkb"
Jul 31 01:37:21.930582 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.929629    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ccac2337-37fd-4a50-b0da-8179fafdd6d2-iptables-alerter-script\") pod \"iptables-alerter-4vfkb\" (UID: \"ccac2337-37fd-4a50-b0da-8179fafdd6d2\") " pod="openshift-network-operator/iptables-alerter-4vfkb"
Jul 31 01:37:21.930582 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.929663    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-var-lib-kubelet\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.930582 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.929701    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ee0ad41b-adbe-4764-ab09-a9c0f058082d-os-release\") pod \"multus-additional-cni-plugins-g97dz\" (UID: \"ee0ad41b-adbe-4764-ab09-a9c0f058082d\") " pod="openshift-multus/multus-additional-cni-plugins-g97dz"
Jul 31 01:37:21.930582 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.929696    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p2tq\" (UniqueName: \"kubernetes.io/projected/1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb-kube-api-access-6p2tq\") pod \"network-check-target-78xx9\" (UID: \"1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb\") " pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:37:21.930582 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.929782    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-run-ovn\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:21.930582 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.929816    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-log-socket\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:21.930582 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.929844    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe-etc-selinux\") pod \"aws-ebs-csi-driver-node-rs7dx\" (UID: \"5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx"
Jul 31 01:37:21.930582 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.929818    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-var-lib-kubelet\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.930582 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.929905    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-run\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.931635 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.929941    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe-sys-fs\") pod \"aws-ebs-csi-driver-node-rs7dx\" (UID: \"5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx"
Jul 31 01:37:21.931635 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.929999    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-run\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.931635 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.930046    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gr4v\" (UniqueName: \"kubernetes.io/projected/ee0ad41b-adbe-4764-ab09-a9c0f058082d-kube-api-access-8gr4v\") pod \"multus-additional-cni-plugins-g97dz\" (UID: \"ee0ad41b-adbe-4764-ab09-a9c0f058082d\") " pod="openshift-multus/multus-additional-cni-plugins-g97dz"
Jul 31 01:37:21.931635 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.930077    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b02ea9cd-e292-44df-8d6a-113fd9848370-multus-daemon-config\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.931635 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.930128    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-etc-sysctl-d\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.931635 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.930160    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-host\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.931635 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.930204    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-host-slash\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:21.931635 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.930229    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-host-run-netns\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:21.931635 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.930253    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-var-lib-openvswitch\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:21.931635 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.930245    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ccac2337-37fd-4a50-b0da-8179fafdd6d2-iptables-alerter-script\") pod \"iptables-alerter-4vfkb\" (UID: \"ccac2337-37fd-4a50-b0da-8179fafdd6d2\") " pod="openshift-network-operator/iptables-alerter-4vfkb"
Jul 31 01:37:21.931635 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.930279    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn5dw\" (UniqueName: \"kubernetes.io/projected/1e39601f-4171-4ed9-81ff-e5ba5786c967-kube-api-access-gn5dw\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:21.931635 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.930304    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-host-var-lib-cni-bin\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.931635 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.930333    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-host\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.931635 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.930330    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/09fec214-2f3f-4166-8687-3c1c822794c3-serviceca\") pod \"node-ca-5vkv9\" (UID: \"09fec214-2f3f-4166-8687-3c1c822794c3\") " pod="openshift-image-registry/node-ca-5vkv9"
Jul 31 01:37:21.931635 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.930366    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-etc-systemd\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.931635 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.930439    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-host-cni-bin\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:21.931635 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.930468    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-system-cni-dir\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.932679 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.930498    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-os-release\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.932679 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.930515    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-etc-sysctl-d\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.932679 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.930529    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b02ea9cd-e292-44df-8d6a-113fd9848370-cni-binary-copy\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.932679 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.930563    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5c45f8a-a655-4813-8c7c-f26041b4f19f-tmp\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.932679 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.930569    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-host-var-lib-cni-bin\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.932679 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.930728    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-os-release\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.932679 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.930742    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b02ea9cd-e292-44df-8d6a-113fd9848370-system-cni-dir\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.932679 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.930772    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a5c45f8a-a655-4813-8c7c-f26041b4f19f-etc-systemd\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.932679 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.930916    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b02ea9cd-e292-44df-8d6a-113fd9848370-multus-daemon-config\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.932679 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.931213    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/09fec214-2f3f-4166-8687-3c1c822794c3-serviceca\") pod \"node-ca-5vkv9\" (UID: \"09fec214-2f3f-4166-8687-3c1c822794c3\") " pod="openshift-image-registry/node-ca-5vkv9"
Jul 31 01:37:21.932679 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.931403    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b02ea9cd-e292-44df-8d6a-113fd9848370-cni-binary-copy\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.934133 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.934109    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5c45f8a-a655-4813-8c7c-f26041b4f19f-tmp\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.934914 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.934693    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a5c45f8a-a655-4813-8c7c-f26041b4f19f-etc-tuned\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.935960 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.935915    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwtkf\" (UniqueName: \"kubernetes.io/projected/ccac2337-37fd-4a50-b0da-8179fafdd6d2-kube-api-access-lwtkf\") pod \"iptables-alerter-4vfkb\" (UID: \"ccac2337-37fd-4a50-b0da-8179fafdd6d2\") " pod="openshift-network-operator/iptables-alerter-4vfkb"
Jul 31 01:37:21.938090 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.938045    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vnbr\" (UniqueName: \"kubernetes.io/projected/522b6666-22de-4d13-9794-07680e2375d6-kube-api-access-9vnbr\") pod \"node-resolver-l4gcr\" (UID: \"522b6666-22de-4d13-9794-07680e2375d6\") " pod="openshift-dns/node-resolver-l4gcr"
Jul 31 01:37:21.939555 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.939523    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrwqj\" (UniqueName: \"kubernetes.io/projected/a5c45f8a-a655-4813-8c7c-f26041b4f19f-kube-api-access-hrwqj\") pod \"tuned-th4tz\" (UID: \"a5c45f8a-a655-4813-8c7c-f26041b4f19f\") " pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:21.943495 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.943443    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5z8f\" (UniqueName: \"kubernetes.io/projected/09fec214-2f3f-4166-8687-3c1c822794c3-kube-api-access-m5z8f\") pod \"node-ca-5vkv9\" (UID: \"09fec214-2f3f-4166-8687-3c1c822794c3\") " pod="openshift-image-registry/node-ca-5vkv9"
Jul 31 01:37:21.944700 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.942331    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kdr9\" (UniqueName: \"kubernetes.io/projected/b02ea9cd-e292-44df-8d6a-113fd9848370-kube-api-access-4kdr9\") pod \"multus-krg4k\" (UID: \"b02ea9cd-e292-44df-8d6a-113fd9848370\") " pod="openshift-multus/multus-krg4k"
Jul 31 01:37:21.947656 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.947630    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gr4v\" (UniqueName: \"kubernetes.io/projected/ee0ad41b-adbe-4764-ab09-a9c0f058082d-kube-api-access-8gr4v\") pod \"multus-additional-cni-plugins-g97dz\" (UID: \"ee0ad41b-adbe-4764-ab09-a9c0f058082d\") " pod="openshift-multus/multus-additional-cni-plugins-g97dz"
Jul 31 01:37:21.990665 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.990609    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-91.ec2.internal" event={"ID":"2b1da00732300b353fe684ed60474f6b","Type":"ContainerStarted","Data":"c7cd9cd4793a2081c21f1be6600e66db616ca18d01fccb32e340498fe2fcc231"}
Jul 31 01:37:21.992347 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:21.992316    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-91.ec2.internal" event={"ID":"8f05a7e3d33391cf18a6238fa486d743","Type":"ContainerStarted","Data":"680cfe57b17625dcf92c42fe4cd8dc96c9440703430edd752332aa50b0a77088"}
Jul 31 01:37:22.031349 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.031312    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-run-systemd\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.031349 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.031356    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-host-cni-netd\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.031614 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.031384    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kg4w\" (UniqueName: \"kubernetes.io/projected/5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe-kube-api-access-8kg4w\") pod \"aws-ebs-csi-driver-node-rs7dx\" (UID: \"5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx"
Jul 31 01:37:22.031614 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.031413    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fv8g\" (UniqueName: \"kubernetes.io/projected/2eeb74ea-3868-467e-ac82-a476ddfaf787-kube-api-access-9fv8g\") pod \"network-metrics-daemon-dbn98\" (UID: \"2eeb74ea-3868-467e-ac82-a476ddfaf787\") " pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:22.031614 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.031434    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe-device-dir\") pod \"aws-ebs-csi-driver-node-rs7dx\" (UID: \"5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx"
Jul 31 01:37:22.031614 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.031448    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-run-systemd\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.031614 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.031506    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-host-cni-netd\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.031614 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.031518    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-host-run-ovn-kubernetes\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.031614 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.031456    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-host-run-ovn-kubernetes\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.031614 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.031569    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-node-log\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.031614 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.031599    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.032103 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.031626    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe-registration-dir\") pod \"aws-ebs-csi-driver-node-rs7dx\" (UID: \"5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx"
Jul 31 01:37:22.032103 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.031656    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p2tq\" (UniqueName: \"kubernetes.io/projected/1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb-kube-api-access-6p2tq\") pod \"network-check-target-78xx9\" (UID: \"1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb\") " pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:37:22.032103 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.031657    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-node-log\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.032103 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.031681    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-run-ovn\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.032103 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.031708    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-log-socket\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.032103 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.031731    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe-etc-selinux\") pod \"aws-ebs-csi-driver-node-rs7dx\" (UID: \"5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx"
Jul 31 01:37:22.032103 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.031757    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe-sys-fs\") pod \"aws-ebs-csi-driver-node-rs7dx\" (UID: \"5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx"
Jul 31 01:37:22.032103 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.031786    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-host-slash\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.032103 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.031809    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-host-run-netns\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.032103 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.031835    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-var-lib-openvswitch\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.032103 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.031839    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe-device-dir\") pod \"aws-ebs-csi-driver-node-rs7dx\" (UID: \"5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx"
Jul 31 01:37:22.032103 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.031858    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn5dw\" (UniqueName: \"kubernetes.io/projected/1e39601f-4171-4ed9-81ff-e5ba5786c967-kube-api-access-gn5dw\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.032103 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.031886    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-host-cni-bin\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.032103 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.031896    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-log-socket\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.032103 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.031915    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-original-pull-secret\") pod \"global-pull-secret-syncer-5sd9h\" (UID: \"d7a3c161-fb9a-48d4-b150-58fe365b2a6c\") " pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:22.032103 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.031937    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.032103 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.031991    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-dbus\") pod \"global-pull-secret-syncer-5sd9h\" (UID: \"d7a3c161-fb9a-48d4-b150-58fe365b2a6c\") " pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:22.033005 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.032005    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-run-ovn\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.033005 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.032020    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-etc-openvswitch\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.033005 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.032050    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/652076b0-3ea5-413f-8e40-396b7decfd5e-agent-certs\") pod \"konnectivity-agent-kxjk7\" (UID: \"652076b0-3ea5-413f-8e40-396b7decfd5e\") " pod="kube-system/konnectivity-agent-kxjk7"
Jul 31 01:37:22.033005 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.032083    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rs7dx\" (UID: \"5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx"
Jul 31 01:37:22.033005 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.032114    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-run-openvswitch\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.033005 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.032137    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe-etc-selinux\") pod \"aws-ebs-csi-driver-node-rs7dx\" (UID: \"5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx"
Jul 31 01:37:22.033005 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.032181    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe-registration-dir\") pod \"aws-ebs-csi-driver-node-rs7dx\" (UID: \"5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx"
Jul 31 01:37:22.033005 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.032200    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-run-openvswitch\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.033005 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.032222    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe-socket-dir\") pod \"aws-ebs-csi-driver-node-rs7dx\" (UID: \"5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx"
Jul 31 01:37:22.033005 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:22.032227    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 01:37:22.033005 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.032256    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/652076b0-3ea5-413f-8e40-396b7decfd5e-konnectivity-ca\") pod \"konnectivity-agent-kxjk7\" (UID: \"652076b0-3ea5-413f-8e40-396b7decfd5e\") " pod="kube-system/konnectivity-agent-kxjk7"
Jul 31 01:37:22.033005 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.032258    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe-sys-fs\") pod \"aws-ebs-csi-driver-node-rs7dx\" (UID: \"5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx"
Jul 31 01:37:22.033005 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.032288    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-host-kubelet\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.033005 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:22.032319    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-original-pull-secret podName:d7a3c161-fb9a-48d4-b150-58fe365b2a6c nodeName:}" failed. No retries permitted until 2026-07-31 01:37:22.5322931 +0000 UTC m=+3.112534098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-original-pull-secret") pod "global-pull-secret-syncer-5sd9h" (UID: "d7a3c161-fb9a-48d4-b150-58fe365b2a6c") : object "kube-system"/"original-pull-secret" not registered
Jul 31 01:37:22.033005 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.032317    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-host-slash\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.033005 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.032334    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-host-kubelet\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.033005 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.032351    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1e39601f-4171-4ed9-81ff-e5ba5786c967-env-overrides\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.033797 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.032373    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-var-lib-openvswitch\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.033797 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.032379    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1e39601f-4171-4ed9-81ff-e5ba5786c967-ovnkube-script-lib\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.033797 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.032410    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs\") pod \"network-metrics-daemon-dbn98\" (UID: \"2eeb74ea-3868-467e-ac82-a476ddfaf787\") " pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:22.033797 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.032436    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1e39601f-4171-4ed9-81ff-e5ba5786c967-ovnkube-config\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.033797 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.032466    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-kubelet-config\") pod \"global-pull-secret-syncer-5sd9h\" (UID: \"d7a3c161-fb9a-48d4-b150-58fe365b2a6c\") " pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:22.033797 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.032496    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-systemd-units\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.033797 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.032502    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe-socket-dir\") pod \"aws-ebs-csi-driver-node-rs7dx\" (UID: \"5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx"
Jul 31 01:37:22.033797 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.032521    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1e39601f-4171-4ed9-81ff-e5ba5786c967-ovn-node-metrics-cert\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.033797 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.032761    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-host-cni-bin\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.033797 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.032806    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-host-run-netns\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.033797 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.032875    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-dbus\") pod \"global-pull-secret-syncer-5sd9h\" (UID: \"d7a3c161-fb9a-48d4-b150-58fe365b2a6c\") " pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:22.033797 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.032919    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-etc-openvswitch\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.033797 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.032919    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/652076b0-3ea5-413f-8e40-396b7decfd5e-konnectivity-ca\") pod \"konnectivity-agent-kxjk7\" (UID: \"652076b0-3ea5-413f-8e40-396b7decfd5e\") " pod="kube-system/konnectivity-agent-kxjk7"
Jul 31 01:37:22.033797 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:22.033015    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 01:37:22.033797 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:22.033065    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs podName:2eeb74ea-3868-467e-ac82-a476ddfaf787 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:22.533049473 +0000 UTC m=+3.113290447 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs") pod "network-metrics-daemon-dbn98" (UID: "2eeb74ea-3868-467e-ac82-a476ddfaf787") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 01:37:22.033797 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.033615    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1e39601f-4171-4ed9-81ff-e5ba5786c967-ovnkube-script-lib\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.033797 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.033690    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rs7dx\" (UID: \"5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx"
Jul 31 01:37:22.034784 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.033742    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-kubelet-config\") pod \"global-pull-secret-syncer-5sd9h\" (UID: \"d7a3c161-fb9a-48d4-b150-58fe365b2a6c\") " pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:22.034784 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.033988    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1e39601f-4171-4ed9-81ff-e5ba5786c967-env-overrides\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.034784 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.034002    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1e39601f-4171-4ed9-81ff-e5ba5786c967-systemd-units\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.034784 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.034052    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1e39601f-4171-4ed9-81ff-e5ba5786c967-ovnkube-config\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.035600 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.035562    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1e39601f-4171-4ed9-81ff-e5ba5786c967-ovn-node-metrics-cert\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.036756 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.036721    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/652076b0-3ea5-413f-8e40-396b7decfd5e-agent-certs\") pod \"konnectivity-agent-kxjk7\" (UID: \"652076b0-3ea5-413f-8e40-396b7decfd5e\") " pod="kube-system/konnectivity-agent-kxjk7"
Jul 31 01:37:22.038169 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:22.038033    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 01:37:22.038169 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:22.038058    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 01:37:22.038169 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:22.038074    2571 projected.go:196] Error preparing data for projected volume kube-api-access-6p2tq for pod openshift-network-diagnostics/network-check-target-78xx9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 01:37:22.038169 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:22.038134    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb-kube-api-access-6p2tq podName:1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb nodeName:}" failed. No retries permitted until 2026-07-31 01:37:22.538115871 +0000 UTC m=+3.118356861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6p2tq" (UniqueName: "kubernetes.io/projected/1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb-kube-api-access-6p2tq") pod "network-check-target-78xx9" (UID: "1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 01:37:22.040851 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.040827    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fv8g\" (UniqueName: \"kubernetes.io/projected/2eeb74ea-3868-467e-ac82-a476ddfaf787-kube-api-access-9fv8g\") pod \"network-metrics-daemon-dbn98\" (UID: \"2eeb74ea-3868-467e-ac82-a476ddfaf787\") " pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:22.041026 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.040965    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn5dw\" (UniqueName: \"kubernetes.io/projected/1e39601f-4171-4ed9-81ff-e5ba5786c967-kube-api-access-gn5dw\") pod \"ovnkube-node-6r5df\" (UID: \"1e39601f-4171-4ed9-81ff-e5ba5786c967\") " pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.042069 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.042043    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kg4w\" (UniqueName: \"kubernetes.io/projected/5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe-kube-api-access-8kg4w\") pod \"aws-ebs-csi-driver-node-rs7dx\" (UID: \"5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx"
Jul 31 01:37:22.073226 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.073199    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 01:37:22.117552 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.117519    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-krg4k"
Jul 31 01:37:22.131673 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.131631    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4vfkb"
Jul 31 01:37:22.143482 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.143450    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-th4tz"
Jul 31 01:37:22.152260 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.152218    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l4gcr"
Jul 31 01:37:22.161037 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.161010    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5vkv9"
Jul 31 01:37:22.171729 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.171611    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g97dz"
Jul 31 01:37:22.179670 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.179647    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:22.189348 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.189323    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx"
Jul 31 01:37:22.196982 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.196951    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kxjk7"
Jul 31 01:37:22.535376 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.535334    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs\") pod \"network-metrics-daemon-dbn98\" (UID: \"2eeb74ea-3868-467e-ac82-a476ddfaf787\") " pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:22.535581 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.535433    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-original-pull-secret\") pod \"global-pull-secret-syncer-5sd9h\" (UID: \"d7a3c161-fb9a-48d4-b150-58fe365b2a6c\") " pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:22.535581 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:22.535508    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 01:37:22.535581 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:22.535578    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs podName:2eeb74ea-3868-467e-ac82-a476ddfaf787 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:23.535561569 +0000 UTC m=+4.115802549 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs") pod "network-metrics-daemon-dbn98" (UID: "2eeb74ea-3868-467e-ac82-a476ddfaf787") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 01:37:22.535765 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:22.535609    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 01:37:22.535765 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:22.535740    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-original-pull-secret podName:d7a3c161-fb9a-48d4-b150-58fe365b2a6c nodeName:}" failed. No retries permitted until 2026-07-31 01:37:23.535718921 +0000 UTC m=+4.115959917 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-original-pull-secret") pod "global-pull-secret-syncer-5sd9h" (UID: "d7a3c161-fb9a-48d4-b150-58fe365b2a6c") : object "kube-system"/"original-pull-secret" not registered
Jul 31 01:37:22.636761 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.636692    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p2tq\" (UniqueName: \"kubernetes.io/projected/1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb-kube-api-access-6p2tq\") pod \"network-check-target-78xx9\" (UID: \"1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb\") " pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:37:22.636978 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:22.636891    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 01:37:22.636978 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:22.636929    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 01:37:22.636978 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:22.636943    2571 projected.go:196] Error preparing data for projected volume kube-api-access-6p2tq for pod openshift-network-diagnostics/network-check-target-78xx9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 01:37:22.637128 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:22.637009    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb-kube-api-access-6p2tq podName:1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb nodeName:}" failed. No retries permitted until 2026-07-31 01:37:23.6369896 +0000 UTC m=+4.217230582 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6p2tq" (UniqueName: "kubernetes.io/projected/1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb-kube-api-access-6p2tq") pod "network-check-target-78xx9" (UID: "1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 01:37:22.849141 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.849075    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 01:32:21 +0000 UTC" deadline="2028-05-08 02:36:49.967255988 +0000 UTC"
Jul 31 01:37:22.849141 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.849139    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15528h59m27.118122054s"
Jul 31 01:37:22.986434 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:22.986402    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:22.986628 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:22.986545    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbn98" podUID="2eeb74ea-3868-467e-ac82-a476ddfaf787"
Jul 31 01:37:23.224803 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:23.224772    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09fec214_2f3f_4166_8687_3c1c822794c3.slice/crio-a78ebd7455fb8cc29239f226a0654c6a68250b69dee4a5b2bc534f3db357e785 WatchSource:0}: Error finding container a78ebd7455fb8cc29239f226a0654c6a68250b69dee4a5b2bc534f3db357e785: Status 404 returned error can't find the container with id a78ebd7455fb8cc29239f226a0654c6a68250b69dee4a5b2bc534f3db357e785
Jul 31 01:37:23.226623 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:23.226597    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb02ea9cd_e292_44df_8d6a_113fd9848370.slice/crio-132ceba9fe9f9c5c8ab94aeaf90e2d545fe13bd1b32868abf063b7ba6f70a9bb WatchSource:0}: Error finding container 132ceba9fe9f9c5c8ab94aeaf90e2d545fe13bd1b32868abf063b7ba6f70a9bb: Status 404 returned error can't find the container with id 132ceba9fe9f9c5c8ab94aeaf90e2d545fe13bd1b32868abf063b7ba6f70a9bb
Jul 31 01:37:23.230052 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:23.230018    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e39601f_4171_4ed9_81ff_e5ba5786c967.slice/crio-881758d67c9dd7854a30e4f10a3029c35e9901e63f34459465778863938a65e2 WatchSource:0}: Error finding container 881758d67c9dd7854a30e4f10a3029c35e9901e63f34459465778863938a65e2: Status 404 returned error can't find the container with id 881758d67c9dd7854a30e4f10a3029c35e9901e63f34459465778863938a65e2
Jul 31 01:37:23.230853 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:23.230834    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee0ad41b_adbe_4764_ab09_a9c0f058082d.slice/crio-ca1a150912da2d4201a346db8f814b007f6c66e389b93809ac2430962bb22ec1 WatchSource:0}: Error finding container ca1a150912da2d4201a346db8f814b007f6c66e389b93809ac2430962bb22ec1: Status 404 returned error can't find the container with id ca1a150912da2d4201a346db8f814b007f6c66e389b93809ac2430962bb22ec1
Jul 31 01:37:23.232473 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:23.232219    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccac2337_37fd_4a50_b0da_8179fafdd6d2.slice/crio-157697de06b7166bdf803ec79b4bbc112f1a6375204a2bf2357d8cf62d1ece6a WatchSource:0}: Error finding container 157697de06b7166bdf803ec79b4bbc112f1a6375204a2bf2357d8cf62d1ece6a: Status 404 returned error can't find the container with id 157697de06b7166bdf803ec79b4bbc112f1a6375204a2bf2357d8cf62d1ece6a
Jul 31 01:37:23.232850 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:23.232786    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5c45f8a_a655_4813_8c7c_f26041b4f19f.slice/crio-3e0fa4aa18ad6ef648ffe131647fe17a5d823f2e1094a37ef82f958452b85d4d WatchSource:0}: Error finding container 3e0fa4aa18ad6ef648ffe131647fe17a5d823f2e1094a37ef82f958452b85d4d: Status 404 returned error can't find the container with id 3e0fa4aa18ad6ef648ffe131647fe17a5d823f2e1094a37ef82f958452b85d4d
Jul 31 01:37:23.235080 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:23.234872    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod652076b0_3ea5_413f_8e40_396b7decfd5e.slice/crio-237bb489934fe4ba6a52796ac3a4aa57fb9170b2b2175a3f7912d105308a36b4 WatchSource:0}: Error finding container 237bb489934fe4ba6a52796ac3a4aa57fb9170b2b2175a3f7912d105308a36b4: Status 404 returned error can't find the container with id 237bb489934fe4ba6a52796ac3a4aa57fb9170b2b2175a3f7912d105308a36b4
Jul 31 01:37:23.235956 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:23.235809    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod522b6666_22de_4d13_9794_07680e2375d6.slice/crio-7c1f0e40ea16f550dd6365eee5f4a94f7b13441e2efc85ad35d613e434637432 WatchSource:0}: Error finding container 7c1f0e40ea16f550dd6365eee5f4a94f7b13441e2efc85ad35d613e434637432: Status 404 returned error can't find the container with id 7c1f0e40ea16f550dd6365eee5f4a94f7b13441e2efc85ad35d613e434637432
Jul 31 01:37:23.236776 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:23.236749    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d6cfca1_2f2e_4bf4_936f_ec8b32b3dabe.slice/crio-4aa47cc35c9d86f8499f79b67d628e07f7abfcd505d389d1914f4c96d830b0ba WatchSource:0}: Error finding container 4aa47cc35c9d86f8499f79b67d628e07f7abfcd505d389d1914f4c96d830b0ba: Status 404 returned error can't find the container with id 4aa47cc35c9d86f8499f79b67d628e07f7abfcd505d389d1914f4c96d830b0ba
Jul 31 01:37:23.544861 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:23.544659    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs\") pod \"network-metrics-daemon-dbn98\" (UID: \"2eeb74ea-3868-467e-ac82-a476ddfaf787\") " pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:23.545018 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:23.544905    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-original-pull-secret\") pod \"global-pull-secret-syncer-5sd9h\" (UID: \"d7a3c161-fb9a-48d4-b150-58fe365b2a6c\") " pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:23.545018 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:23.544819    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 01:37:23.545018 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:23.544990    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs podName:2eeb74ea-3868-467e-ac82-a476ddfaf787 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:25.544969929 +0000 UTC m=+6.125210918 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs") pod "network-metrics-daemon-dbn98" (UID: "2eeb74ea-3868-467e-ac82-a476ddfaf787") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 01:37:23.545224 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:23.545021    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 01:37:23.545224 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:23.545068    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-original-pull-secret podName:d7a3c161-fb9a-48d4-b150-58fe365b2a6c nodeName:}" failed. No retries permitted until 2026-07-31 01:37:25.545056823 +0000 UTC m=+6.125297798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-original-pull-secret") pod "global-pull-secret-syncer-5sd9h" (UID: "d7a3c161-fb9a-48d4-b150-58fe365b2a6c") : object "kube-system"/"original-pull-secret" not registered
Jul 31 01:37:23.645449 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:23.645415    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p2tq\" (UniqueName: \"kubernetes.io/projected/1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb-kube-api-access-6p2tq\") pod \"network-check-target-78xx9\" (UID: \"1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb\") " pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:37:23.645620 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:23.645604    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 01:37:23.645685 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:23.645630    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 01:37:23.645685 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:23.645644    2571 projected.go:196] Error preparing data for projected volume kube-api-access-6p2tq for pod openshift-network-diagnostics/network-check-target-78xx9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 01:37:23.645806 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:23.645708    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb-kube-api-access-6p2tq podName:1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb nodeName:}" failed. No retries permitted until 2026-07-31 01:37:25.645689951 +0000 UTC m=+6.225930937 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6p2tq" (UniqueName: "kubernetes.io/projected/1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb-kube-api-access-6p2tq") pod "network-check-target-78xx9" (UID: "1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 01:37:23.852809 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:23.852418    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 01:32:21 +0000 UTC" deadline="2028-03-18 01:18:07.714321406 +0000 UTC"
Jul 31 01:37:23.852809 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:23.852479    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14303h40m43.861846693s"
Jul 31 01:37:23.988651 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:23.988619    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:37:23.988807 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:23.988747    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78xx9" podUID="1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb"
Jul 31 01:37:23.989159 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:23.989140    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:23.989264 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:23.989236    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sd9h" podUID="d7a3c161-fb9a-48d4-b150-58fe365b2a6c"
Jul 31 01:37:24.000137 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:24.000102    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-krg4k" event={"ID":"b02ea9cd-e292-44df-8d6a-113fd9848370","Type":"ContainerStarted","Data":"132ceba9fe9f9c5c8ab94aeaf90e2d545fe13bd1b32868abf063b7ba6f70a9bb"}
Jul 31 01:37:24.007820 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:24.007781    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5vkv9" event={"ID":"09fec214-2f3f-4166-8687-3c1c822794c3","Type":"ContainerStarted","Data":"a78ebd7455fb8cc29239f226a0654c6a68250b69dee4a5b2bc534f3db357e785"}
Jul 31 01:37:24.018941 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:24.017997    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-91.ec2.internal" event={"ID":"2b1da00732300b353fe684ed60474f6b","Type":"ContainerStarted","Data":"81f62126a926085073ff80e2cc6da3062f8e1c53e3980df96dfbf3f0c7c7d500"}
Jul 31 01:37:24.021347 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:24.021317    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx" event={"ID":"5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe","Type":"ContainerStarted","Data":"4aa47cc35c9d86f8499f79b67d628e07f7abfcd505d389d1914f4c96d830b0ba"}
Jul 31 01:37:24.033070 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:24.032993    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kxjk7" event={"ID":"652076b0-3ea5-413f-8e40-396b7decfd5e","Type":"ContainerStarted","Data":"237bb489934fe4ba6a52796ac3a4aa57fb9170b2b2175a3f7912d105308a36b4"}
Jul 31 01:37:24.044020 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:24.043907    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4vfkb" event={"ID":"ccac2337-37fd-4a50-b0da-8179fafdd6d2","Type":"ContainerStarted","Data":"157697de06b7166bdf803ec79b4bbc112f1a6375204a2bf2357d8cf62d1ece6a"}
Jul 31 01:37:24.058809 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:24.058772    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g97dz" event={"ID":"ee0ad41b-adbe-4764-ab09-a9c0f058082d","Type":"ContainerStarted","Data":"ca1a150912da2d4201a346db8f814b007f6c66e389b93809ac2430962bb22ec1"}
Jul 31 01:37:24.067404 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:24.067297    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6r5df" event={"ID":"1e39601f-4171-4ed9-81ff-e5ba5786c967","Type":"ContainerStarted","Data":"881758d67c9dd7854a30e4f10a3029c35e9901e63f34459465778863938a65e2"}
Jul 31 01:37:24.080942 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:24.080505    2571 generic.go:356] "Generic (PLEG): container finished" podID="8f05a7e3d33391cf18a6238fa486d743" containerID="ba58310323ce3db1ed93e4f69f4d50dc579a496e1788d4568057c78700503bec" exitCode=0
Jul 31 01:37:24.080942 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:24.080589    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-91.ec2.internal" event={"ID":"8f05a7e3d33391cf18a6238fa486d743","Type":"ContainerDied","Data":"ba58310323ce3db1ed93e4f69f4d50dc579a496e1788d4568057c78700503bec"}
Jul 31 01:37:24.098703 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:24.098648    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-91.ec2.internal" podStartSLOduration=3.098627032 podStartE2EDuration="3.098627032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 01:37:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:37:24.032685659 +0000 UTC m=+4.612926655" watchObservedRunningTime="2026-07-31 01:37:24.098627032 +0000 UTC m=+4.678868031"
Jul 31 01:37:24.100429 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:24.100364    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l4gcr" event={"ID":"522b6666-22de-4d13-9794-07680e2375d6","Type":"ContainerStarted","Data":"7c1f0e40ea16f550dd6365eee5f4a94f7b13441e2efc85ad35d613e434637432"}
Jul 31 01:37:24.111141 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:24.111107    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-th4tz" event={"ID":"a5c45f8a-a655-4813-8c7c-f26041b4f19f","Type":"ContainerStarted","Data":"3e0fa4aa18ad6ef648ffe131647fe17a5d823f2e1094a37ef82f958452b85d4d"}
Jul 31 01:37:24.986138 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:24.986102    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:24.986605 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:24.986257    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbn98" podUID="2eeb74ea-3868-467e-ac82-a476ddfaf787"
Jul 31 01:37:25.127532 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:25.127461    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-91.ec2.internal" event={"ID":"8f05a7e3d33391cf18a6238fa486d743","Type":"ContainerStarted","Data":"19b7875f1ed8cbea767ee58fce59af5ab3b25349569eefdf13e1b6b50b53aba1"}
Jul 31 01:37:25.566991 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:25.566180    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs\") pod \"network-metrics-daemon-dbn98\" (UID: \"2eeb74ea-3868-467e-ac82-a476ddfaf787\") " pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:25.566991 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:25.566285    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-original-pull-secret\") pod \"global-pull-secret-syncer-5sd9h\" (UID: \"d7a3c161-fb9a-48d4-b150-58fe365b2a6c\") " pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:25.566991 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:25.566410    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 01:37:25.566991 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:25.566469    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-original-pull-secret podName:d7a3c161-fb9a-48d4-b150-58fe365b2a6c nodeName:}" failed. No retries permitted until 2026-07-31 01:37:29.566450496 +0000 UTC m=+10.146691471 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-original-pull-secret") pod "global-pull-secret-syncer-5sd9h" (UID: "d7a3c161-fb9a-48d4-b150-58fe365b2a6c") : object "kube-system"/"original-pull-secret" not registered
Jul 31 01:37:25.566991 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:25.566888    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 01:37:25.566991 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:25.566956    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs podName:2eeb74ea-3868-467e-ac82-a476ddfaf787 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:29.5669393 +0000 UTC m=+10.147180279 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs") pod "network-metrics-daemon-dbn98" (UID: "2eeb74ea-3868-467e-ac82-a476ddfaf787") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 01:37:25.666858 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:25.666819    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p2tq\" (UniqueName: \"kubernetes.io/projected/1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb-kube-api-access-6p2tq\") pod \"network-check-target-78xx9\" (UID: \"1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb\") " pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:37:25.667308 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:25.667031    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 01:37:25.667308 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:25.667056    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 01:37:25.667308 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:25.667068    2571 projected.go:196] Error preparing data for projected volume kube-api-access-6p2tq for pod openshift-network-diagnostics/network-check-target-78xx9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 01:37:25.667308 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:25.667129    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb-kube-api-access-6p2tq podName:1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb nodeName:}" failed. No retries permitted until 2026-07-31 01:37:29.66711009 +0000 UTC m=+10.247351087 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6p2tq" (UniqueName: "kubernetes.io/projected/1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb-kube-api-access-6p2tq") pod "network-check-target-78xx9" (UID: "1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 01:37:25.986185 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:25.986094    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:25.986185 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:25.986133    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:37:25.986699 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:25.986233    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sd9h" podUID="d7a3c161-fb9a-48d4-b150-58fe365b2a6c"
Jul 31 01:37:25.986699 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:25.986634    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78xx9" podUID="1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb"
Jul 31 01:37:26.985777 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:26.985745    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:26.985977 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:26.985910    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbn98" podUID="2eeb74ea-3868-467e-ac82-a476ddfaf787"
Jul 31 01:37:27.988587 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:27.988003    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:37:27.988587 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:27.988149    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78xx9" podUID="1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb"
Jul 31 01:37:27.988587 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:27.988490    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:27.989208 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:27.988595    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sd9h" podUID="d7a3c161-fb9a-48d4-b150-58fe365b2a6c"
Jul 31 01:37:28.986229 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:28.986196    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:28.986383 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:28.986335    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbn98" podUID="2eeb74ea-3868-467e-ac82-a476ddfaf787"
Jul 31 01:37:29.601656 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:29.601449    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-original-pull-secret\") pod \"global-pull-secret-syncer-5sd9h\" (UID: \"d7a3c161-fb9a-48d4-b150-58fe365b2a6c\") " pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:29.601656 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:29.601504    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs\") pod \"network-metrics-daemon-dbn98\" (UID: \"2eeb74ea-3868-467e-ac82-a476ddfaf787\") " pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:29.601656 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:29.601609    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 01:37:29.601656 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:29.601667    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs podName:2eeb74ea-3868-467e-ac82-a476ddfaf787 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:37.601650174 +0000 UTC m=+18.181891161 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs") pod "network-metrics-daemon-dbn98" (UID: "2eeb74ea-3868-467e-ac82-a476ddfaf787") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 01:37:29.602309 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:29.601608    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 01:37:29.602309 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:29.602054    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-original-pull-secret podName:d7a3c161-fb9a-48d4-b150-58fe365b2a6c nodeName:}" failed. No retries permitted until 2026-07-31 01:37:37.602037855 +0000 UTC m=+18.182278828 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-original-pull-secret") pod "global-pull-secret-syncer-5sd9h" (UID: "d7a3c161-fb9a-48d4-b150-58fe365b2a6c") : object "kube-system"/"original-pull-secret" not registered
Jul 31 01:37:29.703689 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:29.702416    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p2tq\" (UniqueName: \"kubernetes.io/projected/1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb-kube-api-access-6p2tq\") pod \"network-check-target-78xx9\" (UID: \"1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb\") " pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:37:29.703689 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:29.702656    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 01:37:29.703689 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:29.702681    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 01:37:29.703689 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:29.702695    2571 projected.go:196] Error preparing data for projected volume kube-api-access-6p2tq for pod openshift-network-diagnostics/network-check-target-78xx9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 01:37:29.703689 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:29.702758    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb-kube-api-access-6p2tq podName:1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb nodeName:}" failed. No retries permitted until 2026-07-31 01:37:37.702739402 +0000 UTC m=+18.282980393 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6p2tq" (UniqueName: "kubernetes.io/projected/1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb-kube-api-access-6p2tq") pod "network-check-target-78xx9" (UID: "1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 01:37:29.987051 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:29.986962    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:37:29.987051 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:29.987010    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:29.987264 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:29.987078    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78xx9" podUID="1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb"
Jul 31 01:37:29.987264 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:29.987192    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sd9h" podUID="d7a3c161-fb9a-48d4-b150-58fe365b2a6c"
Jul 31 01:37:30.986140 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:30.986100    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:30.986582 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:30.986247    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbn98" podUID="2eeb74ea-3868-467e-ac82-a476ddfaf787"
Jul 31 01:37:31.985973 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:31.985428    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:37:31.985973 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:31.985450    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:31.985973 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:31.985541    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78xx9" podUID="1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb"
Jul 31 01:37:31.985973 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:31.985931    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sd9h" podUID="d7a3c161-fb9a-48d4-b150-58fe365b2a6c"
Jul 31 01:37:32.986401 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:32.986334    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:32.986875 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:32.986488    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbn98" podUID="2eeb74ea-3868-467e-ac82-a476ddfaf787"
Jul 31 01:37:33.986071 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:33.985986    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:37:33.986071 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:33.986028    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:33.986278 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:33.986117    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78xx9" podUID="1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb"
Jul 31 01:37:33.986278 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:33.986241    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sd9h" podUID="d7a3c161-fb9a-48d4-b150-58fe365b2a6c"
Jul 31 01:37:34.986254 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:34.986226    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:34.986671 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:34.986348    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbn98" podUID="2eeb74ea-3868-467e-ac82-a476ddfaf787"
Jul 31 01:37:35.986019 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:35.985982    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:35.986191 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:35.986136    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sd9h" podUID="d7a3c161-fb9a-48d4-b150-58fe365b2a6c"
Jul 31 01:37:35.986191 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:35.986180    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:37:35.986313 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:35.986290    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78xx9" podUID="1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb"
Jul 31 01:37:36.986303 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:36.986269    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:36.986777 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:36.986393    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbn98" podUID="2eeb74ea-3868-467e-ac82-a476ddfaf787"
Jul 31 01:37:37.660830 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:37.660791    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs\") pod \"network-metrics-daemon-dbn98\" (UID: \"2eeb74ea-3868-467e-ac82-a476ddfaf787\") " pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:37.661013 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:37.660848    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-original-pull-secret\") pod \"global-pull-secret-syncer-5sd9h\" (UID: \"d7a3c161-fb9a-48d4-b150-58fe365b2a6c\") " pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:37.661013 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:37.660965    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 01:37:37.661093 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:37.661025    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs podName:2eeb74ea-3868-467e-ac82-a476ddfaf787 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:53.661010267 +0000 UTC m=+34.241251243 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs") pod "network-metrics-daemon-dbn98" (UID: "2eeb74ea-3868-467e-ac82-a476ddfaf787") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 01:37:37.661093 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:37.660965    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 01:37:37.661093 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:37.661087    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-original-pull-secret podName:d7a3c161-fb9a-48d4-b150-58fe365b2a6c nodeName:}" failed. No retries permitted until 2026-07-31 01:37:53.661074028 +0000 UTC m=+34.241315016 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-original-pull-secret") pod "global-pull-secret-syncer-5sd9h" (UID: "d7a3c161-fb9a-48d4-b150-58fe365b2a6c") : object "kube-system"/"original-pull-secret" not registered
Jul 31 01:37:37.761298 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:37.761268    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p2tq\" (UniqueName: \"kubernetes.io/projected/1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb-kube-api-access-6p2tq\") pod \"network-check-target-78xx9\" (UID: \"1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb\") " pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:37:37.761471 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:37.761414    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 01:37:37.761471 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:37.761438    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 01:37:37.761471 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:37.761450    2571 projected.go:196] Error preparing data for projected volume kube-api-access-6p2tq for pod openshift-network-diagnostics/network-check-target-78xx9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 01:37:37.761606 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:37.761517    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb-kube-api-access-6p2tq podName:1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb nodeName:}" failed. No retries permitted until 2026-07-31 01:37:53.761498505 +0000 UTC m=+34.341739479 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6p2tq" (UniqueName: "kubernetes.io/projected/1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb-kube-api-access-6p2tq") pod "network-check-target-78xx9" (UID: "1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 01:37:37.986011 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:37.985927    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:37:37.986155 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:37.985927    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:37.986155 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:37.986058    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78xx9" podUID="1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb"
Jul 31 01:37:37.986155 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:37.986122    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sd9h" podUID="d7a3c161-fb9a-48d4-b150-58fe365b2a6c"
Jul 31 01:37:38.985752 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:38.985718    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:38.986227 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:38.985862    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbn98" podUID="2eeb74ea-3868-467e-ac82-a476ddfaf787"
Jul 31 01:37:39.986216 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:39.986182    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:37:39.986678 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:39.986291    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78xx9" podUID="1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb"
Jul 31 01:37:39.986678 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:39.986364    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:39.986678 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:39.986454    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sd9h" podUID="d7a3c161-fb9a-48d4-b150-58fe365b2a6c"
Jul 31 01:37:40.986062 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:40.986025    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:40.986246 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:40.986172    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbn98" podUID="2eeb74ea-3868-467e-ac82-a476ddfaf787"
Jul 31 01:37:41.986779 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:41.986194    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:37:41.986779 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:41.986578    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78xx9" podUID="1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb"
Jul 31 01:37:41.987439 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:41.986349    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:41.987439 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:41.987086    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sd9h" podUID="d7a3c161-fb9a-48d4-b150-58fe365b2a6c"
Jul 31 01:37:42.161163 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:42.160918    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-krg4k" event={"ID":"b02ea9cd-e292-44df-8d6a-113fd9848370","Type":"ContainerStarted","Data":"83daec0e3956cf048de890c636acd941a7d44d395614ad47573c45e1352a6cc0"}
Jul 31 01:37:42.162467 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:42.162438    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5vkv9" event={"ID":"09fec214-2f3f-4166-8687-3c1c822794c3","Type":"ContainerStarted","Data":"baa4d3ad615c73fcf64d9c8e1a1a99b730c5021abfbad6d872cfbc9a3e3c00a4"}
Jul 31 01:37:42.163985 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:42.163961    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx" event={"ID":"5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe","Type":"ContainerStarted","Data":"2af3f072dc5fb618c708a0900d6cebfd59b3c35eca380ed7c8db622150e89ae0"}
Jul 31 01:37:42.165372 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:42.165352    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kxjk7" event={"ID":"652076b0-3ea5-413f-8e40-396b7decfd5e","Type":"ContainerStarted","Data":"9fbdd8fd7479c270614f3f6ef8551d7247a84cf2b52f82738c8547139ebee42f"}
Jul 31 01:37:42.166820 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:42.166801    2571 generic.go:356] "Generic (PLEG): container finished" podID="ee0ad41b-adbe-4764-ab09-a9c0f058082d" containerID="f1b450f2a0b551363cf36fc4873e842e1d4671ea6ea456560ac4d1f0b9f461ec" exitCode=0
Jul 31 01:37:42.166930 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:42.166861    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g97dz" event={"ID":"ee0ad41b-adbe-4764-ab09-a9c0f058082d","Type":"ContainerDied","Data":"f1b450f2a0b551363cf36fc4873e842e1d4671ea6ea456560ac4d1f0b9f461ec"}
Jul 31 01:37:42.169057 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:42.169038    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6r5df" event={"ID":"1e39601f-4171-4ed9-81ff-e5ba5786c967","Type":"ContainerStarted","Data":"4ab116354ecb47a4d0fc89472043763a18a55f78386109ffe68d80e6595a9132"}
Jul 31 01:37:42.169154 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:42.169092    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6r5df" event={"ID":"1e39601f-4171-4ed9-81ff-e5ba5786c967","Type":"ContainerStarted","Data":"6251a547c962eef63828642776266f0110cac67f1b23193bd6f28e734d418912"}
Jul 31 01:37:42.169154 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:42.169129    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6r5df" event={"ID":"1e39601f-4171-4ed9-81ff-e5ba5786c967","Type":"ContainerStarted","Data":"42443a71553f8395fc5c708d3cf422ce87bbf7eae890e9980d7f0c864c120c94"}
Jul 31 01:37:42.170325 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:42.170303    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l4gcr" event={"ID":"522b6666-22de-4d13-9794-07680e2375d6","Type":"ContainerStarted","Data":"47e2ae2dccd05c710e86cb07fce56e80bbb369bd1ecf566457f5b183401316e0"}
Jul 31 01:37:42.171511 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:42.171492    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-th4tz" event={"ID":"a5c45f8a-a655-4813-8c7c-f26041b4f19f","Type":"ContainerStarted","Data":"ea7d79a1a49bac9a07ee3dcab8d868e5ef7f953189b484764983393f2cac7aa1"}
Jul 31 01:37:42.177703 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:42.177670    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-91.ec2.internal" podStartSLOduration=21.177658875 podStartE2EDuration="21.177658875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 01:37:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:37:25.151103795 +0000 UTC m=+5.731344793" watchObservedRunningTime="2026-07-31 01:37:42.177658875 +0000 UTC m=+22.757899870"
Jul 31 01:37:42.178181 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:42.178158    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-krg4k" podStartSLOduration=3.599256579 podStartE2EDuration="22.178152408s" totalImagesPullingTime="18.578895829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 01:37:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:37:42.177915433 +0000 UTC m=+22.758156418" watchObservedRunningTime="2026-07-31 01:37:42.178152408 +0000 UTC m=+22.758393403"
Jul 31 01:37:42.190498 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:42.190459    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5vkv9" podStartSLOduration=3.668427146 podStartE2EDuration="22.19044705s" totalImagesPullingTime="18.522019904s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 01:37:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:37:42.190441333 +0000 UTC m=+22.770682330" watchObservedRunningTime="2026-07-31 01:37:42.19044705 +0000 UTC m=+22.770688045"
Jul 31 01:37:42.228360 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:42.228316    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-l4gcr" podStartSLOduration=3.717858133 podStartE2EDuration="22.22830378s" totalImagesPullingTime="18.510445647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 01:37:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:37:42.228147845 +0000 UTC m=+22.808388841" watchObservedRunningTime="2026-07-31 01:37:42.22830378 +0000 UTC m=+22.808544775"
Jul 31 01:37:42.244580 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:42.244510    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kxjk7" podStartSLOduration=7.8508756779999995 podStartE2EDuration="22.244497381s" totalImagesPullingTime="14.393621703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:37:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:37:42.244211262 +0000 UTC m=+22.824452254" watchObservedRunningTime="2026-07-31 01:37:42.244497381 +0000 UTC m=+22.824738375"
Jul 31 01:37:42.263508 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:42.263471    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-th4tz" podStartSLOduration=3.730396644 podStartE2EDuration="22.263458228s" totalImagesPullingTime="18.533061584s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 01:37:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:37:42.263208588 +0000 UTC m=+22.843449585" watchObservedRunningTime="2026-07-31 01:37:42.263458228 +0000 UTC m=+22.843699222"
Jul 31 01:37:42.985612 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:42.985577    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:42.985787 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:42.985727    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbn98" podUID="2eeb74ea-3868-467e-ac82-a476ddfaf787"
Jul 31 01:37:43.175100 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:43.175070    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4vfkb" event={"ID":"ccac2337-37fd-4a50-b0da-8179fafdd6d2","Type":"ContainerStarted","Data":"e5a92f7dce58646fd12ea8a195479dc00f7d3f9935eb6ee165189d06e243227f"}
Jul 31 01:37:43.177759 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:43.177736    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6r5df" event={"ID":"1e39601f-4171-4ed9-81ff-e5ba5786c967","Type":"ContainerStarted","Data":"867b8285d2afa265b60f9bd5f6e7012ea70d0baec6b2fb186d946227a3e9b9ef"}
Jul 31 01:37:43.177853 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:43.177798    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6r5df" event={"ID":"1e39601f-4171-4ed9-81ff-e5ba5786c967","Type":"ContainerStarted","Data":"0b0fe04b255bbd047fa9f4f3cb30dcf53a96baccdd3efc77fafa7945cafc56d3"}
Jul 31 01:37:43.177853 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:43.177828    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6r5df" event={"ID":"1e39601f-4171-4ed9-81ff-e5ba5786c967","Type":"ContainerStarted","Data":"359efd45a6628894d5a5ed077f5f058c234ac483a939840dd815289c4af955aa"}
Jul 31 01:37:43.308534 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:43.308507    2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 31 01:37:43.893941 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:43.893809    2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-31T01:37:43.308528375Z","UUID":"483636ca-a53d-4127-ab1d-2c750dadf47d","Handler":null,"Name":"","Endpoint":""}
Jul 31 01:37:43.895686 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:43.895655    2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 31 01:37:43.895835 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:43.895702    2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 31 01:37:43.985624 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:43.985591    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:37:43.985780 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:43.985696    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78xx9" podUID="1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb"
Jul 31 01:37:43.985780 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:43.985757    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:43.985914 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:43.985873    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sd9h" podUID="d7a3c161-fb9a-48d4-b150-58fe365b2a6c"
Jul 31 01:37:44.183242 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:44.183161    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx" event={"ID":"5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe","Type":"ContainerStarted","Data":"8a904445136f1b242c09aecc6378e68fbc1c22099cb76090105e37b813cad365"}
Jul 31 01:37:44.986123 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:44.986054    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:44.986375 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:44.986178    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbn98" podUID="2eeb74ea-3868-467e-ac82-a476ddfaf787"
Jul 31 01:37:45.189834 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:45.189794    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6r5df" event={"ID":"1e39601f-4171-4ed9-81ff-e5ba5786c967","Type":"ContainerStarted","Data":"eccf24f46482ff559dfacfeece4228be8cc848588db9316ebbf560b105ad4cfc"}
Jul 31 01:37:45.192281 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:45.192252    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx" event={"ID":"5d6cfca1-2f2e-4bf4-936f-ec8b32b3dabe","Type":"ContainerStarted","Data":"ad5a1ced78a58d841f32a500868e7f6253a09d21d768e96d2d96b9373312a2cb"}
Jul 31 01:37:45.209039 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:45.208983    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4vfkb" podStartSLOduration=6.688060319 podStartE2EDuration="25.208965696s" totalImagesPullingTime="18.520905377s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 01:37:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:37:43.19511561 +0000 UTC m=+23.775356605" watchObservedRunningTime="2026-07-31 01:37:45.208965696 +0000 UTC m=+25.789206694"
Jul 31 01:37:45.985794 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:45.985596    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:37:45.985996 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:45.985662    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:45.985996 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:45.985889    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78xx9" podUID="1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb"
Jul 31 01:37:45.986112 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:45.985994    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sd9h" podUID="d7a3c161-fb9a-48d4-b150-58fe365b2a6c"
Jul 31 01:37:46.202221 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:46.202181    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kxjk7"
Jul 31 01:37:46.202950 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:46.202927    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kxjk7"
Jul 31 01:37:46.218024 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:46.217977    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs7dx" podStartSLOduration=5.5723859319999995 podStartE2EDuration="26.217962361s" totalImagesPullingTime="20.645576429s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 01:37:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:37:45.208275386 +0000 UTC m=+25.788516381" watchObservedRunningTime="2026-07-31 01:37:46.217962361 +0000 UTC m=+26.798203350"
Jul 31 01:37:46.986102 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:46.986063    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:46.986248 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:46.986225    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbn98" podUID="2eeb74ea-3868-467e-ac82-a476ddfaf787"
Jul 31 01:37:47.198826 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:47.198733    2571 generic.go:356] "Generic (PLEG): container finished" podID="ee0ad41b-adbe-4764-ab09-a9c0f058082d" containerID="13604671cfc47c03a3806e71f369171d24cb36c9a35b4260c79c092c10f2461a" exitCode=0
Jul 31 01:37:47.199004 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:47.198818    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g97dz" event={"ID":"ee0ad41b-adbe-4764-ab09-a9c0f058082d","Type":"ContainerDied","Data":"13604671cfc47c03a3806e71f369171d24cb36c9a35b4260c79c092c10f2461a"}
Jul 31 01:37:47.202611 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:47.202575    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6r5df" event={"ID":"1e39601f-4171-4ed9-81ff-e5ba5786c967","Type":"ContainerStarted","Data":"c8f9a5109cede0e48d072d04470692a76ca008f45b7485cdf49ee59b43dfcc38"}
Jul 31 01:37:47.203499 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:47.202825    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kxjk7"
Jul 31 01:37:47.203499 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:47.202865    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:47.203499 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:47.202928    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:47.203499 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:47.202975    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:47.203499 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:47.203349    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kxjk7"
Jul 31 01:37:47.219247 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:47.219070    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:47.219399 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:47.219334    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:37:47.247480 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:47.247426    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6r5df" podStartSLOduration=8.664517221 podStartE2EDuration="27.247409191s" totalImagesPullingTime="18.58289197s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 01:37:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:37:47.246196195 +0000 UTC m=+27.826437245" watchObservedRunningTime="2026-07-31 01:37:47.247409191 +0000 UTC m=+27.827650187"
Jul 31 01:37:47.986109 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:47.986080    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:37:47.986354 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:47.986080    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:47.986354 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:47.986203    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78xx9" podUID="1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb"
Jul 31 01:37:47.986354 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:47.986243    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sd9h" podUID="d7a3c161-fb9a-48d4-b150-58fe365b2a6c"
Jul 31 01:37:48.802510 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:48.802436    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5sd9h"]
Jul 31 01:37:48.802955 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:48.802582    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:48.802955 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:48.802677    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sd9h" podUID="d7a3c161-fb9a-48d4-b150-58fe365b2a6c"
Jul 31 01:37:48.805492 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:48.805468    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dbn98"]
Jul 31 01:37:48.805634 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:48.805585    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:48.805713 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:48.805692    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbn98" podUID="2eeb74ea-3868-467e-ac82-a476ddfaf787"
Jul 31 01:37:48.806122 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:48.806097    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-78xx9"]
Jul 31 01:37:48.806220 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:48.806196    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:37:48.806302 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:48.806283    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78xx9" podUID="1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb"
Jul 31 01:37:49.208947 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:49.208909    2571 generic.go:356] "Generic (PLEG): container finished" podID="ee0ad41b-adbe-4764-ab09-a9c0f058082d" containerID="91094e1b05b9b1708414df929f1a3263f018924ed950cb5dca1630cdd8142a51" exitCode=0
Jul 31 01:37:49.209141 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:49.208981    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g97dz" event={"ID":"ee0ad41b-adbe-4764-ab09-a9c0f058082d","Type":"ContainerDied","Data":"91094e1b05b9b1708414df929f1a3263f018924ed950cb5dca1630cdd8142a51"}
Jul 31 01:37:49.986289 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:49.986258    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:49.986707 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:49.986355    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbn98" podUID="2eeb74ea-3868-467e-ac82-a476ddfaf787"
Jul 31 01:37:49.986707 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:49.986440    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:49.986707 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:49.986557    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sd9h" podUID="d7a3c161-fb9a-48d4-b150-58fe365b2a6c"
Jul 31 01:37:50.985992 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:50.985801    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:37:50.986158 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:50.986072    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78xx9" podUID="1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb"
Jul 31 01:37:51.215712 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:51.215672    2571 generic.go:356] "Generic (PLEG): container finished" podID="ee0ad41b-adbe-4764-ab09-a9c0f058082d" containerID="ce1475521ccdf546b4ca46033cde8b6569669f68e1fc9fed8e62f8936d39ea41" exitCode=0
Jul 31 01:37:51.215712 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:51.215706    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g97dz" event={"ID":"ee0ad41b-adbe-4764-ab09-a9c0f058082d","Type":"ContainerDied","Data":"ce1475521ccdf546b4ca46033cde8b6569669f68e1fc9fed8e62f8936d39ea41"}
Jul 31 01:37:51.986180 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:51.986140    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:51.986337 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:51.986289    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbn98" podUID="2eeb74ea-3868-467e-ac82-a476ddfaf787"
Jul 31 01:37:51.986415 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:51.986349    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:51.986496 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:51.986472    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sd9h" podUID="d7a3c161-fb9a-48d4-b150-58fe365b2a6c"
Jul 31 01:37:52.985840 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:52.985755    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:37:52.986430 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:52.985866    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78xx9" podUID="1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb"
Jul 31 01:37:53.682274 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:53.682233    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs\") pod \"network-metrics-daemon-dbn98\" (UID: \"2eeb74ea-3868-467e-ac82-a476ddfaf787\") " pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:53.682541 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:53.682300    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-original-pull-secret\") pod \"global-pull-secret-syncer-5sd9h\" (UID: \"d7a3c161-fb9a-48d4-b150-58fe365b2a6c\") " pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:53.682541 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:53.682398    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 01:37:53.682541 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:53.682422    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 01:37:53.682541 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:53.682449    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-original-pull-secret podName:d7a3c161-fb9a-48d4-b150-58fe365b2a6c nodeName:}" failed. No retries permitted until 2026-07-31 01:38:25.682435796 +0000 UTC m=+66.262676770 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-original-pull-secret") pod "global-pull-secret-syncer-5sd9h" (UID: "d7a3c161-fb9a-48d4-b150-58fe365b2a6c") : object "kube-system"/"original-pull-secret" not registered
Jul 31 01:37:53.682541 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:53.682493    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs podName:2eeb74ea-3868-467e-ac82-a476ddfaf787 nodeName:}" failed. No retries permitted until 2026-07-31 01:38:25.682475531 +0000 UTC m=+66.262716510 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs") pod "network-metrics-daemon-dbn98" (UID: "2eeb74ea-3868-467e-ac82-a476ddfaf787") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 01:37:53.783407 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:53.783367    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p2tq\" (UniqueName: \"kubernetes.io/projected/1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb-kube-api-access-6p2tq\") pod \"network-check-target-78xx9\" (UID: \"1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb\") " pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:37:53.783598 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:53.783448    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 01:37:53.783598 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:53.783473    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 01:37:53.783598 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:53.783483    2571 projected.go:196] Error preparing data for projected volume kube-api-access-6p2tq for pod openshift-network-diagnostics/network-check-target-78xx9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 01:37:53.783598 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:53.783539    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb-kube-api-access-6p2tq podName:1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb nodeName:}" failed. No retries permitted until 2026-07-31 01:38:25.783520899 +0000 UTC m=+66.363761893 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6p2tq" (UniqueName: "kubernetes.io/projected/1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb-kube-api-access-6p2tq") pod "network-check-target-78xx9" (UID: "1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 01:37:53.985766 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:53.985674    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:53.985951 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:53.985849    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbn98" podUID="2eeb74ea-3868-467e-ac82-a476ddfaf787"
Jul 31 01:37:53.985951 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:53.985873    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:53.986433 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:53.986003    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5sd9h" podUID="d7a3c161-fb9a-48d4-b150-58fe365b2a6c"
Jul 31 01:37:54.706869 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.706835    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-91.ec2.internal" event="NodeReady"
Jul 31 01:37:54.707066 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.707015    2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 31 01:37:54.750993 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.750957    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hpfnx"]
Jul 31 01:37:54.753290 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.753268    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hpfnx"
Jul 31 01:37:54.753415 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.753323    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-djswh"]
Jul 31 01:37:54.755040 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.755022    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-djswh"
Jul 31 01:37:54.755955 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.755931    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 31 01:37:54.755955 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.755940    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 31 01:37:54.756114 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.755885    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5txjm\""
Jul 31 01:37:54.757293 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.757276    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kcx9d\""
Jul 31 01:37:54.757587 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.757570    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 31 01:37:54.757662 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.757626    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 31 01:37:54.757718 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.757664    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 31 01:37:54.762762 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.762742    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hpfnx"]
Jul 31 01:37:54.765775 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.765743    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-djswh"]
Jul 31 01:37:54.892115 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.892080    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltckx\" (UniqueName: \"kubernetes.io/projected/7cec939f-eacf-4254-abbd-75903f407f37-kube-api-access-ltckx\") pod \"dns-default-hpfnx\" (UID: \"7cec939f-eacf-4254-abbd-75903f407f37\") " pod="openshift-dns/dns-default-hpfnx"
Jul 31 01:37:54.892310 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.892133    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7cec939f-eacf-4254-abbd-75903f407f37-config-volume\") pod \"dns-default-hpfnx\" (UID: \"7cec939f-eacf-4254-abbd-75903f407f37\") " pod="openshift-dns/dns-default-hpfnx"
Jul 31 01:37:54.892310 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.892174    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/275216a4-fea3-4c16-bb45-425da974aa47-cert\") pod \"ingress-canary-djswh\" (UID: \"275216a4-fea3-4c16-bb45-425da974aa47\") " pod="openshift-ingress-canary/ingress-canary-djswh"
Jul 31 01:37:54.892310 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.892198    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cec939f-eacf-4254-abbd-75903f407f37-tmp-dir\") pod \"dns-default-hpfnx\" (UID: \"7cec939f-eacf-4254-abbd-75903f407f37\") " pod="openshift-dns/dns-default-hpfnx"
Jul 31 01:37:54.892310 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.892282    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls\") pod \"dns-default-hpfnx\" (UID: \"7cec939f-eacf-4254-abbd-75903f407f37\") " pod="openshift-dns/dns-default-hpfnx"
Jul 31 01:37:54.892528 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.892315    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkjvz\" (UniqueName: \"kubernetes.io/projected/275216a4-fea3-4c16-bb45-425da974aa47-kube-api-access-fkjvz\") pod \"ingress-canary-djswh\" (UID: \"275216a4-fea3-4c16-bb45-425da974aa47\") " pod="openshift-ingress-canary/ingress-canary-djswh"
Jul 31 01:37:54.986264 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.986172    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:37:54.988885 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.988862    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 31 01:37:54.989060 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.989037    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gfbbx\""
Jul 31 01:37:54.989188 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.989119    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 31 01:37:54.992904 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.992865    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkjvz\" (UniqueName: \"kubernetes.io/projected/275216a4-fea3-4c16-bb45-425da974aa47-kube-api-access-fkjvz\") pod \"ingress-canary-djswh\" (UID: \"275216a4-fea3-4c16-bb45-425da974aa47\") " pod="openshift-ingress-canary/ingress-canary-djswh"
Jul 31 01:37:54.993017 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.992962    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltckx\" (UniqueName: \"kubernetes.io/projected/7cec939f-eacf-4254-abbd-75903f407f37-kube-api-access-ltckx\") pod \"dns-default-hpfnx\" (UID: \"7cec939f-eacf-4254-abbd-75903f407f37\") " pod="openshift-dns/dns-default-hpfnx"
Jul 31 01:37:54.993017 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.993002    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7cec939f-eacf-4254-abbd-75903f407f37-config-volume\") pod \"dns-default-hpfnx\" (UID: \"7cec939f-eacf-4254-abbd-75903f407f37\") " pod="openshift-dns/dns-default-hpfnx"
Jul 31 01:37:54.993129 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.993027    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/275216a4-fea3-4c16-bb45-425da974aa47-cert\") pod \"ingress-canary-djswh\" (UID: \"275216a4-fea3-4c16-bb45-425da974aa47\") " pod="openshift-ingress-canary/ingress-canary-djswh"
Jul 31 01:37:54.993129 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.993057    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cec939f-eacf-4254-abbd-75903f407f37-tmp-dir\") pod \"dns-default-hpfnx\" (UID: \"7cec939f-eacf-4254-abbd-75903f407f37\") " pod="openshift-dns/dns-default-hpfnx"
Jul 31 01:37:54.993129 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.993122    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls\") pod \"dns-default-hpfnx\" (UID: \"7cec939f-eacf-4254-abbd-75903f407f37\") " pod="openshift-dns/dns-default-hpfnx"
Jul 31 01:37:54.993269 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:54.993229    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 01:37:54.993424 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:54.993288    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls podName:7cec939f-eacf-4254-abbd-75903f407f37 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:55.493268967 +0000 UTC m=+36.073509963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls") pod "dns-default-hpfnx" (UID: "7cec939f-eacf-4254-abbd-75903f407f37") : secret "dns-default-metrics-tls" not found
Jul 31 01:37:54.993778 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.993746    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7cec939f-eacf-4254-abbd-75903f407f37-config-volume\") pod \"dns-default-hpfnx\" (UID: \"7cec939f-eacf-4254-abbd-75903f407f37\") " pod="openshift-dns/dns-default-hpfnx"
Jul 31 01:37:54.993865 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.993786    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cec939f-eacf-4254-abbd-75903f407f37-tmp-dir\") pod \"dns-default-hpfnx\" (UID: \"7cec939f-eacf-4254-abbd-75903f407f37\") " pod="openshift-dns/dns-default-hpfnx"
Jul 31 01:37:54.998429 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:54.998410    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/275216a4-fea3-4c16-bb45-425da974aa47-cert\") pod \"ingress-canary-djswh\" (UID: \"275216a4-fea3-4c16-bb45-425da974aa47\") " pod="openshift-ingress-canary/ingress-canary-djswh"
Jul 31 01:37:55.004059 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:55.004038    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltckx\" (UniqueName: \"kubernetes.io/projected/7cec939f-eacf-4254-abbd-75903f407f37-kube-api-access-ltckx\") pod \"dns-default-hpfnx\" (UID: \"7cec939f-eacf-4254-abbd-75903f407f37\") " pod="openshift-dns/dns-default-hpfnx"
Jul 31 01:37:55.004334 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:55.004314    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkjvz\" (UniqueName: \"kubernetes.io/projected/275216a4-fea3-4c16-bb45-425da974aa47-kube-api-access-fkjvz\") pod \"ingress-canary-djswh\" (UID: \"275216a4-fea3-4c16-bb45-425da974aa47\") " pod="openshift-ingress-canary/ingress-canary-djswh"
Jul 31 01:37:55.072254 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:55.072225    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-djswh"
Jul 31 01:37:55.496669 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:55.496632    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls\") pod \"dns-default-hpfnx\" (UID: \"7cec939f-eacf-4254-abbd-75903f407f37\") " pod="openshift-dns/dns-default-hpfnx"
Jul 31 01:37:55.496845 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:55.496798    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 01:37:55.496916 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:55.496867    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls podName:7cec939f-eacf-4254-abbd-75903f407f37 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:56.496851757 +0000 UTC m=+37.077092730 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls") pod "dns-default-hpfnx" (UID: "7cec939f-eacf-4254-abbd-75903f407f37") : secret "dns-default-metrics-tls" not found
Jul 31 01:37:55.986248 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:55.986211    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:37:55.986425 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:55.986214    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:37:55.989014 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:55.988992    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 31 01:37:55.989124 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:55.989019    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 31 01:37:55.989124 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:55.989080    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zn99h\""
Jul 31 01:37:56.165815 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:56.165650    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-djswh"]
Jul 31 01:37:56.169269 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:37:56.169239    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod275216a4_fea3_4c16_bb45_425da974aa47.slice/crio-5c891a0acc7147a69eeea87b46bcb4b79d8ce7730d98313bfe88a6afe90cebd3 WatchSource:0}: Error finding container 5c891a0acc7147a69eeea87b46bcb4b79d8ce7730d98313bfe88a6afe90cebd3: Status 404 returned error can't find the container with id 5c891a0acc7147a69eeea87b46bcb4b79d8ce7730d98313bfe88a6afe90cebd3
Jul 31 01:37:56.229551 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:56.229498    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g97dz" event={"ID":"ee0ad41b-adbe-4764-ab09-a9c0f058082d","Type":"ContainerStarted","Data":"3b81b3a05a8873456cd0ca093b370754c0d37061d6c05edf2ffac162e53c2c9c"}
Jul 31 01:37:56.230679 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:56.230641    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-djswh" event={"ID":"275216a4-fea3-4c16-bb45-425da974aa47","Type":"ContainerStarted","Data":"5c891a0acc7147a69eeea87b46bcb4b79d8ce7730d98313bfe88a6afe90cebd3"}
Jul 31 01:37:56.504968 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:56.504852    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls\") pod \"dns-default-hpfnx\" (UID: \"7cec939f-eacf-4254-abbd-75903f407f37\") " pod="openshift-dns/dns-default-hpfnx"
Jul 31 01:37:56.505116 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:56.505005    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 01:37:56.505116 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:56.505072    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls podName:7cec939f-eacf-4254-abbd-75903f407f37 nodeName:}" failed. No retries permitted until 2026-07-31 01:37:58.505056606 +0000 UTC m=+39.085297581 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls") pod "dns-default-hpfnx" (UID: "7cec939f-eacf-4254-abbd-75903f407f37") : secret "dns-default-metrics-tls" not found
Jul 31 01:37:57.236068 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:57.236025    2571 generic.go:356] "Generic (PLEG): container finished" podID="ee0ad41b-adbe-4764-ab09-a9c0f058082d" containerID="3b81b3a05a8873456cd0ca093b370754c0d37061d6c05edf2ffac162e53c2c9c" exitCode=0
Jul 31 01:37:57.236522 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:57.236091    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g97dz" event={"ID":"ee0ad41b-adbe-4764-ab09-a9c0f058082d","Type":"ContainerDied","Data":"3b81b3a05a8873456cd0ca093b370754c0d37061d6c05edf2ffac162e53c2c9c"}
Jul 31 01:37:58.242114 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:58.242072    2571 generic.go:356] "Generic (PLEG): container finished" podID="ee0ad41b-adbe-4764-ab09-a9c0f058082d" containerID="138892b69b0d8b2d0966f4c3597e388d33f14f28d48d8fced225dbaa9313ac33" exitCode=0
Jul 31 01:37:58.242575 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:58.242147    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g97dz" event={"ID":"ee0ad41b-adbe-4764-ab09-a9c0f058082d","Type":"ContainerDied","Data":"138892b69b0d8b2d0966f4c3597e388d33f14f28d48d8fced225dbaa9313ac33"}
Jul 31 01:37:58.520328 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:58.520009    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls\") pod \"dns-default-hpfnx\" (UID: \"7cec939f-eacf-4254-abbd-75903f407f37\") " pod="openshift-dns/dns-default-hpfnx"
Jul 31 01:37:58.520328 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:58.520154    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 01:37:58.520475 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:37:58.520444    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls podName:7cec939f-eacf-4254-abbd-75903f407f37 nodeName:}" failed. No retries permitted until 2026-07-31 01:38:02.520420133 +0000 UTC m=+43.100661127 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls") pod "dns-default-hpfnx" (UID: "7cec939f-eacf-4254-abbd-75903f407f37") : secret "dns-default-metrics-tls" not found
Jul 31 01:37:59.247767 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:59.247735    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g97dz" event={"ID":"ee0ad41b-adbe-4764-ab09-a9c0f058082d","Type":"ContainerStarted","Data":"abd9f483f6194a79b3b0be88ea3efd11d54d583742d189cf83afd5c29fa8babb"}
Jul 31 01:37:59.249089 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:59.249062    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-djswh" event={"ID":"275216a4-fea3-4c16-bb45-425da974aa47","Type":"ContainerStarted","Data":"e56fe0be778c714a4c0ba36121dd77fbcd0d6210e7c9ee65c6e3fda40938dda0"}
Jul 31 01:37:59.269861 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:59.269814    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-g97dz" podStartSLOduration=9.219403532 podStartE2EDuration="39.26979923s" totalImagesPullingTime="30.050395698s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 01:37:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:37:59.268156148 +0000 UTC m=+39.848397144" watchObservedRunningTime="2026-07-31 01:37:59.26979923 +0000 UTC m=+39.850040225"
Jul 31 01:37:59.282147 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:37:59.282106    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-djswh" podStartSLOduration=2.9726134269999998 podStartE2EDuration="5.28209273s" totalImagesPullingTime="2.309479303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:37:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:37:59.281852827 +0000 UTC m=+39.862093823" watchObservedRunningTime="2026-07-31 01:37:59.28209273 +0000 UTC m=+39.862333726"
Jul 31 01:38:02.552034 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:38:02.551991    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls\") pod \"dns-default-hpfnx\" (UID: \"7cec939f-eacf-4254-abbd-75903f407f37\") " pod="openshift-dns/dns-default-hpfnx"
Jul 31 01:38:02.552436 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:38:02.552136    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 01:38:02.552436 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:38:02.552199    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls podName:7cec939f-eacf-4254-abbd-75903f407f37 nodeName:}" failed. No retries permitted until 2026-07-31 01:38:10.552183577 +0000 UTC m=+51.132424578 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls") pod "dns-default-hpfnx" (UID: "7cec939f-eacf-4254-abbd-75903f407f37") : secret "dns-default-metrics-tls" not found
Jul 31 01:38:10.606861 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:38:10.606820    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls\") pod \"dns-default-hpfnx\" (UID: \"7cec939f-eacf-4254-abbd-75903f407f37\") " pod="openshift-dns/dns-default-hpfnx"
Jul 31 01:38:10.607318 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:38:10.606971    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 01:38:10.607318 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:38:10.607024    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls podName:7cec939f-eacf-4254-abbd-75903f407f37 nodeName:}" failed. No retries permitted until 2026-07-31 01:38:26.607010448 +0000 UTC m=+67.187251422 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls") pod "dns-default-hpfnx" (UID: "7cec939f-eacf-4254-abbd-75903f407f37") : secret "dns-default-metrics-tls" not found
Jul 31 01:38:19.219358 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:38:19.219328    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6r5df"
Jul 31 01:38:25.711576 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:38:25.711539    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs\") pod \"network-metrics-daemon-dbn98\" (UID: \"2eeb74ea-3868-467e-ac82-a476ddfaf787\") " pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:38:25.712047 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:38:25.711611    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-original-pull-secret\") pod \"global-pull-secret-syncer-5sd9h\" (UID: \"d7a3c161-fb9a-48d4-b150-58fe365b2a6c\") " pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:38:25.714235 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:38:25.714217    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 31 01:38:25.714338 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:38:25.714322    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 31 01:38:25.722334 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:38:25.722318    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 31 01:38:25.722394 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:38:25.722385    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs podName:2eeb74ea-3868-467e-ac82-a476ddfaf787 nodeName:}" failed. No retries permitted until 2026-07-31 01:39:29.722367605 +0000 UTC m=+130.302608582 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs") pod "network-metrics-daemon-dbn98" (UID: "2eeb74ea-3868-467e-ac82-a476ddfaf787") : secret "metrics-daemon-secret" not found
Jul 31 01:38:25.726001 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:38:25.725973    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7a3c161-fb9a-48d4-b150-58fe365b2a6c-original-pull-secret\") pod \"global-pull-secret-syncer-5sd9h\" (UID: \"d7a3c161-fb9a-48d4-b150-58fe365b2a6c\") " pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:38:25.812675 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:38:25.812635    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p2tq\" (UniqueName: \"kubernetes.io/projected/1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb-kube-api-access-6p2tq\") pod \"network-check-target-78xx9\" (UID: \"1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb\") " pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:38:25.815353 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:38:25.815336    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 31 01:38:25.825718 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:38:25.825703    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 31 01:38:25.835853 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:38:25.835828    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p2tq\" (UniqueName: \"kubernetes.io/projected/1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb-kube-api-access-6p2tq\") pod \"network-check-target-78xx9\" (UID: \"1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb\") " pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:38:25.899653 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:38:25.899622    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gfbbx\""
Jul 31 01:38:25.907839 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:38:25.907822    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:38:25.998626 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:38:25.998592    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5sd9h"
Jul 31 01:38:26.029654 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:38:26.029603    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-78xx9"]
Jul 31 01:38:26.032557 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:38:26.032533    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cae4c84_3f7a_43ac_8a65_afa0c0e5a9cb.slice/crio-21a2eb6d14a5f6c65dc1763bb93158d3b1c1428a2151add1bda934730f016182 WatchSource:0}: Error finding container 21a2eb6d14a5f6c65dc1763bb93158d3b1c1428a2151add1bda934730f016182: Status 404 returned error can't find the container with id 21a2eb6d14a5f6c65dc1763bb93158d3b1c1428a2151add1bda934730f016182
Jul 31 01:38:26.117018 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:38:26.116986    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5sd9h"]
Jul 31 01:38:26.120256 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:38:26.120232    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7a3c161_fb9a_48d4_b150_58fe365b2a6c.slice/crio-707cb13abe00ea9aaf47e3d878203babc59108ec19bcdb77776fa00100377d72 WatchSource:0}: Error finding container 707cb13abe00ea9aaf47e3d878203babc59108ec19bcdb77776fa00100377d72: Status 404 returned error can't find the container with id 707cb13abe00ea9aaf47e3d878203babc59108ec19bcdb77776fa00100377d72
Jul 31 01:38:26.313309 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:38:26.313218    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-78xx9" event={"ID":"1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb","Type":"ContainerStarted","Data":"21a2eb6d14a5f6c65dc1763bb93158d3b1c1428a2151add1bda934730f016182"}
Jul 31 01:38:26.314200 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:38:26.314180    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5sd9h" event={"ID":"d7a3c161-fb9a-48d4-b150-58fe365b2a6c","Type":"ContainerStarted","Data":"707cb13abe00ea9aaf47e3d878203babc59108ec19bcdb77776fa00100377d72"}
Jul 31 01:38:26.618657 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:38:26.618620    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls\") pod \"dns-default-hpfnx\" (UID: \"7cec939f-eacf-4254-abbd-75903f407f37\") " pod="openshift-dns/dns-default-hpfnx"
Jul 31 01:38:26.618821 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:38:26.618801    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 01:38:26.618919 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:38:26.618909    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls podName:7cec939f-eacf-4254-abbd-75903f407f37 nodeName:}" failed. No retries permitted until 2026-07-31 01:38:58.618872922 +0000 UTC m=+99.199113910 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls") pod "dns-default-hpfnx" (UID: "7cec939f-eacf-4254-abbd-75903f407f37") : secret "dns-default-metrics-tls" not found
Jul 31 01:38:31.328065 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:38:31.328025    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-78xx9" event={"ID":"1cae4c84-3f7a-43ac-8a65-afa0c0e5a9cb","Type":"ContainerStarted","Data":"e0a145c106292479298c8d36cda240691673813f4d44bc2583d1938197920aa2"}
Jul 31 01:38:31.328606 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:38:31.328121    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:38:31.329378 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:38:31.329357    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5sd9h" event={"ID":"d7a3c161-fb9a-48d4-b150-58fe365b2a6c","Type":"ContainerStarted","Data":"213fd16df77c62602624ed5fe64ea6425863688755b3743bb93dee0e9e67687d"}
Jul 31 01:38:31.343582 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:38:31.343537    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-78xx9" podStartSLOduration=66.718432155 podStartE2EDuration="1m11.343525123s" totalImagesPullingTime="4.625092968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:37:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:38:31.343007527 +0000 UTC m=+71.923248522" watchObservedRunningTime="2026-07-31 01:38:31.343525123 +0000 UTC m=+71.923766096"
Jul 31 01:38:58.641647 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:38:58.641533    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls\") pod \"dns-default-hpfnx\" (UID: \"7cec939f-eacf-4254-abbd-75903f407f37\") " pod="openshift-dns/dns-default-hpfnx"
Jul 31 01:38:58.642093 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:38:58.641701    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 01:38:58.642093 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:38:58.641770    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls podName:7cec939f-eacf-4254-abbd-75903f407f37 nodeName:}" failed. No retries permitted until 2026-07-31 01:40:02.641755295 +0000 UTC m=+163.221996267 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls") pod "dns-default-hpfnx" (UID: "7cec939f-eacf-4254-abbd-75903f407f37") : secret "dns-default-metrics-tls" not found
Jul 31 01:39:02.334931 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:39:02.334866    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-78xx9"
Jul 31 01:39:02.350202 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:39:02.350151    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5sd9h" podStartSLOduration=97.809724991 podStartE2EDuration="1m42.35013523s" totalImagesPullingTime="4.540410239s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 01:37:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:38:31.356111181 +0000 UTC m=+71.936352179" watchObservedRunningTime="2026-07-31 01:39:02.35013523 +0000 UTC m=+102.930376224"
Jul 31 01:39:22.566756 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:39:22.566714    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7f44cfd4-d4kcs"]
Jul 31 01:39:22.568914 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:39:22.568732    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7f44cfd4-d4kcs"
Jul 31 01:39:22.572432 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:39:22.572402    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-47s2g\""
Jul 31 01:39:22.572585 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:39:22.572405    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 31 01:39:22.572585 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:39:22.572447    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 31 01:39:22.572585 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:39:22.572406    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 31 01:39:22.572585 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:39:22.572408    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 31 01:39:22.578776 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:39:22.578740    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7f44cfd4-d4kcs"]
Jul 31 01:39:22.704296 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:39:22.704256    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9d0c771f-76cf-4d49-98b9-d79883722cdc-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c7f44cfd4-d4kcs\" (UID: \"9d0c771f-76cf-4d49-98b9-d79883722cdc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7f44cfd4-d4kcs"
Jul 31 01:39:22.704497 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:39:22.704390    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg9cc\" (UniqueName: \"kubernetes.io/projected/9d0c771f-76cf-4d49-98b9-d79883722cdc-kube-api-access-hg9cc\") pod \"managed-serviceaccount-addon-agent-5c7f44cfd4-d4kcs\" (UID: \"9d0c771f-76cf-4d49-98b9-d79883722cdc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7f44cfd4-d4kcs"
Jul 31 01:39:22.805450 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:39:22.805413    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg9cc\" (UniqueName: \"kubernetes.io/projected/9d0c771f-76cf-4d49-98b9-d79883722cdc-kube-api-access-hg9cc\") pod \"managed-serviceaccount-addon-agent-5c7f44cfd4-d4kcs\" (UID: \"9d0c771f-76cf-4d49-98b9-d79883722cdc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7f44cfd4-d4kcs"
Jul 31 01:39:22.805450 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:39:22.805456    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9d0c771f-76cf-4d49-98b9-d79883722cdc-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c7f44cfd4-d4kcs\" (UID: \"9d0c771f-76cf-4d49-98b9-d79883722cdc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7f44cfd4-d4kcs"
Jul 31 01:39:22.807923 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:39:22.807881    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9d0c771f-76cf-4d49-98b9-d79883722cdc-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c7f44cfd4-d4kcs\" (UID: \"9d0c771f-76cf-4d49-98b9-d79883722cdc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7f44cfd4-d4kcs"
Jul 31 01:39:22.815351 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:39:22.815316    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg9cc\" (UniqueName: \"kubernetes.io/projected/9d0c771f-76cf-4d49-98b9-d79883722cdc-kube-api-access-hg9cc\") pod \"managed-serviceaccount-addon-agent-5c7f44cfd4-d4kcs\" (UID: \"9d0c771f-76cf-4d49-98b9-d79883722cdc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7f44cfd4-d4kcs"
Jul 31 01:39:22.889288 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:39:22.889257    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7f44cfd4-d4kcs"
Jul 31 01:39:23.008861 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:39:23.008793    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7f44cfd4-d4kcs"]
Jul 31 01:39:23.012288 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:39:23.012260    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d0c771f_76cf_4d49_98b9_d79883722cdc.slice/crio-9d7bda30e6b4d52b40c351a086e4a0a4339acd1dbe7588a9965b64ef339037a6 WatchSource:0}: Error finding container 9d7bda30e6b4d52b40c351a086e4a0a4339acd1dbe7588a9965b64ef339037a6: Status 404 returned error can't find the container with id 9d7bda30e6b4d52b40c351a086e4a0a4339acd1dbe7588a9965b64ef339037a6
Jul 31 01:39:23.454948 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:39:23.454916    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7f44cfd4-d4kcs" event={"ID":"9d0c771f-76cf-4d49-98b9-d79883722cdc","Type":"ContainerStarted","Data":"9d7bda30e6b4d52b40c351a086e4a0a4339acd1dbe7588a9965b64ef339037a6"}
Jul 31 01:39:27.466476 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:39:27.466439    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7f44cfd4-d4kcs" event={"ID":"9d0c771f-76cf-4d49-98b9-d79883722cdc","Type":"ContainerStarted","Data":"44152364aeee2eaf1199c7d1d644e7a8bc796bd9095c4e1931350318162df173"}
Jul 31 01:39:27.481816 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:39:27.481769    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7f44cfd4-d4kcs" podStartSLOduration=1.727057157 podStartE2EDuration="5.481756017s" totalImagesPullingTime="3.75469886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:39:27.481589877 +0000 UTC m=+128.061830872" watchObservedRunningTime="2026-07-31 01:39:27.481756017 +0000 UTC m=+128.061997011"
Jul 31 01:39:29.752281 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:39:29.752237    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs\") pod \"network-metrics-daemon-dbn98\" (UID: \"2eeb74ea-3868-467e-ac82-a476ddfaf787\") " pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:39:29.752755 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:39:29.752345    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 31 01:39:29.752755 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:39:29.752398    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs podName:2eeb74ea-3868-467e-ac82-a476ddfaf787 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:31.752384025 +0000 UTC m=+252.332624998 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs") pod "network-metrics-daemon-dbn98" (UID: "2eeb74ea-3868-467e-ac82-a476ddfaf787") : secret "metrics-daemon-secret" not found
Jul 31 01:39:57.766573 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:39:57.766532    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hpfnx" podUID="7cec939f-eacf-4254-abbd-75903f407f37"
Jul 31 01:39:58.543625 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:39:58.543588    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hpfnx"
Jul 31 01:39:59.003780 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:39:59.003736    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dbn98" podUID="2eeb74ea-3868-467e-ac82-a476ddfaf787"
Jul 31 01:40:02.663672 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:40:02.663617    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls\") pod \"dns-default-hpfnx\" (UID: \"7cec939f-eacf-4254-abbd-75903f407f37\") " pod="openshift-dns/dns-default-hpfnx"
Jul 31 01:40:02.664314 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:40:02.663791    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 01:40:02.664314 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:40:02.663883    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls podName:7cec939f-eacf-4254-abbd-75903f407f37 nodeName:}" failed. No retries permitted until 2026-07-31 01:42:04.663859457 +0000 UTC m=+285.244100452 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls") pod "dns-default-hpfnx" (UID: "7cec939f-eacf-4254-abbd-75903f407f37") : secret "dns-default-metrics-tls" not found
Jul 31 01:40:13.986509 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:40:13.986424    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:41:05.742224 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.742190    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-77696685b-gklgq"]
Jul 31 01:41:05.744948 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.744926    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jfbvr"]
Jul 31 01:41:05.745088 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.745006    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-gklgq"
Jul 31 01:41:05.747561 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.747505    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 31 01:41:05.747703 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.747638    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-fw8wr\""
Jul 31 01:41:05.747703 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.747660    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jfbvr"
Jul 31 01:41:05.747806 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.747752    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 31 01:41:05.747971 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.747954    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 31 01:41:05.747971 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.747963    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 31 01:41:05.750428 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.750409    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8hcnp\""
Jul 31 01:41:05.750536 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.750442    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 31 01:41:05.750536 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.750415    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 31 01:41:05.750757 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.750741    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 31 01:41:05.753566 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.753547    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 31 01:41:05.763683 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.763662    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jfbvr"]
Jul 31 01:41:05.764314 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.764291    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-gklgq"]
Jul 31 01:41:05.832911 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.832876    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-jrpst"]
Jul 31 01:41:05.835635 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.835614    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-jrpst"
Jul 31 01:41:05.837378 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.837354    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-78d646dddb-6hkw9"]
Jul 31 01:41:05.838828 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.838811    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 31 01:41:05.838944 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.838824    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-r69pd\""
Jul 31 01:41:05.838944 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.838852    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 31 01:41:05.840166 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.840151    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b57d7bb5d-zm786"]
Jul 31 01:41:05.840280 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.840268    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:05.843021 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.843002    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:05.851504 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.851487    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 31 01:41:05.851871 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.851853    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 31 01:41:05.851980 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.851887    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 31 01:41:05.851980 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.851953    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 31 01:41:05.851980 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.851974    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 31 01:41:05.852136 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.852036    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-p7dl9\""
Jul 31 01:41:05.861614 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.861583    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 31 01:41:05.861949 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.861930    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 31 01:41:05.862133 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.861959    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 31 01:41:05.862133 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.862051    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6prlk\""
Jul 31 01:41:05.862285 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.862270    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 31 01:41:05.863684 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.863665    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-jrpst"]
Jul 31 01:41:05.869882 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.869850    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b57d7bb5d-zm786"]
Jul 31 01:41:05.871090 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.871071    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-78d646dddb-6hkw9"]
Jul 31 01:41:05.880183 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.880163    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 31 01:41:05.896635 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.896606    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22-snapshots\") pod \"insights-operator-77696685b-gklgq\" (UID: \"7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22\") " pod="openshift-insights/insights-operator-77696685b-gklgq"
Jul 31 01:41:05.896740 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.896640    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkmrl\" (UniqueName: \"kubernetes.io/projected/5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb-kube-api-access-nkmrl\") pod \"cluster-samples-operator-559cbf5745-jfbvr\" (UID: \"5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jfbvr"
Jul 31 01:41:05.896740 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.896663    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22-service-ca-bundle\") pod \"insights-operator-77696685b-gklgq\" (UID: \"7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22\") " pod="openshift-insights/insights-operator-77696685b-gklgq"
Jul 31 01:41:05.896740 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.896693    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22-serving-cert\") pod \"insights-operator-77696685b-gklgq\" (UID: \"7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22\") " pod="openshift-insights/insights-operator-77696685b-gklgq"
Jul 31 01:41:05.896740 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.896733    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgxcp\" (UniqueName: \"kubernetes.io/projected/1e80ef61-7c6a-48d3-9406-7d1e7435fa6a-kube-api-access-wgxcp\") pod \"volume-data-source-validator-5b8776669-jrpst\" (UID: \"1e80ef61-7c6a-48d3-9406-7d1e7435fa6a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-jrpst"
Jul 31 01:41:05.896868 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.896748    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22-tmp\") pod \"insights-operator-77696685b-gklgq\" (UID: \"7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22\") " pod="openshift-insights/insights-operator-77696685b-gklgq"
Jul 31 01:41:05.896868 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.896794    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22-trusted-ca-bundle\") pod \"insights-operator-77696685b-gklgq\" (UID: \"7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22\") " pod="openshift-insights/insights-operator-77696685b-gklgq"
Jul 31 01:41:05.896868 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.896817    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-jfbvr\" (UID: \"5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jfbvr"
Jul 31 01:41:05.896868 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.896851    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6fht\" (UniqueName: \"kubernetes.io/projected/7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22-kube-api-access-g6fht\") pod \"insights-operator-77696685b-gklgq\" (UID: \"7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22\") " pod="openshift-insights/insights-operator-77696685b-gklgq"
Jul 31 01:41:05.998171 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.998064    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs7dt\" (UniqueName: \"kubernetes.io/projected/03e216bb-cb12-4fb4-a9dd-a693daa5f657-kube-api-access-qs7dt\") pod \"router-default-78d646dddb-6hkw9\" (UID: \"03e216bb-cb12-4fb4-a9dd-a693daa5f657\") " pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:05.998171 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.998117    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkmrl\" (UniqueName: \"kubernetes.io/projected/5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb-kube-api-access-nkmrl\") pod \"cluster-samples-operator-559cbf5745-jfbvr\" (UID: \"5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jfbvr"
Jul 31 01:41:05.998171 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.998138    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae6425d7-a4c4-4e59-aebf-7cc141f93252-image-registry-private-configuration\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:05.998171 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.998162    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae6425d7-a4c4-4e59-aebf-7cc141f93252-ca-trust-extracted\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:05.998171 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.998184    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22-serving-cert\") pod \"insights-operator-77696685b-gklgq\" (UID: \"7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22\") " pod="openshift-insights/insights-operator-77696685b-gklgq"
Jul 31 01:41:05.998489 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.998201    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-registry-tls\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:05.998489 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.998215    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae6425d7-a4c4-4e59-aebf-7cc141f93252-registry-certificates\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:05.998489 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.998229    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-bound-sa-token\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:05.998489 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.998321    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae6425d7-a4c4-4e59-aebf-7cc141f93252-trusted-ca\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:05.998489 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.998340    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8lgs\" (UniqueName: \"kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-kube-api-access-m8lgs\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:05.998489 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.998357    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgxcp\" (UniqueName: \"kubernetes.io/projected/1e80ef61-7c6a-48d3-9406-7d1e7435fa6a-kube-api-access-wgxcp\") pod \"volume-data-source-validator-5b8776669-jrpst\" (UID: \"1e80ef61-7c6a-48d3-9406-7d1e7435fa6a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-jrpst"
Jul 31 01:41:05.998489 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.998394    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03e216bb-cb12-4fb4-a9dd-a693daa5f657-metrics-certs\") pod \"router-default-78d646dddb-6hkw9\" (UID: \"03e216bb-cb12-4fb4-a9dd-a693daa5f657\") " pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:05.998489 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.998436    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22-trusted-ca-bundle\") pod \"insights-operator-77696685b-gklgq\" (UID: \"7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22\") " pod="openshift-insights/insights-operator-77696685b-gklgq"
Jul 31 01:41:05.998489 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.998470    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6fht\" (UniqueName: \"kubernetes.io/projected/7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22-kube-api-access-g6fht\") pod \"insights-operator-77696685b-gklgq\" (UID: \"7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22\") " pod="openshift-insights/insights-operator-77696685b-gklgq"
Jul 31 01:41:05.998489 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.998490    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/03e216bb-cb12-4fb4-a9dd-a693daa5f657-default-certificate\") pod \"router-default-78d646dddb-6hkw9\" (UID: \"03e216bb-cb12-4fb4-a9dd-a693daa5f657\") " pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:05.998973 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.998530    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22-snapshots\") pod \"insights-operator-77696685b-gklgq\" (UID: \"7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22\") " pod="openshift-insights/insights-operator-77696685b-gklgq"
Jul 31 01:41:05.998973 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.998638    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae6425d7-a4c4-4e59-aebf-7cc141f93252-installation-pull-secrets\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:05.998973 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.998690    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22-service-ca-bundle\") pod \"insights-operator-77696685b-gklgq\" (UID: \"7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22\") " pod="openshift-insights/insights-operator-77696685b-gklgq"
Jul 31 01:41:05.998973 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.998736    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e216bb-cb12-4fb4-a9dd-a693daa5f657-service-ca-bundle\") pod \"router-default-78d646dddb-6hkw9\" (UID: \"03e216bb-cb12-4fb4-a9dd-a693daa5f657\") " pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:05.998973 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.998843    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22-tmp\") pod \"insights-operator-77696685b-gklgq\" (UID: \"7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22\") " pod="openshift-insights/insights-operator-77696685b-gklgq"
Jul 31 01:41:05.998973 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.998881    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-jfbvr\" (UID: \"5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jfbvr"
Jul 31 01:41:05.998973 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.998927    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/03e216bb-cb12-4fb4-a9dd-a693daa5f657-stats-auth\") pod \"router-default-78d646dddb-6hkw9\" (UID: \"03e216bb-cb12-4fb4-a9dd-a693daa5f657\") " pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:05.999309 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:05.999048    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 31 01:41:05.999309 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:05.999115    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb-samples-operator-tls podName:5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb nodeName:}" failed. No retries permitted until 2026-07-31 01:41:06.499096657 +0000 UTC m=+227.079337634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-jfbvr" (UID: "5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb") : secret "samples-operator-tls" not found
Jul 31 01:41:05.999309 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.999176    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22-snapshots\") pod \"insights-operator-77696685b-gklgq\" (UID: \"7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22\") " pod="openshift-insights/insights-operator-77696685b-gklgq"
Jul 31 01:41:05.999309 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.999225    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22-tmp\") pod \"insights-operator-77696685b-gklgq\" (UID: \"7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22\") " pod="openshift-insights/insights-operator-77696685b-gklgq"
Jul 31 01:41:05.999309 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.999250    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22-service-ca-bundle\") pod \"insights-operator-77696685b-gklgq\" (UID: \"7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22\") " pod="openshift-insights/insights-operator-77696685b-gklgq"
Jul 31 01:41:05.999720 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:05.999704    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22-trusted-ca-bundle\") pod \"insights-operator-77696685b-gklgq\" (UID: \"7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22\") " pod="openshift-insights/insights-operator-77696685b-gklgq"
Jul 31 01:41:06.000677 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.000661    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22-serving-cert\") pod \"insights-operator-77696685b-gklgq\" (UID: \"7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22\") " pod="openshift-insights/insights-operator-77696685b-gklgq"
Jul 31 01:41:06.006445 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.006413    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6fht\" (UniqueName: \"kubernetes.io/projected/7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22-kube-api-access-g6fht\") pod \"insights-operator-77696685b-gklgq\" (UID: \"7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22\") " pod="openshift-insights/insights-operator-77696685b-gklgq"
Jul 31 01:41:06.006736 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.006716    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkmrl\" (UniqueName: \"kubernetes.io/projected/5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb-kube-api-access-nkmrl\") pod \"cluster-samples-operator-559cbf5745-jfbvr\" (UID: \"5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jfbvr"
Jul 31 01:41:06.006818 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.006776    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgxcp\" (UniqueName: \"kubernetes.io/projected/1e80ef61-7c6a-48d3-9406-7d1e7435fa6a-kube-api-access-wgxcp\") pod \"volume-data-source-validator-5b8776669-jrpst\" (UID: \"1e80ef61-7c6a-48d3-9406-7d1e7435fa6a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-jrpst"
Jul 31 01:41:06.054724 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.054691    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-gklgq"
Jul 31 01:41:06.100262 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.100228    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs7dt\" (UniqueName: \"kubernetes.io/projected/03e216bb-cb12-4fb4-a9dd-a693daa5f657-kube-api-access-qs7dt\") pod \"router-default-78d646dddb-6hkw9\" (UID: \"03e216bb-cb12-4fb4-a9dd-a693daa5f657\") " pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:06.100502 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.100266    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae6425d7-a4c4-4e59-aebf-7cc141f93252-image-registry-private-configuration\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:06.100502 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.100287    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae6425d7-a4c4-4e59-aebf-7cc141f93252-ca-trust-extracted\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:06.100502 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.100308    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-registry-tls\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:06.100502 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.100326    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae6425d7-a4c4-4e59-aebf-7cc141f93252-registry-certificates\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:06.100502 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.100349    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-bound-sa-token\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:06.100502 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.100370    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae6425d7-a4c4-4e59-aebf-7cc141f93252-trusted-ca\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:06.100502 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.100386    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8lgs\" (UniqueName: \"kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-kube-api-access-m8lgs\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:06.100502 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.100409    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03e216bb-cb12-4fb4-a9dd-a693daa5f657-metrics-certs\") pod \"router-default-78d646dddb-6hkw9\" (UID: \"03e216bb-cb12-4fb4-a9dd-a693daa5f657\") " pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:06.100502 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.100439    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/03e216bb-cb12-4fb4-a9dd-a693daa5f657-default-certificate\") pod \"router-default-78d646dddb-6hkw9\" (UID: \"03e216bb-cb12-4fb4-a9dd-a693daa5f657\") " pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:06.100502 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.100499    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae6425d7-a4c4-4e59-aebf-7cc141f93252-installation-pull-secrets\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:06.101273 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.100530    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e216bb-cb12-4fb4-a9dd-a693daa5f657-service-ca-bundle\") pod \"router-default-78d646dddb-6hkw9\" (UID: \"03e216bb-cb12-4fb4-a9dd-a693daa5f657\") " pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:06.101273 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.100563    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/03e216bb-cb12-4fb4-a9dd-a693daa5f657-stats-auth\") pod \"router-default-78d646dddb-6hkw9\" (UID: \"03e216bb-cb12-4fb4-a9dd-a693daa5f657\") " pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:06.101273 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.100710    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae6425d7-a4c4-4e59-aebf-7cc141f93252-ca-trust-extracted\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:06.101530 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.101389    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae6425d7-a4c4-4e59-aebf-7cc141f93252-registry-certificates\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:06.101530 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:06.101488    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 01:41:06.101530 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:06.101505    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b57d7bb5d-zm786: secret "image-registry-tls" not found
Jul 31 01:41:06.101788 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:06.101568    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-registry-tls podName:ae6425d7-a4c4-4e59-aebf-7cc141f93252 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:06.601546775 +0000 UTC m=+227.181787749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-registry-tls") pod "image-registry-6b57d7bb5d-zm786" (UID: "ae6425d7-a4c4-4e59-aebf-7cc141f93252") : secret "image-registry-tls" not found
Jul 31 01:41:06.101878 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:06.101830    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 31 01:41:06.101878 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:06.101876    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03e216bb-cb12-4fb4-a9dd-a693daa5f657-metrics-certs podName:03e216bb-cb12-4fb4-a9dd-a693daa5f657 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:06.601861418 +0000 UTC m=+227.182102392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03e216bb-cb12-4fb4-a9dd-a693daa5f657-metrics-certs") pod "router-default-78d646dddb-6hkw9" (UID: "03e216bb-cb12-4fb4-a9dd-a693daa5f657") : secret "router-metrics-certs-default" not found
Jul 31 01:41:06.102121 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:06.102102    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/03e216bb-cb12-4fb4-a9dd-a693daa5f657-service-ca-bundle podName:03e216bb-cb12-4fb4-a9dd-a693daa5f657 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:06.602085497 +0000 UTC m=+227.182326508 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/03e216bb-cb12-4fb4-a9dd-a693daa5f657-service-ca-bundle") pod "router-default-78d646dddb-6hkw9" (UID: "03e216bb-cb12-4fb4-a9dd-a693daa5f657") : configmap references non-existent config key: service-ca.crt
Jul 31 01:41:06.102452 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.102348    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae6425d7-a4c4-4e59-aebf-7cc141f93252-trusted-ca\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:06.105519 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.105446    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae6425d7-a4c4-4e59-aebf-7cc141f93252-image-registry-private-configuration\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:06.105632 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.105557    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/03e216bb-cb12-4fb4-a9dd-a693daa5f657-stats-auth\") pod \"router-default-78d646dddb-6hkw9\" (UID: \"03e216bb-cb12-4fb4-a9dd-a693daa5f657\") " pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:06.105917 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.105879    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae6425d7-a4c4-4e59-aebf-7cc141f93252-installation-pull-secrets\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:06.106534 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.106512    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/03e216bb-cb12-4fb4-a9dd-a693daa5f657-default-certificate\") pod \"router-default-78d646dddb-6hkw9\" (UID: \"03e216bb-cb12-4fb4-a9dd-a693daa5f657\") " pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:06.110213 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.110182    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs7dt\" (UniqueName: \"kubernetes.io/projected/03e216bb-cb12-4fb4-a9dd-a693daa5f657-kube-api-access-qs7dt\") pod \"router-default-78d646dddb-6hkw9\" (UID: \"03e216bb-cb12-4fb4-a9dd-a693daa5f657\") " pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:06.110499 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.110476    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-bound-sa-token\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:06.110685 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.110665    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8lgs\" (UniqueName: \"kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-kube-api-access-m8lgs\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:06.145322 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.145220    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-jrpst"
Jul 31 01:41:06.179825 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.179673    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-gklgq"]
Jul 31 01:41:06.182518 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:41:06.182493    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f90bf7d_b0d8_4c7d_97bf_472bf70ebf22.slice/crio-d4302bbe27f0452fecffbc651aae4a03862c7fe7637c2cb0faed092d5bd5d30a WatchSource:0}: Error finding container d4302bbe27f0452fecffbc651aae4a03862c7fe7637c2cb0faed092d5bd5d30a: Status 404 returned error can't find the container with id d4302bbe27f0452fecffbc651aae4a03862c7fe7637c2cb0faed092d5bd5d30a
Jul 31 01:41:06.273749 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.273665    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-jrpst"]
Jul 31 01:41:06.277237 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:41:06.277210    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e80ef61_7c6a_48d3_9406_7d1e7435fa6a.slice/crio-fa10623f3e409aa0f6a07c50829a9d4a20171b10b0bf8592d905731172250fcc WatchSource:0}: Error finding container fa10623f3e409aa0f6a07c50829a9d4a20171b10b0bf8592d905731172250fcc: Status 404 returned error can't find the container with id fa10623f3e409aa0f6a07c50829a9d4a20171b10b0bf8592d905731172250fcc
Jul 31 01:41:06.504616 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.504585    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-jfbvr\" (UID: \"5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jfbvr"
Jul 31 01:41:06.504770 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:06.504693    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 31 01:41:06.504770 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:06.504745    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb-samples-operator-tls podName:5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb nodeName:}" failed. No retries permitted until 2026-07-31 01:41:07.504732373 +0000 UTC m=+228.084973347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-jfbvr" (UID: "5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb") : secret "samples-operator-tls" not found
Jul 31 01:41:06.605779 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.605748    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e216bb-cb12-4fb4-a9dd-a693daa5f657-service-ca-bundle\") pod \"router-default-78d646dddb-6hkw9\" (UID: \"03e216bb-cb12-4fb4-a9dd-a693daa5f657\") " pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:06.605955 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.605808    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-registry-tls\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:06.605955 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.605834    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03e216bb-cb12-4fb4-a9dd-a693daa5f657-metrics-certs\") pod \"router-default-78d646dddb-6hkw9\" (UID: \"03e216bb-cb12-4fb4-a9dd-a693daa5f657\") " pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:06.606041 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:06.605960    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 31 01:41:06.606041 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:06.605978    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 01:41:06.606041 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:06.605961    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/03e216bb-cb12-4fb4-a9dd-a693daa5f657-service-ca-bundle podName:03e216bb-cb12-4fb4-a9dd-a693daa5f657 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:07.605938918 +0000 UTC m=+228.186179914 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/03e216bb-cb12-4fb4-a9dd-a693daa5f657-service-ca-bundle") pod "router-default-78d646dddb-6hkw9" (UID: "03e216bb-cb12-4fb4-a9dd-a693daa5f657") : configmap references non-existent config key: service-ca.crt
Jul 31 01:41:06.606041 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:06.605998    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b57d7bb5d-zm786: secret "image-registry-tls" not found
Jul 31 01:41:06.606041 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:06.606010    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03e216bb-cb12-4fb4-a9dd-a693daa5f657-metrics-certs podName:03e216bb-cb12-4fb4-a9dd-a693daa5f657 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:07.605998215 +0000 UTC m=+228.186239188 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03e216bb-cb12-4fb4-a9dd-a693daa5f657-metrics-certs") pod "router-default-78d646dddb-6hkw9" (UID: "03e216bb-cb12-4fb4-a9dd-a693daa5f657") : secret "router-metrics-certs-default" not found
Jul 31 01:41:06.606041 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:06.606032    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-registry-tls podName:ae6425d7-a4c4-4e59-aebf-7cc141f93252 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:07.606021642 +0000 UTC m=+228.186262614 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-registry-tls") pod "image-registry-6b57d7bb5d-zm786" (UID: "ae6425d7-a4c4-4e59-aebf-7cc141f93252") : secret "image-registry-tls" not found
Jul 31 01:41:06.703849 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.703813    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-jrpst" event={"ID":"1e80ef61-7c6a-48d3-9406-7d1e7435fa6a","Type":"ContainerStarted","Data":"fa10623f3e409aa0f6a07c50829a9d4a20171b10b0bf8592d905731172250fcc"}
Jul 31 01:41:06.705013 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:06.704981    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-gklgq" event={"ID":"7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22","Type":"ContainerStarted","Data":"d4302bbe27f0452fecffbc651aae4a03862c7fe7637c2cb0faed092d5bd5d30a"}
Jul 31 01:41:07.513066 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:07.513029    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-jfbvr\" (UID: \"5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jfbvr"
Jul 31 01:41:07.513437 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:07.513184    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 31 01:41:07.513437 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:07.513244    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb-samples-operator-tls podName:5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb nodeName:}" failed. No retries permitted until 2026-07-31 01:41:09.513229827 +0000 UTC m=+230.093470800 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-jfbvr" (UID: "5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb") : secret "samples-operator-tls" not found
Jul 31 01:41:07.614082 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:07.614048    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-registry-tls\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:07.614082 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:07.614090    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03e216bb-cb12-4fb4-a9dd-a693daa5f657-metrics-certs\") pod \"router-default-78d646dddb-6hkw9\" (UID: \"03e216bb-cb12-4fb4-a9dd-a693daa5f657\") " pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:07.614295 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:07.614136    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e216bb-cb12-4fb4-a9dd-a693daa5f657-service-ca-bundle\") pod \"router-default-78d646dddb-6hkw9\" (UID: \"03e216bb-cb12-4fb4-a9dd-a693daa5f657\") " pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:07.614295 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:07.614198    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 01:41:07.614295 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:07.614219    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b57d7bb5d-zm786: secret "image-registry-tls" not found
Jul 31 01:41:07.614295 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:07.614226    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/03e216bb-cb12-4fb4-a9dd-a693daa5f657-service-ca-bundle podName:03e216bb-cb12-4fb4-a9dd-a693daa5f657 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:09.614214092 +0000 UTC m=+230.194455066 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/03e216bb-cb12-4fb4-a9dd-a693daa5f657-service-ca-bundle") pod "router-default-78d646dddb-6hkw9" (UID: "03e216bb-cb12-4fb4-a9dd-a693daa5f657") : configmap references non-existent config key: service-ca.crt
Jul 31 01:41:07.614295 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:07.614234    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 31 01:41:07.614295 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:07.614261    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-registry-tls podName:ae6425d7-a4c4-4e59-aebf-7cc141f93252 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:09.614247994 +0000 UTC m=+230.194488968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-registry-tls") pod "image-registry-6b57d7bb5d-zm786" (UID: "ae6425d7-a4c4-4e59-aebf-7cc141f93252") : secret "image-registry-tls" not found
Jul 31 01:41:07.614295 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:07.614287    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03e216bb-cb12-4fb4-a9dd-a693daa5f657-metrics-certs podName:03e216bb-cb12-4fb4-a9dd-a693daa5f657 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:09.614272684 +0000 UTC m=+230.194513660 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03e216bb-cb12-4fb4-a9dd-a693daa5f657-metrics-certs") pod "router-default-78d646dddb-6hkw9" (UID: "03e216bb-cb12-4fb4-a9dd-a693daa5f657") : secret "router-metrics-certs-default" not found
Jul 31 01:41:07.709465 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:07.709378    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-jrpst" event={"ID":"1e80ef61-7c6a-48d3-9406-7d1e7435fa6a","Type":"ContainerStarted","Data":"358fd9f3ae620547de1fe38e53f5896e02d012589d2f66117e61902babc49af7"}
Jul 31 01:41:07.724852 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:07.724800    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-jrpst" podStartSLOduration=1.617357137 podStartE2EDuration="2.724780708s" totalImagesPullingTime="1.107423571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:41:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:41:07.724004346 +0000 UTC m=+228.304245342" watchObservedRunningTime="2026-07-31 01:41:07.724780708 +0000 UTC m=+228.305021707"
Jul 31 01:41:08.714439 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:08.714402    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-gklgq" event={"ID":"7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22","Type":"ContainerStarted","Data":"091f06dd8ccdbabac2d8aadc91c6bfe992e7177a8ca1028270996ba0ced97c15"}
Jul 31 01:41:08.731120 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:08.731077    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-77696685b-gklgq" podStartSLOduration=1.795339727 podStartE2EDuration="3.731062428s" totalImagesPullingTime="1.935722701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:41:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:41:08.730041132 +0000 UTC m=+229.310282128" watchObservedRunningTime="2026-07-31 01:41:08.731062428 +0000 UTC m=+229.311303457"
Jul 31 01:41:09.063173 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:09.063087    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tqt22"]
Jul 31 01:41:09.066187 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:09.066166    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tqt22"
Jul 31 01:41:09.068672 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:09.068641    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 31 01:41:09.068784 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:09.068687    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vl56s\""
Jul 31 01:41:09.068784 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:09.068698    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 31 01:41:09.075049 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:09.075022    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tqt22"]
Jul 31 01:41:09.230865 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:09.230833    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d67508f-6254-4125-a86a-74d85ac5e22c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tqt22\" (UID: \"7d67508f-6254-4125-a86a-74d85ac5e22c\") " pod="openshift-insights/insights-runtime-extractor-tqt22"
Jul 31 01:41:09.230865 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:09.230869    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d67508f-6254-4125-a86a-74d85ac5e22c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tqt22\" (UID: \"7d67508f-6254-4125-a86a-74d85ac5e22c\") " pod="openshift-insights/insights-runtime-extractor-tqt22"
Jul 31 01:41:09.231190 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:09.230912    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz2l2\" (UniqueName: \"kubernetes.io/projected/7d67508f-6254-4125-a86a-74d85ac5e22c-kube-api-access-nz2l2\") pod \"insights-runtime-extractor-tqt22\" (UID: \"7d67508f-6254-4125-a86a-74d85ac5e22c\") " pod="openshift-insights/insights-runtime-extractor-tqt22"
Jul 31 01:41:09.231190 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:09.231069    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d67508f-6254-4125-a86a-74d85ac5e22c-data-volume\") pod \"insights-runtime-extractor-tqt22\" (UID: \"7d67508f-6254-4125-a86a-74d85ac5e22c\") " pod="openshift-insights/insights-runtime-extractor-tqt22"
Jul 31 01:41:09.231190 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:09.231159    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d67508f-6254-4125-a86a-74d85ac5e22c-crio-socket\") pod \"insights-runtime-extractor-tqt22\" (UID: \"7d67508f-6254-4125-a86a-74d85ac5e22c\") " pod="openshift-insights/insights-runtime-extractor-tqt22"
Jul 31 01:41:09.331996 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:09.331889    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d67508f-6254-4125-a86a-74d85ac5e22c-crio-socket\") pod \"insights-runtime-extractor-tqt22\" (UID: \"7d67508f-6254-4125-a86a-74d85ac5e22c\") " pod="openshift-insights/insights-runtime-extractor-tqt22"
Jul 31 01:41:09.331996 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:09.331982    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d67508f-6254-4125-a86a-74d85ac5e22c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tqt22\" (UID: \"7d67508f-6254-4125-a86a-74d85ac5e22c\") " pod="openshift-insights/insights-runtime-extractor-tqt22"
Jul 31 01:41:09.331996 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:09.332008    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d67508f-6254-4125-a86a-74d85ac5e22c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tqt22\" (UID: \"7d67508f-6254-4125-a86a-74d85ac5e22c\") " pod="openshift-insights/insights-runtime-extractor-tqt22"
Jul 31 01:41:09.332206 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:09.332031    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz2l2\" (UniqueName: \"kubernetes.io/projected/7d67508f-6254-4125-a86a-74d85ac5e22c-kube-api-access-nz2l2\") pod \"insights-runtime-extractor-tqt22\" (UID: \"7d67508f-6254-4125-a86a-74d85ac5e22c\") " pod="openshift-insights/insights-runtime-extractor-tqt22"
Jul 31 01:41:09.332206 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:09.332056    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d67508f-6254-4125-a86a-74d85ac5e22c-crio-socket\") pod \"insights-runtime-extractor-tqt22\" (UID: \"7d67508f-6254-4125-a86a-74d85ac5e22c\") " pod="openshift-insights/insights-runtime-extractor-tqt22"
Jul 31 01:41:09.332206 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:09.332063    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 01:41:09.332206 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:09.332139    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d67508f-6254-4125-a86a-74d85ac5e22c-kube-rbac-proxy-cm podName:7d67508f-6254-4125-a86a-74d85ac5e22c nodeName:}" failed. No retries permitted until 2026-07-31 01:41:09.832117617 +0000 UTC m=+230.412358597 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d67508f-6254-4125-a86a-74d85ac5e22c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tqt22" (UID: "7d67508f-6254-4125-a86a-74d85ac5e22c") : configmap "kube-rbac-proxy" not found
Jul 31 01:41:09.332206 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:09.332166    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 01:41:09.332206 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:09.332181    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d67508f-6254-4125-a86a-74d85ac5e22c-data-volume\") pod \"insights-runtime-extractor-tqt22\" (UID: \"7d67508f-6254-4125-a86a-74d85ac5e22c\") " pod="openshift-insights/insights-runtime-extractor-tqt22"
Jul 31 01:41:09.332449 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:09.332222    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d67508f-6254-4125-a86a-74d85ac5e22c-insights-runtime-extractor-tls podName:7d67508f-6254-4125-a86a-74d85ac5e22c nodeName:}" failed. No retries permitted until 2026-07-31 01:41:09.832206032 +0000 UTC m=+230.412447018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d67508f-6254-4125-a86a-74d85ac5e22c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tqt22" (UID: "7d67508f-6254-4125-a86a-74d85ac5e22c") : secret "insights-runtime-extractor-tls" not found
Jul 31 01:41:09.332499 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:09.332483    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d67508f-6254-4125-a86a-74d85ac5e22c-data-volume\") pod \"insights-runtime-extractor-tqt22\" (UID: \"7d67508f-6254-4125-a86a-74d85ac5e22c\") " pod="openshift-insights/insights-runtime-extractor-tqt22"
Jul 31 01:41:09.340422 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:09.340402    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz2l2\" (UniqueName: \"kubernetes.io/projected/7d67508f-6254-4125-a86a-74d85ac5e22c-kube-api-access-nz2l2\") pod \"insights-runtime-extractor-tqt22\" (UID: \"7d67508f-6254-4125-a86a-74d85ac5e22c\") " pod="openshift-insights/insights-runtime-extractor-tqt22"
Jul 31 01:41:09.533516 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:09.533463    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-jfbvr\" (UID: \"5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jfbvr"
Jul 31 01:41:09.533688 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:09.533616    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 31 01:41:09.533688 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:09.533676    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb-samples-operator-tls podName:5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb nodeName:}" failed. No retries permitted until 2026-07-31 01:41:13.53365975 +0000 UTC m=+234.113900737 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-jfbvr" (UID: "5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb") : secret "samples-operator-tls" not found
Jul 31 01:41:09.634266 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:09.634230    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e216bb-cb12-4fb4-a9dd-a693daa5f657-service-ca-bundle\") pod \"router-default-78d646dddb-6hkw9\" (UID: \"03e216bb-cb12-4fb4-a9dd-a693daa5f657\") " pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:09.634452 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:09.634290    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-registry-tls\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:09.634452 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:09.634321    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03e216bb-cb12-4fb4-a9dd-a693daa5f657-metrics-certs\") pod \"router-default-78d646dddb-6hkw9\" (UID: \"03e216bb-cb12-4fb4-a9dd-a693daa5f657\") " pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:09.634452 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:09.634397    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/03e216bb-cb12-4fb4-a9dd-a693daa5f657-service-ca-bundle podName:03e216bb-cb12-4fb4-a9dd-a693daa5f657 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:13.634377683 +0000 UTC m=+234.214618659 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/03e216bb-cb12-4fb4-a9dd-a693daa5f657-service-ca-bundle") pod "router-default-78d646dddb-6hkw9" (UID: "03e216bb-cb12-4fb4-a9dd-a693daa5f657") : configmap references non-existent config key: service-ca.crt
Jul 31 01:41:09.634452 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:09.634410    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 31 01:41:09.634452 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:09.634441    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 01:41:09.634452 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:09.634455    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b57d7bb5d-zm786: secret "image-registry-tls" not found
Jul 31 01:41:09.634667 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:09.634467    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03e216bb-cb12-4fb4-a9dd-a693daa5f657-metrics-certs podName:03e216bb-cb12-4fb4-a9dd-a693daa5f657 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:13.634450508 +0000 UTC m=+234.214691480 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03e216bb-cb12-4fb4-a9dd-a693daa5f657-metrics-certs") pod "router-default-78d646dddb-6hkw9" (UID: "03e216bb-cb12-4fb4-a9dd-a693daa5f657") : secret "router-metrics-certs-default" not found
Jul 31 01:41:09.634667 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:09.634489    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-registry-tls podName:ae6425d7-a4c4-4e59-aebf-7cc141f93252 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:13.634477683 +0000 UTC m=+234.214718670 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-registry-tls") pod "image-registry-6b57d7bb5d-zm786" (UID: "ae6425d7-a4c4-4e59-aebf-7cc141f93252") : secret "image-registry-tls" not found
Jul 31 01:41:09.836354 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:09.836315    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d67508f-6254-4125-a86a-74d85ac5e22c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tqt22\" (UID: \"7d67508f-6254-4125-a86a-74d85ac5e22c\") " pod="openshift-insights/insights-runtime-extractor-tqt22"
Jul 31 01:41:09.836354 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:09.836353    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d67508f-6254-4125-a86a-74d85ac5e22c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tqt22\" (UID: \"7d67508f-6254-4125-a86a-74d85ac5e22c\") " pod="openshift-insights/insights-runtime-extractor-tqt22"
Jul 31 01:41:09.836885 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:09.836450    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 01:41:09.836885 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:09.836491    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 01:41:09.836885 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:09.836529    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d67508f-6254-4125-a86a-74d85ac5e22c-kube-rbac-proxy-cm podName:7d67508f-6254-4125-a86a-74d85ac5e22c nodeName:}" failed. No retries permitted until 2026-07-31 01:41:10.836506465 +0000 UTC m=+231.416747469 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d67508f-6254-4125-a86a-74d85ac5e22c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tqt22" (UID: "7d67508f-6254-4125-a86a-74d85ac5e22c") : configmap "kube-rbac-proxy" not found
Jul 31 01:41:09.836885 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:09.836625    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d67508f-6254-4125-a86a-74d85ac5e22c-insights-runtime-extractor-tls podName:7d67508f-6254-4125-a86a-74d85ac5e22c nodeName:}" failed. No retries permitted until 2026-07-31 01:41:10.836594878 +0000 UTC m=+231.416835855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d67508f-6254-4125-a86a-74d85ac5e22c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tqt22" (UID: "7d67508f-6254-4125-a86a-74d85ac5e22c") : secret "insights-runtime-extractor-tls" not found
Jul 31 01:41:10.845021 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:10.844981    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d67508f-6254-4125-a86a-74d85ac5e22c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tqt22\" (UID: \"7d67508f-6254-4125-a86a-74d85ac5e22c\") " pod="openshift-insights/insights-runtime-extractor-tqt22"
Jul 31 01:41:10.845021 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:10.845024    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d67508f-6254-4125-a86a-74d85ac5e22c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tqt22\" (UID: \"7d67508f-6254-4125-a86a-74d85ac5e22c\") " pod="openshift-insights/insights-runtime-extractor-tqt22"
Jul 31 01:41:10.845439 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:10.845100    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 01:41:10.845439 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:10.845117    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 01:41:10.845439 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:10.845169    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d67508f-6254-4125-a86a-74d85ac5e22c-insights-runtime-extractor-tls podName:7d67508f-6254-4125-a86a-74d85ac5e22c nodeName:}" failed. No retries permitted until 2026-07-31 01:41:12.845156193 +0000 UTC m=+233.425397169 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d67508f-6254-4125-a86a-74d85ac5e22c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tqt22" (UID: "7d67508f-6254-4125-a86a-74d85ac5e22c") : secret "insights-runtime-extractor-tls" not found
Jul 31 01:41:10.845439 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:10.845182    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d67508f-6254-4125-a86a-74d85ac5e22c-kube-rbac-proxy-cm podName:7d67508f-6254-4125-a86a-74d85ac5e22c nodeName:}" failed. No retries permitted until 2026-07-31 01:41:12.84517578 +0000 UTC m=+233.425416753 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d67508f-6254-4125-a86a-74d85ac5e22c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tqt22" (UID: "7d67508f-6254-4125-a86a-74d85ac5e22c") : configmap "kube-rbac-proxy" not found
Jul 31 01:41:11.013252 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:11.013217    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l4gcr_522b6666-22de-4d13-9794-07680e2375d6/dns-node-resolver/0.log"
Jul 31 01:41:11.812698 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:11.812670    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5vkv9_09fec214-2f3f-4166-8687-3c1c822794c3/node-ca/0.log"
Jul 31 01:41:12.612391 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:12.612360    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-djswh_275216a4-fea3-4c16-bb45-425da974aa47/serve-healthcheck-canary/0.log"
Jul 31 01:41:12.862783 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:12.862680    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d67508f-6254-4125-a86a-74d85ac5e22c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tqt22\" (UID: \"7d67508f-6254-4125-a86a-74d85ac5e22c\") " pod="openshift-insights/insights-runtime-extractor-tqt22"
Jul 31 01:41:12.862783 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:12.862734    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d67508f-6254-4125-a86a-74d85ac5e22c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tqt22\" (UID: \"7d67508f-6254-4125-a86a-74d85ac5e22c\") " pod="openshift-insights/insights-runtime-extractor-tqt22"
Jul 31 01:41:12.863014 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:12.862812    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 01:41:12.863014 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:12.862833    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 01:41:12.863014 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:12.862876    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d67508f-6254-4125-a86a-74d85ac5e22c-insights-runtime-extractor-tls podName:7d67508f-6254-4125-a86a-74d85ac5e22c nodeName:}" failed. No retries permitted until 2026-07-31 01:41:16.862862601 +0000 UTC m=+237.443103575 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d67508f-6254-4125-a86a-74d85ac5e22c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tqt22" (UID: "7d67508f-6254-4125-a86a-74d85ac5e22c") : secret "insights-runtime-extractor-tls" not found
Jul 31 01:41:12.863014 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:12.862888    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d67508f-6254-4125-a86a-74d85ac5e22c-kube-rbac-proxy-cm podName:7d67508f-6254-4125-a86a-74d85ac5e22c nodeName:}" failed. No retries permitted until 2026-07-31 01:41:16.862882233 +0000 UTC m=+237.443123207 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d67508f-6254-4125-a86a-74d85ac5e22c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tqt22" (UID: "7d67508f-6254-4125-a86a-74d85ac5e22c") : configmap "kube-rbac-proxy" not found
Jul 31 01:41:13.569003 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:13.568962    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-jfbvr\" (UID: \"5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jfbvr"
Jul 31 01:41:13.569182 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:13.569123    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 31 01:41:13.569229 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:13.569182    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb-samples-operator-tls podName:5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb nodeName:}" failed. No retries permitted until 2026-07-31 01:41:21.569166898 +0000 UTC m=+242.149407883 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-jfbvr" (UID: "5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb") : secret "samples-operator-tls" not found
Jul 31 01:41:13.669668 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:13.669631    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e216bb-cb12-4fb4-a9dd-a693daa5f657-service-ca-bundle\") pod \"router-default-78d646dddb-6hkw9\" (UID: \"03e216bb-cb12-4fb4-a9dd-a693daa5f657\") " pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:13.670083 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:13.669689    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-registry-tls\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:13.670083 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:13.669723    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03e216bb-cb12-4fb4-a9dd-a693daa5f657-metrics-certs\") pod \"router-default-78d646dddb-6hkw9\" (UID: \"03e216bb-cb12-4fb4-a9dd-a693daa5f657\") " pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:13.670083 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:13.669815    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/03e216bb-cb12-4fb4-a9dd-a693daa5f657-service-ca-bundle podName:03e216bb-cb12-4fb4-a9dd-a693daa5f657 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:21.669797548 +0000 UTC m=+242.250038521 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/03e216bb-cb12-4fb4-a9dd-a693daa5f657-service-ca-bundle") pod "router-default-78d646dddb-6hkw9" (UID: "03e216bb-cb12-4fb4-a9dd-a693daa5f657") : configmap references non-existent config key: service-ca.crt
Jul 31 01:41:13.670083 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:13.669829    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 31 01:41:13.670083 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:13.669833    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 01:41:13.670083 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:13.669879    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03e216bb-cb12-4fb4-a9dd-a693daa5f657-metrics-certs podName:03e216bb-cb12-4fb4-a9dd-a693daa5f657 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:21.66986259 +0000 UTC m=+242.250103563 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03e216bb-cb12-4fb4-a9dd-a693daa5f657-metrics-certs") pod "router-default-78d646dddb-6hkw9" (UID: "03e216bb-cb12-4fb4-a9dd-a693daa5f657") : secret "router-metrics-certs-default" not found
Jul 31 01:41:13.670083 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:13.669888    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b57d7bb5d-zm786: secret "image-registry-tls" not found
Jul 31 01:41:13.670083 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:13.669960    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-registry-tls podName:ae6425d7-a4c4-4e59-aebf-7cc141f93252 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:21.669945468 +0000 UTC m=+242.250186441 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-registry-tls") pod "image-registry-6b57d7bb5d-zm786" (UID: "ae6425d7-a4c4-4e59-aebf-7cc141f93252") : secret "image-registry-tls" not found
Jul 31 01:41:16.897984 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:16.897948    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d67508f-6254-4125-a86a-74d85ac5e22c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tqt22\" (UID: \"7d67508f-6254-4125-a86a-74d85ac5e22c\") " pod="openshift-insights/insights-runtime-extractor-tqt22"
Jul 31 01:41:16.898423 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:16.897993    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d67508f-6254-4125-a86a-74d85ac5e22c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tqt22\" (UID: \"7d67508f-6254-4125-a86a-74d85ac5e22c\") " pod="openshift-insights/insights-runtime-extractor-tqt22"
Jul 31 01:41:16.898423 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:16.898091    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 01:41:16.898423 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:16.898168    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 01:41:16.898423 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:16.898176    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d67508f-6254-4125-a86a-74d85ac5e22c-kube-rbac-proxy-cm podName:7d67508f-6254-4125-a86a-74d85ac5e22c nodeName:}" failed. No retries permitted until 2026-07-31 01:41:24.89815454 +0000 UTC m=+245.478395517 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d67508f-6254-4125-a86a-74d85ac5e22c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tqt22" (UID: "7d67508f-6254-4125-a86a-74d85ac5e22c") : configmap "kube-rbac-proxy" not found
Jul 31 01:41:16.898423 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:16.898226    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d67508f-6254-4125-a86a-74d85ac5e22c-insights-runtime-extractor-tls podName:7d67508f-6254-4125-a86a-74d85ac5e22c nodeName:}" failed. No retries permitted until 2026-07-31 01:41:24.898214251 +0000 UTC m=+245.478455225 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d67508f-6254-4125-a86a-74d85ac5e22c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tqt22" (UID: "7d67508f-6254-4125-a86a-74d85ac5e22c") : secret "insights-runtime-extractor-tls" not found
Jul 31 01:41:21.643418 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:21.643373    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-jfbvr\" (UID: \"5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jfbvr"
Jul 31 01:41:21.645869 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:21.645844    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-jfbvr\" (UID: \"5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jfbvr"
Jul 31 01:41:21.663514 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:21.663487    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8hcnp\""
Jul 31 01:41:21.671614 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:21.671592    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jfbvr"
Jul 31 01:41:21.744270 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:21.744239    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-registry-tls\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:21.744431 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:21.744289    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03e216bb-cb12-4fb4-a9dd-a693daa5f657-metrics-certs\") pod \"router-default-78d646dddb-6hkw9\" (UID: \"03e216bb-cb12-4fb4-a9dd-a693daa5f657\") " pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:21.744431 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:21.744392    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e216bb-cb12-4fb4-a9dd-a693daa5f657-service-ca-bundle\") pod \"router-default-78d646dddb-6hkw9\" (UID: \"03e216bb-cb12-4fb4-a9dd-a693daa5f657\") " pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:21.744984 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:21.744960    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e216bb-cb12-4fb4-a9dd-a693daa5f657-service-ca-bundle\") pod \"router-default-78d646dddb-6hkw9\" (UID: \"03e216bb-cb12-4fb4-a9dd-a693daa5f657\") " pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:21.746606 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:21.746586    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03e216bb-cb12-4fb4-a9dd-a693daa5f657-metrics-certs\") pod \"router-default-78d646dddb-6hkw9\" (UID: \"03e216bb-cb12-4fb4-a9dd-a693daa5f657\") " pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:21.746719 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:21.746700    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-registry-tls\") pod \"image-registry-6b57d7bb5d-zm786\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") " pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:21.754594 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:21.754505    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-p7dl9\""
Jul 31 01:41:21.758780 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:21.758762    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6prlk\""
Jul 31 01:41:21.761582 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:21.761560    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:21.768576 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:21.767406    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:21.798566 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:21.798532    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jfbvr"]
Jul 31 01:41:21.901109 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:21.901027    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-78d646dddb-6hkw9"]
Jul 31 01:41:21.906982 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:41:21.906956    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e216bb_cb12_4fb4_a9dd_a693daa5f657.slice/crio-b73075695ac94e32a6df17329ddd6164f1ed88b45ade3c9b114ad0ab66e0cc4a WatchSource:0}: Error finding container b73075695ac94e32a6df17329ddd6164f1ed88b45ade3c9b114ad0ab66e0cc4a: Status 404 returned error can't find the container with id b73075695ac94e32a6df17329ddd6164f1ed88b45ade3c9b114ad0ab66e0cc4a
Jul 31 01:41:21.917999 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:21.917979    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b57d7bb5d-zm786"]
Jul 31 01:41:21.920321 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:41:21.920295    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae6425d7_a4c4_4e59_aebf_7cc141f93252.slice/crio-f0ce84e49cf52a83f27d86d05ea6b35daed6c08c998d2aba698856e9361f137f WatchSource:0}: Error finding container f0ce84e49cf52a83f27d86d05ea6b35daed6c08c998d2aba698856e9361f137f: Status 404 returned error can't find the container with id f0ce84e49cf52a83f27d86d05ea6b35daed6c08c998d2aba698856e9361f137f
Jul 31 01:41:22.756565 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:22.756522    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786" event={"ID":"ae6425d7-a4c4-4e59-aebf-7cc141f93252","Type":"ContainerStarted","Data":"3cefda558bc8cdd3c400e173c0278a3e447fdd1b85c693b07e2b94252a197ddc"}
Jul 31 01:41:22.757070 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:22.756618    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:22.757070 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:22.756641    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786" event={"ID":"ae6425d7-a4c4-4e59-aebf-7cc141f93252","Type":"ContainerStarted","Data":"f0ce84e49cf52a83f27d86d05ea6b35daed6c08c998d2aba698856e9361f137f"}
Jul 31 01:41:22.758418 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:22.758388    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-78d646dddb-6hkw9" event={"ID":"03e216bb-cb12-4fb4-a9dd-a693daa5f657","Type":"ContainerStarted","Data":"8342e018c4fe879e537b6b7600b256cc37e256ccee8f34366495cb2ef989a474"}
Jul 31 01:41:22.758519 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:22.758440    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-78d646dddb-6hkw9" event={"ID":"03e216bb-cb12-4fb4-a9dd-a693daa5f657","Type":"ContainerStarted","Data":"b73075695ac94e32a6df17329ddd6164f1ed88b45ade3c9b114ad0ab66e0cc4a"}
Jul 31 01:41:22.759641 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:22.759619    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jfbvr" event={"ID":"5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb","Type":"ContainerStarted","Data":"e4f1e915f69e8674547c0ac0e194a1d5d66fb8376289f7c46f5ec74c5ba3ec58"}
Jul 31 01:41:22.761816 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:22.761794    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:22.764563 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:22.764545    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:22.777955 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:22.777883    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786" podStartSLOduration=17.777868557 podStartE2EDuration="17.777868557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:41:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:41:22.776691313 +0000 UTC m=+243.356932311" watchObservedRunningTime="2026-07-31 01:41:22.777868557 +0000 UTC m=+243.358109530"
Jul 31 01:41:22.796252 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:22.796210    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-78d646dddb-6hkw9" podStartSLOduration=17.796194521 podStartE2EDuration="17.796194521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:41:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:41:22.795528333 +0000 UTC m=+243.375769330" watchObservedRunningTime="2026-07-31 01:41:22.796194521 +0000 UTC m=+243.376435517"
Jul 31 01:41:23.764527 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:23.764441    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jfbvr" event={"ID":"5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb","Type":"ContainerStarted","Data":"1528e227f091cff7dfa258969264f46f8961f13567c13086e75ce59d14f48840"}
Jul 31 01:41:23.764527 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:23.764506    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jfbvr" event={"ID":"5dfe1dc0-c9b4-45ce-be13-cd9aaa47cceb","Type":"ContainerStarted","Data":"ccfaae565b3408c010e1d9953ee3d5ef89efbb9902d568b1a2f5a247704275dc"}
Jul 31 01:41:23.764948 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:23.764809    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:23.765996 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:23.765976    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-78d646dddb-6hkw9"
Jul 31 01:41:23.781678 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:23.781629    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-jfbvr" podStartSLOduration=17.117239375 podStartE2EDuration="18.781609427s" totalImagesPullingTime="1.664370052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:41:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:41:23.780354788 +0000 UTC m=+244.360595786" watchObservedRunningTime="2026-07-31 01:41:23.781609427 +0000 UTC m=+244.361850427"
Jul 31 01:41:24.972990 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:24.972951    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d67508f-6254-4125-a86a-74d85ac5e22c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tqt22\" (UID: \"7d67508f-6254-4125-a86a-74d85ac5e22c\") " pod="openshift-insights/insights-runtime-extractor-tqt22"
Jul 31 01:41:24.972990 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:24.972990    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d67508f-6254-4125-a86a-74d85ac5e22c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tqt22\" (UID: \"7d67508f-6254-4125-a86a-74d85ac5e22c\") " pod="openshift-insights/insights-runtime-extractor-tqt22"
Jul 31 01:41:24.973406 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:24.973116    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 01:41:24.973406 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:24.973215    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d67508f-6254-4125-a86a-74d85ac5e22c-insights-runtime-extractor-tls podName:7d67508f-6254-4125-a86a-74d85ac5e22c nodeName:}" failed. No retries permitted until 2026-07-31 01:41:40.973202299 +0000 UTC m=+261.553443273 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d67508f-6254-4125-a86a-74d85ac5e22c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tqt22" (UID: "7d67508f-6254-4125-a86a-74d85ac5e22c") : secret "insights-runtime-extractor-tls" not found
Jul 31 01:41:24.973516 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:24.973493    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d67508f-6254-4125-a86a-74d85ac5e22c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tqt22\" (UID: \"7d67508f-6254-4125-a86a-74d85ac5e22c\") " pod="openshift-insights/insights-runtime-extractor-tqt22"
Jul 31 01:41:27.781237 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:27.781197    2571 generic.go:356] "Generic (PLEG): container finished" podID="9d0c771f-76cf-4d49-98b9-d79883722cdc" containerID="44152364aeee2eaf1199c7d1d644e7a8bc796bd9095c4e1931350318162df173" exitCode=255
Jul 31 01:41:27.781609 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:27.781251    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7f44cfd4-d4kcs" event={"ID":"9d0c771f-76cf-4d49-98b9-d79883722cdc","Type":"ContainerDied","Data":"44152364aeee2eaf1199c7d1d644e7a8bc796bd9095c4e1931350318162df173"}
Jul 31 01:41:27.786761 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:27.786744    2571 scope.go:117] "RemoveContainer" containerID="44152364aeee2eaf1199c7d1d644e7a8bc796bd9095c4e1931350318162df173"
Jul 31 01:41:28.785729 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:28.785683    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7f44cfd4-d4kcs" event={"ID":"9d0c771f-76cf-4d49-98b9-d79883722cdc","Type":"ContainerStarted","Data":"5bd587151852665149dbfd985cd5b72910ef8ee9f924f0f46e26cd63c647c48d"}
Jul 31 01:41:31.771334 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:31.771306    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b57d7bb5d-zm786"]
Jul 31 01:41:31.795982 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:31.795953    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5744646c59-dd2zb"]
Jul 31 01:41:31.799217 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:31.799192    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5744646c59-dd2zb"
Jul 31 01:41:31.811675 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:31.811648    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5744646c59-dd2zb"]
Jul 31 01:41:31.822651 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:31.822626    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs\") pod \"network-metrics-daemon-dbn98\" (UID: \"2eeb74ea-3868-467e-ac82-a476ddfaf787\") " pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:41:31.824961 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:31.824938    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2eeb74ea-3868-467e-ac82-a476ddfaf787-metrics-certs\") pod \"network-metrics-daemon-dbn98\" (UID: \"2eeb74ea-3868-467e-ac82-a476ddfaf787\") " pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:41:31.923039 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:31.923004    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ab0653aa-986c-458e-9c33-d98bbcb9b39d-image-registry-private-configuration\") pod \"image-registry-5744646c59-dd2zb\" (UID: \"ab0653aa-986c-458e-9c33-d98bbcb9b39d\") " pod="openshift-image-registry/image-registry-5744646c59-dd2zb"
Jul 31 01:41:31.923208 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:31.923049    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab0653aa-986c-458e-9c33-d98bbcb9b39d-bound-sa-token\") pod \"image-registry-5744646c59-dd2zb\" (UID: \"ab0653aa-986c-458e-9c33-d98bbcb9b39d\") " pod="openshift-image-registry/image-registry-5744646c59-dd2zb"
Jul 31 01:41:31.923208 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:31.923066    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab0653aa-986c-458e-9c33-d98bbcb9b39d-trusted-ca\") pod \"image-registry-5744646c59-dd2zb\" (UID: \"ab0653aa-986c-458e-9c33-d98bbcb9b39d\") " pod="openshift-image-registry/image-registry-5744646c59-dd2zb"
Jul 31 01:41:31.923208 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:31.923112    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pvms\" (UniqueName: \"kubernetes.io/projected/ab0653aa-986c-458e-9c33-d98bbcb9b39d-kube-api-access-5pvms\") pod \"image-registry-5744646c59-dd2zb\" (UID: \"ab0653aa-986c-458e-9c33-d98bbcb9b39d\") " pod="openshift-image-registry/image-registry-5744646c59-dd2zb"
Jul 31 01:41:31.923208 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:31.923150    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ab0653aa-986c-458e-9c33-d98bbcb9b39d-installation-pull-secrets\") pod \"image-registry-5744646c59-dd2zb\" (UID: \"ab0653aa-986c-458e-9c33-d98bbcb9b39d\") " pod="openshift-image-registry/image-registry-5744646c59-dd2zb"
Jul 31 01:41:31.923208 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:31.923204    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab0653aa-986c-458e-9c33-d98bbcb9b39d-registry-tls\") pod \"image-registry-5744646c59-dd2zb\" (UID: \"ab0653aa-986c-458e-9c33-d98bbcb9b39d\") " pod="openshift-image-registry/image-registry-5744646c59-dd2zb"
Jul 31 01:41:31.923387 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:31.923231    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ab0653aa-986c-458e-9c33-d98bbcb9b39d-registry-certificates\") pod \"image-registry-5744646c59-dd2zb\" (UID: \"ab0653aa-986c-458e-9c33-d98bbcb9b39d\") " pod="openshift-image-registry/image-registry-5744646c59-dd2zb"
Jul 31 01:41:31.923387 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:31.923273    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ab0653aa-986c-458e-9c33-d98bbcb9b39d-ca-trust-extracted\") pod \"image-registry-5744646c59-dd2zb\" (UID: \"ab0653aa-986c-458e-9c33-d98bbcb9b39d\") " pod="openshift-image-registry/image-registry-5744646c59-dd2zb"
Jul 31 01:41:31.989620 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:31.989591    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zn99h\""
Jul 31 01:41:31.997905 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:31.997859    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbn98"
Jul 31 01:41:32.024340 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:32.024273    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ab0653aa-986c-458e-9c33-d98bbcb9b39d-installation-pull-secrets\") pod \"image-registry-5744646c59-dd2zb\" (UID: \"ab0653aa-986c-458e-9c33-d98bbcb9b39d\") " pod="openshift-image-registry/image-registry-5744646c59-dd2zb"
Jul 31 01:41:32.024340 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:32.024322    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab0653aa-986c-458e-9c33-d98bbcb9b39d-registry-tls\") pod \"image-registry-5744646c59-dd2zb\" (UID: \"ab0653aa-986c-458e-9c33-d98bbcb9b39d\") " pod="openshift-image-registry/image-registry-5744646c59-dd2zb"
Jul 31 01:41:32.024340 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:32.024340    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ab0653aa-986c-458e-9c33-d98bbcb9b39d-registry-certificates\") pod \"image-registry-5744646c59-dd2zb\" (UID: \"ab0653aa-986c-458e-9c33-d98bbcb9b39d\") " pod="openshift-image-registry/image-registry-5744646c59-dd2zb"
Jul 31 01:41:32.024533 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:32.024374    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ab0653aa-986c-458e-9c33-d98bbcb9b39d-ca-trust-extracted\") pod \"image-registry-5744646c59-dd2zb\" (UID: \"ab0653aa-986c-458e-9c33-d98bbcb9b39d\") " pod="openshift-image-registry/image-registry-5744646c59-dd2zb"
Jul 31 01:41:32.024533 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:32.024395    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ab0653aa-986c-458e-9c33-d98bbcb9b39d-image-registry-private-configuration\") pod \"image-registry-5744646c59-dd2zb\" (UID: \"ab0653aa-986c-458e-9c33-d98bbcb9b39d\") " pod="openshift-image-registry/image-registry-5744646c59-dd2zb"
Jul 31 01:41:32.024533 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:32.024422    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab0653aa-986c-458e-9c33-d98bbcb9b39d-bound-sa-token\") pod \"image-registry-5744646c59-dd2zb\" (UID: \"ab0653aa-986c-458e-9c33-d98bbcb9b39d\") " pod="openshift-image-registry/image-registry-5744646c59-dd2zb"
Jul 31 01:41:32.024533 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:32.024460    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab0653aa-986c-458e-9c33-d98bbcb9b39d-trusted-ca\") pod \"image-registry-5744646c59-dd2zb\" (UID: \"ab0653aa-986c-458e-9c33-d98bbcb9b39d\") " pod="openshift-image-registry/image-registry-5744646c59-dd2zb"
Jul 31 01:41:32.024533 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:32.024483    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pvms\" (UniqueName: \"kubernetes.io/projected/ab0653aa-986c-458e-9c33-d98bbcb9b39d-kube-api-access-5pvms\") pod \"image-registry-5744646c59-dd2zb\" (UID: \"ab0653aa-986c-458e-9c33-d98bbcb9b39d\") " pod="openshift-image-registry/image-registry-5744646c59-dd2zb"
Jul 31 01:41:32.025813 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:32.025360    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ab0653aa-986c-458e-9c33-d98bbcb9b39d-ca-trust-extracted\") pod \"image-registry-5744646c59-dd2zb\" (UID: \"ab0653aa-986c-458e-9c33-d98bbcb9b39d\") " pod="openshift-image-registry/image-registry-5744646c59-dd2zb"
Jul 31 01:41:32.025813 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:32.025730    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ab0653aa-986c-458e-9c33-d98bbcb9b39d-registry-certificates\") pod \"image-registry-5744646c59-dd2zb\" (UID: \"ab0653aa-986c-458e-9c33-d98bbcb9b39d\") " pod="openshift-image-registry/image-registry-5744646c59-dd2zb"
Jul 31 01:41:32.026098 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:32.026072    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab0653aa-986c-458e-9c33-d98bbcb9b39d-trusted-ca\") pod \"image-registry-5744646c59-dd2zb\" (UID: \"ab0653aa-986c-458e-9c33-d98bbcb9b39d\") " pod="openshift-image-registry/image-registry-5744646c59-dd2zb"
Jul 31 01:41:32.031465 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:32.028799    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab0653aa-986c-458e-9c33-d98bbcb9b39d-registry-tls\") pod \"image-registry-5744646c59-dd2zb\" (UID: \"ab0653aa-986c-458e-9c33-d98bbcb9b39d\") " pod="openshift-image-registry/image-registry-5744646c59-dd2zb"
Jul 31 01:41:32.031465 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:32.032097    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ab0653aa-986c-458e-9c33-d98bbcb9b39d-image-registry-private-configuration\") pod \"image-registry-5744646c59-dd2zb\" (UID: \"ab0653aa-986c-458e-9c33-d98bbcb9b39d\") " pod="openshift-image-registry/image-registry-5744646c59-dd2zb"
Jul 31 01:41:32.033327 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:32.033302    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ab0653aa-986c-458e-9c33-d98bbcb9b39d-installation-pull-secrets\") pod \"image-registry-5744646c59-dd2zb\" (UID: \"ab0653aa-986c-458e-9c33-d98bbcb9b39d\") " pod="openshift-image-registry/image-registry-5744646c59-dd2zb"
Jul 31 01:41:32.034948 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:32.034925    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab0653aa-986c-458e-9c33-d98bbcb9b39d-bound-sa-token\") pod \"image-registry-5744646c59-dd2zb\" (UID: \"ab0653aa-986c-458e-9c33-d98bbcb9b39d\") " pod="openshift-image-registry/image-registry-5744646c59-dd2zb"
Jul 31 01:41:32.035840 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:32.035817    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pvms\" (UniqueName: \"kubernetes.io/projected/ab0653aa-986c-458e-9c33-d98bbcb9b39d-kube-api-access-5pvms\") pod \"image-registry-5744646c59-dd2zb\" (UID: \"ab0653aa-986c-458e-9c33-d98bbcb9b39d\") " pod="openshift-image-registry/image-registry-5744646c59-dd2zb"
Jul 31 01:41:32.109950 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:32.109923    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5744646c59-dd2zb"
Jul 31 01:41:32.122457 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:32.122429    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dbn98"]
Jul 31 01:41:32.124966 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:41:32.124942    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eeb74ea_3868_467e_ac82_a476ddfaf787.slice/crio-d777db85b3d62053d6afeae93624d21833aabb58a52ad99623da0e3ca550f82e WatchSource:0}: Error finding container d777db85b3d62053d6afeae93624d21833aabb58a52ad99623da0e3ca550f82e: Status 404 returned error can't find the container with id d777db85b3d62053d6afeae93624d21833aabb58a52ad99623da0e3ca550f82e
Jul 31 01:41:32.236560 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:32.236525    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5744646c59-dd2zb"]
Jul 31 01:41:32.239106 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:41:32.239080    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab0653aa_986c_458e_9c33_d98bbcb9b39d.slice/crio-59cec07e930398316a84018e4ee57cd116fae821eac2fe9f0c2adc0681324d6c WatchSource:0}: Error finding container 59cec07e930398316a84018e4ee57cd116fae821eac2fe9f0c2adc0681324d6c: Status 404 returned error can't find the container with id 59cec07e930398316a84018e4ee57cd116fae821eac2fe9f0c2adc0681324d6c
Jul 31 01:41:32.799078 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:32.799042    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5744646c59-dd2zb" event={"ID":"ab0653aa-986c-458e-9c33-d98bbcb9b39d","Type":"ContainerStarted","Data":"54371aa41c53b1d340f3b830a80f4b4dc0af3c1a63ce724e960bef8a6f738c6d"}
Jul 31 01:41:32.799522 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:32.799098    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5744646c59-dd2zb"
Jul 31 01:41:32.799522 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:32.799118    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5744646c59-dd2zb" event={"ID":"ab0653aa-986c-458e-9c33-d98bbcb9b39d","Type":"ContainerStarted","Data":"59cec07e930398316a84018e4ee57cd116fae821eac2fe9f0c2adc0681324d6c"}
Jul 31 01:41:32.800270 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:32.800240    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dbn98" event={"ID":"2eeb74ea-3868-467e-ac82-a476ddfaf787","Type":"ContainerStarted","Data":"d777db85b3d62053d6afeae93624d21833aabb58a52ad99623da0e3ca550f82e"}
Jul 31 01:41:32.818628 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:32.818580    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5744646c59-dd2zb" podStartSLOduration=1.818563806 podStartE2EDuration="1.818563806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:41:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:41:32.817228529 +0000 UTC m=+253.397469528" watchObservedRunningTime="2026-07-31 01:41:32.818563806 +0000 UTC m=+253.398804802"
Jul 31 01:41:33.805649 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:33.805552    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dbn98" event={"ID":"2eeb74ea-3868-467e-ac82-a476ddfaf787","Type":"ContainerStarted","Data":"dfa7771cce342c49b054407100dd3fa8c3d9fd6a06a6eec2bb4a34d4610178bb"}
Jul 31 01:41:33.805649 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:33.805611    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dbn98" event={"ID":"2eeb74ea-3868-467e-ac82-a476ddfaf787","Type":"ContainerStarted","Data":"10fc0bc2ea171e23380181a1cbfb35cb77f671638ebfb12e21343102f8932752"}
Jul 31 01:41:33.821840 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:33.821791    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dbn98" podStartSLOduration=252.487337795 podStartE2EDuration="4m13.821776747s" totalImagesPullingTime="1.334438952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:37:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:41:33.820065433 +0000 UTC m=+254.400306425" watchObservedRunningTime="2026-07-31 01:41:33.821776747 +0000 UTC m=+254.402017764"
Jul 31 01:41:40.993622 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:40.993587    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d67508f-6254-4125-a86a-74d85ac5e22c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tqt22\" (UID: \"7d67508f-6254-4125-a86a-74d85ac5e22c\") " pod="openshift-insights/insights-runtime-extractor-tqt22"
Jul 31 01:41:40.995903 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:40.995875    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d67508f-6254-4125-a86a-74d85ac5e22c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tqt22\" (UID: \"7d67508f-6254-4125-a86a-74d85ac5e22c\") " pod="openshift-insights/insights-runtime-extractor-tqt22"
Jul 31 01:41:41.177644 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:41.177607    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vl56s\""
Jul 31 01:41:41.185723 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:41.185695    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tqt22"
Jul 31 01:41:41.326064 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:41.325865    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tqt22"]
Jul 31 01:41:41.328524 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:41:41.328489    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d67508f_6254_4125_a86a_74d85ac5e22c.slice/crio-a7c66dc5aa33512d5690d7765e90f57f9b15f69b5cc40859b986aecd9da7ca0e WatchSource:0}: Error finding container a7c66dc5aa33512d5690d7765e90f57f9b15f69b5cc40859b986aecd9da7ca0e: Status 404 returned error can't find the container with id a7c66dc5aa33512d5690d7765e90f57f9b15f69b5cc40859b986aecd9da7ca0e
Jul 31 01:41:41.776258 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:41.776221    2571 patch_prober.go:28] interesting pod/image-registry-6b57d7bb5d-zm786 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 31 01:41:41.776414 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:41.776273    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786" podUID="ae6425d7-a4c4-4e59-aebf-7cc141f93252" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 01:41:41.833149 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:41.833116    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tqt22" event={"ID":"7d67508f-6254-4125-a86a-74d85ac5e22c","Type":"ContainerStarted","Data":"4f661bf2ac13999ba232337577160dfd0a2a3a493816ff48f5ff5791d2bc2019"}
Jul 31 01:41:41.833310 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:41.833169    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tqt22" event={"ID":"7d67508f-6254-4125-a86a-74d85ac5e22c","Type":"ContainerStarted","Data":"a7c66dc5aa33512d5690d7765e90f57f9b15f69b5cc40859b986aecd9da7ca0e"}
Jul 31 01:41:42.838362 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:42.838333    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tqt22" event={"ID":"7d67508f-6254-4125-a86a-74d85ac5e22c","Type":"ContainerStarted","Data":"bd6d19c8eb7ac6ba0798a0b38bb9188c1f6ebf44497980de33fbcc31002a03e4"}
Jul 31 01:41:43.848515 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:43.848484    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tqt22" event={"ID":"7d67508f-6254-4125-a86a-74d85ac5e22c","Type":"ContainerStarted","Data":"76b8f4c98f05d5dab37760f01dcfb18821749a257a124d6f2a67c931770fac01"}
Jul 31 01:41:43.868592 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:43.868540    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tqt22" podStartSLOduration=32.774262113 podStartE2EDuration="34.868527204s" totalImagesPullingTime="2.094265091s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 01:41:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:41:43.868100689 +0000 UTC m=+264.448341683" watchObservedRunningTime="2026-07-31 01:41:43.868527204 +0000 UTC m=+264.448768199"
Jul 31 01:41:51.775690 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:51.775650    2571 patch_prober.go:28] interesting pod/image-registry-6b57d7bb5d-zm786 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 31 01:41:51.776069 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:51.775712    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786" podUID="ae6425d7-a4c4-4e59-aebf-7cc141f93252" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 01:41:52.114224 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:52.114193    2571 patch_prober.go:28] interesting pod/image-registry-5744646c59-dd2zb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 31 01:41:52.114379 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:52.114257    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5744646c59-dd2zb" podUID="ab0653aa-986c-458e-9c33-d98bbcb9b39d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 01:41:53.809983 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:53.809946    2571 patch_prober.go:28] interesting pod/image-registry-5744646c59-dd2zb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 31 01:41:53.810355 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:53.809994    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5744646c59-dd2zb" podUID="ab0653aa-986c-458e-9c33-d98bbcb9b39d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 01:41:56.748857 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.748824    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq"]
Jul 31 01:41:56.754515 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.754493    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq"
Jul 31 01:41:56.756853 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.756828    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9kqcl"]
Jul 31 01:41:56.758120 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.758101    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 31 01:41:56.758266 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.758233    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-d4kzl\""
Jul 31 01:41:56.758266 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.758235    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 31 01:41:56.758440 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.758267    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 31 01:41:56.758440 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.758239    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 31 01:41:56.758440 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.758257    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 31 01:41:56.758440 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.758213    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 31 01:41:56.760434 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.760416    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:56.763637 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.763616    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 31 01:41:56.763738 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.763720    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-94jhd\""
Jul 31 01:41:56.764089 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.764061    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 31 01:41:56.764189 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.764068    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 31 01:41:56.764608 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.764589    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq"]
Jul 31 01:41:56.790506 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.790477    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786" podUID="ae6425d7-a4c4-4e59-aebf-7cc141f93252" containerName="registry" containerID="cri-o://3cefda558bc8cdd3c400e173c0278a3e447fdd1b85c693b07e2b94252a197ddc" gracePeriod=30
Jul 31 01:41:56.919603 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.919555    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/97255a23-484f-40db-8480-d40cd155a620-root\") pod \"node-exporter-9kqcl\" (UID: \"97255a23-484f-40db-8480-d40cd155a620\") " pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:56.919743 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.919616    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a800110d-2f4c-42b0-a1e6-89c0b3a2140c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-rc4bq\" (UID: \"a800110d-2f4c-42b0-a1e6-89c0b3a2140c\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq"
Jul 31 01:41:56.919743 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.919645    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/97255a23-484f-40db-8480-d40cd155a620-node-exporter-tls\") pod \"node-exporter-9kqcl\" (UID: \"97255a23-484f-40db-8480-d40cd155a620\") " pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:56.919743 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.919679    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/97255a23-484f-40db-8480-d40cd155a620-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9kqcl\" (UID: \"97255a23-484f-40db-8480-d40cd155a620\") " pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:56.919743 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.919726    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/97255a23-484f-40db-8480-d40cd155a620-node-exporter-accelerators-collector-config\") pod \"node-exporter-9kqcl\" (UID: \"97255a23-484f-40db-8480-d40cd155a620\") " pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:56.919915 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.919756    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksm8h\" (UniqueName: \"kubernetes.io/projected/97255a23-484f-40db-8480-d40cd155a620-kube-api-access-ksm8h\") pod \"node-exporter-9kqcl\" (UID: \"97255a23-484f-40db-8480-d40cd155a620\") " pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:56.919915 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.919785    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97255a23-484f-40db-8480-d40cd155a620-metrics-client-ca\") pod \"node-exporter-9kqcl\" (UID: \"97255a23-484f-40db-8480-d40cd155a620\") " pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:56.919915 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.919822    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a800110d-2f4c-42b0-a1e6-89c0b3a2140c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-rc4bq\" (UID: \"a800110d-2f4c-42b0-a1e6-89c0b3a2140c\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq"
Jul 31 01:41:56.919915 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.919849    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9skp5\" (UniqueName: \"kubernetes.io/projected/a800110d-2f4c-42b0-a1e6-89c0b3a2140c-kube-api-access-9skp5\") pod \"kube-state-metrics-6bd9664c4-rc4bq\" (UID: \"a800110d-2f4c-42b0-a1e6-89c0b3a2140c\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq"
Jul 31 01:41:56.919915 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.919880    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/97255a23-484f-40db-8480-d40cd155a620-node-exporter-textfile\") pod \"node-exporter-9kqcl\" (UID: \"97255a23-484f-40db-8480-d40cd155a620\") " pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:56.920073 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.919943    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a800110d-2f4c-42b0-a1e6-89c0b3a2140c-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-rc4bq\" (UID: \"a800110d-2f4c-42b0-a1e6-89c0b3a2140c\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq"
Jul 31 01:41:56.920073 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.919991    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97255a23-484f-40db-8480-d40cd155a620-sys\") pod \"node-exporter-9kqcl\" (UID: \"97255a23-484f-40db-8480-d40cd155a620\") " pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:56.920073 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.920035    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a800110d-2f4c-42b0-a1e6-89c0b3a2140c-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-rc4bq\" (UID: \"a800110d-2f4c-42b0-a1e6-89c0b3a2140c\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq"
Jul 31 01:41:56.920073 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.920059    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a800110d-2f4c-42b0-a1e6-89c0b3a2140c-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-rc4bq\" (UID: \"a800110d-2f4c-42b0-a1e6-89c0b3a2140c\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq"
Jul 31 01:41:56.920253 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:56.920129    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/97255a23-484f-40db-8480-d40cd155a620-node-exporter-wtmp\") pod \"node-exporter-9kqcl\" (UID: \"97255a23-484f-40db-8480-d40cd155a620\") " pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:57.021705 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.021606    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a800110d-2f4c-42b0-a1e6-89c0b3a2140c-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-rc4bq\" (UID: \"a800110d-2f4c-42b0-a1e6-89c0b3a2140c\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq"
Jul 31 01:41:57.021705 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.021674    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97255a23-484f-40db-8480-d40cd155a620-sys\") pod \"node-exporter-9kqcl\" (UID: \"97255a23-484f-40db-8480-d40cd155a620\") " pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:57.022021 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.021729    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a800110d-2f4c-42b0-a1e6-89c0b3a2140c-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-rc4bq\" (UID: \"a800110d-2f4c-42b0-a1e6-89c0b3a2140c\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq"
Jul 31 01:41:57.022021 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.021756    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a800110d-2f4c-42b0-a1e6-89c0b3a2140c-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-rc4bq\" (UID: \"a800110d-2f4c-42b0-a1e6-89c0b3a2140c\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq"
Jul 31 01:41:57.022021 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.021786    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/97255a23-484f-40db-8480-d40cd155a620-node-exporter-wtmp\") pod \"node-exporter-9kqcl\" (UID: \"97255a23-484f-40db-8480-d40cd155a620\") " pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:57.022021 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.021819    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/97255a23-484f-40db-8480-d40cd155a620-root\") pod \"node-exporter-9kqcl\" (UID: \"97255a23-484f-40db-8480-d40cd155a620\") " pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:57.022021 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.021842    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a800110d-2f4c-42b0-a1e6-89c0b3a2140c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-rc4bq\" (UID: \"a800110d-2f4c-42b0-a1e6-89c0b3a2140c\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq"
Jul 31 01:41:57.022021 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.021863    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/97255a23-484f-40db-8480-d40cd155a620-node-exporter-tls\") pod \"node-exporter-9kqcl\" (UID: \"97255a23-484f-40db-8480-d40cd155a620\") " pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:57.022021 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:57.021929    2571 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 31 01:41:57.022021 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:57.022018    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a800110d-2f4c-42b0-a1e6-89c0b3a2140c-kube-state-metrics-tls podName:a800110d-2f4c-42b0-a1e6-89c0b3a2140c nodeName:}" failed. No retries permitted until 2026-07-31 01:41:57.521996064 +0000 UTC m=+278.102237051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a800110d-2f4c-42b0-a1e6-89c0b3a2140c-kube-state-metrics-tls") pod "kube-state-metrics-6bd9664c4-rc4bq" (UID: "a800110d-2f4c-42b0-a1e6-89c0b3a2140c") : secret "kube-state-metrics-tls" not found
Jul 31 01:41:57.022397 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.022075    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a800110d-2f4c-42b0-a1e6-89c0b3a2140c-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-rc4bq\" (UID: \"a800110d-2f4c-42b0-a1e6-89c0b3a2140c\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq"
Jul 31 01:41:57.022397 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.021889    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/97255a23-484f-40db-8480-d40cd155a620-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9kqcl\" (UID: \"97255a23-484f-40db-8480-d40cd155a620\") " pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:57.022397 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.022161    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/97255a23-484f-40db-8480-d40cd155a620-node-exporter-accelerators-collector-config\") pod \"node-exporter-9kqcl\" (UID: \"97255a23-484f-40db-8480-d40cd155a620\") " pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:57.022397 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.022193    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksm8h\" (UniqueName: \"kubernetes.io/projected/97255a23-484f-40db-8480-d40cd155a620-kube-api-access-ksm8h\") pod \"node-exporter-9kqcl\" (UID: \"97255a23-484f-40db-8480-d40cd155a620\") " pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:57.022397 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.022226    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97255a23-484f-40db-8480-d40cd155a620-metrics-client-ca\") pod \"node-exporter-9kqcl\" (UID: \"97255a23-484f-40db-8480-d40cd155a620\") " pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:57.022397 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.022261    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a800110d-2f4c-42b0-a1e6-89c0b3a2140c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-rc4bq\" (UID: \"a800110d-2f4c-42b0-a1e6-89c0b3a2140c\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq"
Jul 31 01:41:57.022397 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.022285    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9skp5\" (UniqueName: \"kubernetes.io/projected/a800110d-2f4c-42b0-a1e6-89c0b3a2140c-kube-api-access-9skp5\") pod \"kube-state-metrics-6bd9664c4-rc4bq\" (UID: \"a800110d-2f4c-42b0-a1e6-89c0b3a2140c\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq"
Jul 31 01:41:57.022397 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.022322    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/97255a23-484f-40db-8480-d40cd155a620-node-exporter-textfile\") pod \"node-exporter-9kqcl\" (UID: \"97255a23-484f-40db-8480-d40cd155a620\") " pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:57.022781 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.022444    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97255a23-484f-40db-8480-d40cd155a620-sys\") pod \"node-exporter-9kqcl\" (UID: \"97255a23-484f-40db-8480-d40cd155a620\") " pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:57.022781 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.022468    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/97255a23-484f-40db-8480-d40cd155a620-root\") pod \"node-exporter-9kqcl\" (UID: \"97255a23-484f-40db-8480-d40cd155a620\") " pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:57.022781 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.022602    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/97255a23-484f-40db-8480-d40cd155a620-node-exporter-wtmp\") pod \"node-exporter-9kqcl\" (UID: \"97255a23-484f-40db-8480-d40cd155a620\") " pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:57.022781 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.022622    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/97255a23-484f-40db-8480-d40cd155a620-node-exporter-textfile\") pod \"node-exporter-9kqcl\" (UID: \"97255a23-484f-40db-8480-d40cd155a620\") " pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:57.023105 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:57.023082    2571 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 31 01:41:57.023190 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:57.023163    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97255a23-484f-40db-8480-d40cd155a620-node-exporter-tls podName:97255a23-484f-40db-8480-d40cd155a620 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:57.52314457 +0000 UTC m=+278.103385552 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/97255a23-484f-40db-8480-d40cd155a620-node-exporter-tls") pod "node-exporter-9kqcl" (UID: "97255a23-484f-40db-8480-d40cd155a620") : secret "node-exporter-tls" not found
Jul 31 01:41:57.023255 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.023203    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a800110d-2f4c-42b0-a1e6-89c0b3a2140c-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-rc4bq\" (UID: \"a800110d-2f4c-42b0-a1e6-89c0b3a2140c\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq"
Jul 31 01:41:57.023255 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.023242    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/97255a23-484f-40db-8480-d40cd155a620-node-exporter-accelerators-collector-config\") pod \"node-exporter-9kqcl\" (UID: \"97255a23-484f-40db-8480-d40cd155a620\") " pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:57.023384 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.023361    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97255a23-484f-40db-8480-d40cd155a620-metrics-client-ca\") pod \"node-exporter-9kqcl\" (UID: \"97255a23-484f-40db-8480-d40cd155a620\") " pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:57.023644 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.023627    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a800110d-2f4c-42b0-a1e6-89c0b3a2140c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-rc4bq\" (UID: \"a800110d-2f4c-42b0-a1e6-89c0b3a2140c\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq"
Jul 31 01:41:57.024550 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.024535    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/97255a23-484f-40db-8480-d40cd155a620-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9kqcl\" (UID: \"97255a23-484f-40db-8480-d40cd155a620\") " pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:57.025200 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.025168    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a800110d-2f4c-42b0-a1e6-89c0b3a2140c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-rc4bq\" (UID: \"a800110d-2f4c-42b0-a1e6-89c0b3a2140c\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq"
Jul 31 01:41:57.032042 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.032022    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksm8h\" (UniqueName: \"kubernetes.io/projected/97255a23-484f-40db-8480-d40cd155a620-kube-api-access-ksm8h\") pod \"node-exporter-9kqcl\" (UID: \"97255a23-484f-40db-8480-d40cd155a620\") " pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:57.032867 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.032850    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9skp5\" (UniqueName: \"kubernetes.io/projected/a800110d-2f4c-42b0-a1e6-89c0b3a2140c-kube-api-access-9skp5\") pod \"kube-state-metrics-6bd9664c4-rc4bq\" (UID: \"a800110d-2f4c-42b0-a1e6-89c0b3a2140c\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq"
Jul 31 01:41:57.047114 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.047096    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:57.223544 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.223519    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae6425d7-a4c4-4e59-aebf-7cc141f93252-ca-trust-extracted\") pod \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") "
Jul 31 01:41:57.223708 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.223556    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae6425d7-a4c4-4e59-aebf-7cc141f93252-image-registry-private-configuration\") pod \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") "
Jul 31 01:41:57.223708 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.223578    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae6425d7-a4c4-4e59-aebf-7cc141f93252-registry-certificates\") pod \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") "
Jul 31 01:41:57.223708 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.223607    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae6425d7-a4c4-4e59-aebf-7cc141f93252-trusted-ca\") pod \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") "
Jul 31 01:41:57.223708 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.223653    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8lgs\" (UniqueName: \"kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-kube-api-access-m8lgs\") pod \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") "
Jul 31 01:41:57.223708 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.223672    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-bound-sa-token\") pod \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") "
Jul 31 01:41:57.223708 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.223706    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-registry-tls\") pod \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") "
Jul 31 01:41:57.224015 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.223750    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae6425d7-a4c4-4e59-aebf-7cc141f93252-installation-pull-secrets\") pod \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\" (UID: \"ae6425d7-a4c4-4e59-aebf-7cc141f93252\") "
Jul 31 01:41:57.224071 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.224041    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae6425d7-a4c4-4e59-aebf-7cc141f93252-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ae6425d7-a4c4-4e59-aebf-7cc141f93252" (UID: "ae6425d7-a4c4-4e59-aebf-7cc141f93252"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:41:57.224354 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.224317    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae6425d7-a4c4-4e59-aebf-7cc141f93252-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ae6425d7-a4c4-4e59-aebf-7cc141f93252" (UID: "ae6425d7-a4c4-4e59-aebf-7cc141f93252"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:41:57.225969 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.225923    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ae6425d7-a4c4-4e59-aebf-7cc141f93252" (UID: "ae6425d7-a4c4-4e59-aebf-7cc141f93252"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:41:57.226124 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.226087    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ae6425d7-a4c4-4e59-aebf-7cc141f93252" (UID: "ae6425d7-a4c4-4e59-aebf-7cc141f93252"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:41:57.226205 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.226142    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-kube-api-access-m8lgs" (OuterVolumeSpecName: "kube-api-access-m8lgs") pod "ae6425d7-a4c4-4e59-aebf-7cc141f93252" (UID: "ae6425d7-a4c4-4e59-aebf-7cc141f93252"). InnerVolumeSpecName "kube-api-access-m8lgs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:41:57.226205 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.226169    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae6425d7-a4c4-4e59-aebf-7cc141f93252-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ae6425d7-a4c4-4e59-aebf-7cc141f93252" (UID: "ae6425d7-a4c4-4e59-aebf-7cc141f93252"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 01:41:57.226205 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.226181    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae6425d7-a4c4-4e59-aebf-7cc141f93252-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ae6425d7-a4c4-4e59-aebf-7cc141f93252" (UID: "ae6425d7-a4c4-4e59-aebf-7cc141f93252"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 01:41:57.235150 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.235125    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae6425d7-a4c4-4e59-aebf-7cc141f93252-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ae6425d7-a4c4-4e59-aebf-7cc141f93252" (UID: "ae6425d7-a4c4-4e59-aebf-7cc141f93252"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:41:57.324486 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.324412    2571 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae6425d7-a4c4-4e59-aebf-7cc141f93252-ca-trust-extracted\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:41:57.324486 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.324439    2571 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae6425d7-a4c4-4e59-aebf-7cc141f93252-image-registry-private-configuration\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:41:57.324486 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.324448    2571 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae6425d7-a4c4-4e59-aebf-7cc141f93252-registry-certificates\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:41:57.324486 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.324458    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae6425d7-a4c4-4e59-aebf-7cc141f93252-trusted-ca\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:41:57.324486 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.324467    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8lgs\" (UniqueName: \"kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-kube-api-access-m8lgs\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:41:57.324486 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.324475    2571 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-bound-sa-token\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:41:57.324486 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.324485    2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae6425d7-a4c4-4e59-aebf-7cc141f93252-registry-tls\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:41:57.324486 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.324493    2571 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae6425d7-a4c4-4e59-aebf-7cc141f93252-installation-pull-secrets\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:41:57.525583 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.525548    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a800110d-2f4c-42b0-a1e6-89c0b3a2140c-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-rc4bq\" (UID: \"a800110d-2f4c-42b0-a1e6-89c0b3a2140c\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq"
Jul 31 01:41:57.525754 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.525594    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/97255a23-484f-40db-8480-d40cd155a620-node-exporter-tls\") pod \"node-exporter-9kqcl\" (UID: \"97255a23-484f-40db-8480-d40cd155a620\") " pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:57.527845 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.527818    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/97255a23-484f-40db-8480-d40cd155a620-node-exporter-tls\") pod \"node-exporter-9kqcl\" (UID: \"97255a23-484f-40db-8480-d40cd155a620\") " pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:57.527972 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.527947    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a800110d-2f4c-42b0-a1e6-89c0b3a2140c-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-rc4bq\" (UID: \"a800110d-2f4c-42b0-a1e6-89c0b3a2140c\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq"
Jul 31 01:41:57.666246 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.666208    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq"
Jul 31 01:41:57.671820 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.671803    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9kqcl"
Jul 31 01:41:57.682003 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:41:57.681962    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97255a23_484f_40db_8480_d40cd155a620.slice/crio-5636a50d5a7191b1a933d3f5fa9e313c2397025c81575e6121f23a5933151202 WatchSource:0}: Error finding container 5636a50d5a7191b1a933d3f5fa9e313c2397025c81575e6121f23a5933151202: Status 404 returned error can't find the container with id 5636a50d5a7191b1a933d3f5fa9e313c2397025c81575e6121f23a5933151202
Jul 31 01:41:57.798468 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.798444    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq"]
Jul 31 01:41:57.800924 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:41:57.800881    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda800110d_2f4c_42b0_a1e6_89c0b3a2140c.slice/crio-52ff7dbc0ade429b472729c280059fcb0fde4bc613ae52d244d9e6e48c2ea7ec WatchSource:0}: Error finding container 52ff7dbc0ade429b472729c280059fcb0fde4bc613ae52d244d9e6e48c2ea7ec: Status 404 returned error can't find the container with id 52ff7dbc0ade429b472729c280059fcb0fde4bc613ae52d244d9e6e48c2ea7ec
Jul 31 01:41:57.802942 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.802919    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 01:41:57.803278 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.803262    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae6425d7-a4c4-4e59-aebf-7cc141f93252" containerName="registry"
Jul 31 01:41:57.803333 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.803281    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae6425d7-a4c4-4e59-aebf-7cc141f93252" containerName="registry"
Jul 31 01:41:57.803373 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.803353    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae6425d7-a4c4-4e59-aebf-7cc141f93252" containerName="registry"
Jul 31 01:41:57.808522 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.808502    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:57.811105 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.810886    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 31 01:41:57.811105 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.811062    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 31 01:41:57.811329 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.811184    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 31 01:41:57.811329 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.811254    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 31 01:41:57.811329 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.811293    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2jrdj\""
Jul 31 01:41:57.811475 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.811435    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 31 01:41:57.811475 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.811440    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 31 01:41:57.811552 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.811500    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 31 01:41:57.811611 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.811595    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 31 01:41:57.811752 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.811739    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 31 01:41:57.819624 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.819595    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 01:41:57.895881 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.895849    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9kqcl" event={"ID":"97255a23-484f-40db-8480-d40cd155a620","Type":"ContainerStarted","Data":"5636a50d5a7191b1a933d3f5fa9e313c2397025c81575e6121f23a5933151202"}
Jul 31 01:41:57.897304 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.897276    2571 generic.go:356] "Generic (PLEG): container finished" podID="ae6425d7-a4c4-4e59-aebf-7cc141f93252" containerID="3cefda558bc8cdd3c400e173c0278a3e447fdd1b85c693b07e2b94252a197ddc" exitCode=0
Jul 31 01:41:57.897451 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.897329    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786"
Jul 31 01:41:57.897451 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.897355    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786" event={"ID":"ae6425d7-a4c4-4e59-aebf-7cc141f93252","Type":"ContainerDied","Data":"3cefda558bc8cdd3c400e173c0278a3e447fdd1b85c693b07e2b94252a197ddc"}
Jul 31 01:41:57.897451 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.897403    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b57d7bb5d-zm786" event={"ID":"ae6425d7-a4c4-4e59-aebf-7cc141f93252","Type":"ContainerDied","Data":"f0ce84e49cf52a83f27d86d05ea6b35daed6c08c998d2aba698856e9361f137f"}
Jul 31 01:41:57.897451 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.897443    2571 scope.go:117] "RemoveContainer" containerID="3cefda558bc8cdd3c400e173c0278a3e447fdd1b85c693b07e2b94252a197ddc"
Jul 31 01:41:57.901965 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.901929    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq" event={"ID":"a800110d-2f4c-42b0-a1e6-89c0b3a2140c","Type":"ContainerStarted","Data":"52ff7dbc0ade429b472729c280059fcb0fde4bc613ae52d244d9e6e48c2ea7ec"}
Jul 31 01:41:57.910162 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.910146    2571 scope.go:117] "RemoveContainer" containerID="3cefda558bc8cdd3c400e173c0278a3e447fdd1b85c693b07e2b94252a197ddc"
Jul 31 01:41:57.910439 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:57.910419    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cefda558bc8cdd3c400e173c0278a3e447fdd1b85c693b07e2b94252a197ddc\": container with ID starting with 3cefda558bc8cdd3c400e173c0278a3e447fdd1b85c693b07e2b94252a197ddc not found: ID does not exist" containerID="3cefda558bc8cdd3c400e173c0278a3e447fdd1b85c693b07e2b94252a197ddc"
Jul 31 01:41:57.910496 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.910448    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cefda558bc8cdd3c400e173c0278a3e447fdd1b85c693b07e2b94252a197ddc"} err="failed to get container status \"3cefda558bc8cdd3c400e173c0278a3e447fdd1b85c693b07e2b94252a197ddc\": rpc error: code = NotFound desc = could not find container \"3cefda558bc8cdd3c400e173c0278a3e447fdd1b85c693b07e2b94252a197ddc\": container with ID starting with 3cefda558bc8cdd3c400e173c0278a3e447fdd1b85c693b07e2b94252a197ddc not found: ID does not exist"
Jul 31 01:41:57.926729 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.926667    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b57d7bb5d-zm786"]
Jul 31 01:41:57.928703 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.928685    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4d3d7df3-54dc-41e8-911e-991953869562-config-volume\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:57.928783 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.928719    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4d3d7df3-54dc-41e8-911e-991953869562-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:57.928783 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.928760    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pr9q\" (UniqueName: \"kubernetes.io/projected/4d3d7df3-54dc-41e8-911e-991953869562-kube-api-access-9pr9q\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:57.928866 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.928787    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4d3d7df3-54dc-41e8-911e-991953869562-config-out\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:57.928866 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.928853    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d3d7df3-54dc-41e8-911e-991953869562-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:57.929116 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.928879    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4d3d7df3-54dc-41e8-911e-991953869562-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:57.929116 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.928952    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4d3d7df3-54dc-41e8-911e-991953869562-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:57.929116 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.928986    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4d3d7df3-54dc-41e8-911e-991953869562-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:57.929116 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.929031    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4d3d7df3-54dc-41e8-911e-991953869562-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:57.929116 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.929051    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4d3d7df3-54dc-41e8-911e-991953869562-web-config\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:57.929116 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.929109    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4d3d7df3-54dc-41e8-911e-991953869562-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:57.929381 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.929173    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4d3d7df3-54dc-41e8-911e-991953869562-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:57.929381 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.929241    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d3d7df3-54dc-41e8-911e-991953869562-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:57.930786 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.930765    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6b57d7bb5d-zm786"]
Jul 31 01:41:57.990284 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:57.990255    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae6425d7-a4c4-4e59-aebf-7cc141f93252" path="/var/lib/kubelet/pods/ae6425d7-a4c4-4e59-aebf-7cc141f93252/volumes"
Jul 31 01:41:58.029933 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:58.029886    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4d3d7df3-54dc-41e8-911e-991953869562-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:58.029933 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:58.029941    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4d3d7df3-54dc-41e8-911e-991953869562-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:58.030156 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:58.029978    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d3d7df3-54dc-41e8-911e-991953869562-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:58.030156 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:58.030009    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4d3d7df3-54dc-41e8-911e-991953869562-config-volume\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:58.030156 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:58.030039    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4d3d7df3-54dc-41e8-911e-991953869562-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:58.030156 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:58.030058    2571 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 31 01:41:58.030156 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:58.030076    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pr9q\" (UniqueName: \"kubernetes.io/projected/4d3d7df3-54dc-41e8-911e-991953869562-kube-api-access-9pr9q\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:58.030156 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:58.030104    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4d3d7df3-54dc-41e8-911e-991953869562-config-out\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:58.030156 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:58.030134    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d3d7df3-54dc-41e8-911e-991953869562-secret-alertmanager-main-tls podName:4d3d7df3-54dc-41e8-911e-991953869562 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:58.530112912 +0000 UTC m=+279.110353899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/4d3d7df3-54dc-41e8-911e-991953869562-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "4d3d7df3-54dc-41e8-911e-991953869562") : secret "alertmanager-main-tls" not found
Jul 31 01:41:58.030518 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:58.030163    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d3d7df3-54dc-41e8-911e-991953869562-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:58.030518 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:58.030202    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4d3d7df3-54dc-41e8-911e-991953869562-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:58.030518 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:58.030226    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4d3d7df3-54dc-41e8-911e-991953869562-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:58.030518 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:58.030257    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4d3d7df3-54dc-41e8-911e-991953869562-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:58.030518 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:58.030301    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4d3d7df3-54dc-41e8-911e-991953869562-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:58.030518 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:58.030329    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4d3d7df3-54dc-41e8-911e-991953869562-web-config\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:58.030804 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:58.030689    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4d3d7df3-54dc-41e8-911e-991953869562-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:58.031463 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:58.031145    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d3d7df3-54dc-41e8-911e-991953869562-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:58.031594 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:58.031519    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d3d7df3-54dc-41e8-911e-991953869562-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:58.032996 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:58.032972    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4d3d7df3-54dc-41e8-911e-991953869562-config-out\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:58.033100 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:58.033077    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4d3d7df3-54dc-41e8-911e-991953869562-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:58.033159 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:58.033106    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4d3d7df3-54dc-41e8-911e-991953869562-web-config\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:58.033212 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:58.033196    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4d3d7df3-54dc-41e8-911e-991953869562-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:58.033442 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:58.033414    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4d3d7df3-54dc-41e8-911e-991953869562-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:58.033981 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:58.033962    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4d3d7df3-54dc-41e8-911e-991953869562-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:58.034064 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:58.033992    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4d3d7df3-54dc-41e8-911e-991953869562-config-volume\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:58.034126 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:58.034085    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4d3d7df3-54dc-41e8-911e-991953869562-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:58.038561 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:58.038541    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pr9q\" (UniqueName: \"kubernetes.io/projected/4d3d7df3-54dc-41e8-911e-991953869562-kube-api-access-9pr9q\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:58.534374 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:58.534340    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4d3d7df3-54dc-41e8-911e-991953869562-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:58.534534 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:58.534504    2571 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 31 01:41:58.534581 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:41:58.534566    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d3d7df3-54dc-41e8-911e-991953869562-secret-alertmanager-main-tls podName:4d3d7df3-54dc-41e8-911e-991953869562 nodeName:}" failed. No retries permitted until 2026-07-31 01:41:59.534551658 +0000 UTC m=+280.114792630 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/4d3d7df3-54dc-41e8-911e-991953869562-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "4d3d7df3-54dc-41e8-911e-991953869562") : secret "alertmanager-main-tls" not found
Jul 31 01:41:58.907790 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:58.907753    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9kqcl" event={"ID":"97255a23-484f-40db-8480-d40cd155a620","Type":"ContainerStarted","Data":"e5ca3bd12619bb69b1623ced87b96221e4b97ae0028ea5d38db6514da4665a8d"}
Jul 31 01:41:59.543227 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.543137    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4d3d7df3-54dc-41e8-911e-991953869562-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:59.545617 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.545592    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4d3d7df3-54dc-41e8-911e-991953869562-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4d3d7df3-54dc-41e8-911e-991953869562\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:59.623688 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.623637    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 31 01:41:59.738288 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.738261    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"]
Jul 31 01:41:59.742837 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.742817    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"
Jul 31 01:41:59.745278 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.745253    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-cibjlc03dcfao\""
Jul 31 01:41:59.745378 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.745253    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 31 01:41:59.745378 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.745258    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 31 01:41:59.745642 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.745628    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 31 01:41:59.745690 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.745640    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 31 01:41:59.746545 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.746529    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 31 01:41:59.746641 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.746562    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-tt26k\""
Jul 31 01:41:59.751630 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.751610    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"]
Jul 31 01:41:59.765963 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.765941    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 31 01:41:59.768653 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:41:59.768633    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d3d7df3_54dc_41e8_911e_991953869562.slice/crio-98d9f82f164a7296c2f9ab29d22e766f50d9f6b1b455d5d4beee5088a0bf8978 WatchSource:0}: Error finding container 98d9f82f164a7296c2f9ab29d22e766f50d9f6b1b455d5d4beee5088a0bf8978: Status 404 returned error can't find the container with id 98d9f82f164a7296c2f9ab29d22e766f50d9f6b1b455d5d4beee5088a0bf8978
Jul 31 01:41:59.846312 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.846283    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50eb9b90-31e1-45a4-bfff-c8214570c5d4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6998c95b5c-pwxt7\" (UID: \"50eb9b90-31e1-45a4-bfff-c8214570c5d4\") " pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"
Jul 31 01:41:59.846455 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.846328    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50eb9b90-31e1-45a4-bfff-c8214570c5d4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6998c95b5c-pwxt7\" (UID: \"50eb9b90-31e1-45a4-bfff-c8214570c5d4\") " pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"
Jul 31 01:41:59.846455 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.846347    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fc8f\" (UniqueName: \"kubernetes.io/projected/50eb9b90-31e1-45a4-bfff-c8214570c5d4-kube-api-access-9fc8f\") pod \"thanos-querier-6998c95b5c-pwxt7\" (UID: \"50eb9b90-31e1-45a4-bfff-c8214570c5d4\") " pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"
Jul 31 01:41:59.846455 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.846372    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50eb9b90-31e1-45a4-bfff-c8214570c5d4-secret-grpc-tls\") pod \"thanos-querier-6998c95b5c-pwxt7\" (UID: \"50eb9b90-31e1-45a4-bfff-c8214570c5d4\") " pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"
Jul 31 01:41:59.846455 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.846403    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50eb9b90-31e1-45a4-bfff-c8214570c5d4-metrics-client-ca\") pod \"thanos-querier-6998c95b5c-pwxt7\" (UID: \"50eb9b90-31e1-45a4-bfff-c8214570c5d4\") " pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"
Jul 31 01:41:59.846455 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.846440    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/50eb9b90-31e1-45a4-bfff-c8214570c5d4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6998c95b5c-pwxt7\" (UID: \"50eb9b90-31e1-45a4-bfff-c8214570c5d4\") " pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"
Jul 31 01:41:59.846602 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.846483    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/50eb9b90-31e1-45a4-bfff-c8214570c5d4-secret-thanos-querier-tls\") pod \"thanos-querier-6998c95b5c-pwxt7\" (UID: \"50eb9b90-31e1-45a4-bfff-c8214570c5d4\") " pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"
Jul 31 01:41:59.846602 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.846505    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/50eb9b90-31e1-45a4-bfff-c8214570c5d4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6998c95b5c-pwxt7\" (UID: \"50eb9b90-31e1-45a4-bfff-c8214570c5d4\") " pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"
Jul 31 01:41:59.914829 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.914798    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq" event={"ID":"a800110d-2f4c-42b0-a1e6-89c0b3a2140c","Type":"ContainerStarted","Data":"7979cad5bf157636b3f2c4d722c3eac09dcbd9ddfaff247bb4f4182d1dfa9a95"}
Jul 31 01:41:59.915281 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.914859    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq" event={"ID":"a800110d-2f4c-42b0-a1e6-89c0b3a2140c","Type":"ContainerStarted","Data":"db3ced1c7f351dfe3f5d630979d9ce7e72871dbaa17d3ba4e08e7068f9257d10"}
Jul 31 01:41:59.915281 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.914886    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq" event={"ID":"a800110d-2f4c-42b0-a1e6-89c0b3a2140c","Type":"ContainerStarted","Data":"ffa726f6b2db077177efe0c030802b340b889d4115577a89dd3dfbb21c38f8b6"}
Jul 31 01:41:59.915945 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.915923    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4d3d7df3-54dc-41e8-911e-991953869562","Type":"ContainerStarted","Data":"98d9f82f164a7296c2f9ab29d22e766f50d9f6b1b455d5d4beee5088a0bf8978"}
Jul 31 01:41:59.917210 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.917188    2571 generic.go:356] "Generic (PLEG): container finished" podID="97255a23-484f-40db-8480-d40cd155a620" containerID="e5ca3bd12619bb69b1623ced87b96221e4b97ae0028ea5d38db6514da4665a8d" exitCode=0
Jul 31 01:41:59.917319 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.917218    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9kqcl" event={"ID":"97255a23-484f-40db-8480-d40cd155a620","Type":"ContainerDied","Data":"e5ca3bd12619bb69b1623ced87b96221e4b97ae0028ea5d38db6514da4665a8d"}
Jul 31 01:41:59.932560 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.932514    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-rc4bq" podStartSLOduration=2.515980511 podStartE2EDuration="3.932497297s" totalImagesPullingTime="1.416516786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:41:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:41:59.931939015 +0000 UTC m=+280.512180011" watchObservedRunningTime="2026-07-31 01:41:59.932497297 +0000 UTC m=+280.512738293"
Jul 31 01:41:59.947361 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.947341    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50eb9b90-31e1-45a4-bfff-c8214570c5d4-metrics-client-ca\") pod \"thanos-querier-6998c95b5c-pwxt7\" (UID: \"50eb9b90-31e1-45a4-bfff-c8214570c5d4\") " pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"
Jul 31 01:41:59.947465 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.947382    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/50eb9b90-31e1-45a4-bfff-c8214570c5d4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6998c95b5c-pwxt7\" (UID: \"50eb9b90-31e1-45a4-bfff-c8214570c5d4\") " pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"
Jul 31 01:41:59.947465 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.947400    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/50eb9b90-31e1-45a4-bfff-c8214570c5d4-secret-thanos-querier-tls\") pod \"thanos-querier-6998c95b5c-pwxt7\" (UID: \"50eb9b90-31e1-45a4-bfff-c8214570c5d4\") " pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"
Jul 31 01:41:59.947465 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.947421    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/50eb9b90-31e1-45a4-bfff-c8214570c5d4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6998c95b5c-pwxt7\" (UID: \"50eb9b90-31e1-45a4-bfff-c8214570c5d4\") " pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"
Jul 31 01:41:59.947465 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.947450    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50eb9b90-31e1-45a4-bfff-c8214570c5d4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6998c95b5c-pwxt7\" (UID: \"50eb9b90-31e1-45a4-bfff-c8214570c5d4\") " pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"
Jul 31 01:41:59.947666 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.947481    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50eb9b90-31e1-45a4-bfff-c8214570c5d4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6998c95b5c-pwxt7\" (UID: \"50eb9b90-31e1-45a4-bfff-c8214570c5d4\") " pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"
Jul 31 01:41:59.947666 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.947497    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fc8f\" (UniqueName: \"kubernetes.io/projected/50eb9b90-31e1-45a4-bfff-c8214570c5d4-kube-api-access-9fc8f\") pod \"thanos-querier-6998c95b5c-pwxt7\" (UID: \"50eb9b90-31e1-45a4-bfff-c8214570c5d4\") " pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"
Jul 31 01:41:59.947666 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.947551    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50eb9b90-31e1-45a4-bfff-c8214570c5d4-secret-grpc-tls\") pod \"thanos-querier-6998c95b5c-pwxt7\" (UID: \"50eb9b90-31e1-45a4-bfff-c8214570c5d4\") " pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"
Jul 31 01:41:59.948470 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.948442    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50eb9b90-31e1-45a4-bfff-c8214570c5d4-metrics-client-ca\") pod \"thanos-querier-6998c95b5c-pwxt7\" (UID: \"50eb9b90-31e1-45a4-bfff-c8214570c5d4\") " pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"
Jul 31 01:41:59.950636 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.950196    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50eb9b90-31e1-45a4-bfff-c8214570c5d4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6998c95b5c-pwxt7\" (UID: \"50eb9b90-31e1-45a4-bfff-c8214570c5d4\") " pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"
Jul 31 01:41:59.950636 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.950375    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/50eb9b90-31e1-45a4-bfff-c8214570c5d4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6998c95b5c-pwxt7\" (UID: \"50eb9b90-31e1-45a4-bfff-c8214570c5d4\") " pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"
Jul 31 01:41:59.950636 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.950586    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/50eb9b90-31e1-45a4-bfff-c8214570c5d4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6998c95b5c-pwxt7\" (UID: \"50eb9b90-31e1-45a4-bfff-c8214570c5d4\") " pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"
Jul 31 01:41:59.950852 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.950832    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/50eb9b90-31e1-45a4-bfff-c8214570c5d4-secret-thanos-querier-tls\") pod \"thanos-querier-6998c95b5c-pwxt7\" (UID: \"50eb9b90-31e1-45a4-bfff-c8214570c5d4\") " pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"
Jul 31 01:41:59.950911 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.950857    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50eb9b90-31e1-45a4-bfff-c8214570c5d4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6998c95b5c-pwxt7\" (UID: \"50eb9b90-31e1-45a4-bfff-c8214570c5d4\") " pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"
Jul 31 01:41:59.950958 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.950838    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50eb9b90-31e1-45a4-bfff-c8214570c5d4-secret-grpc-tls\") pod \"thanos-querier-6998c95b5c-pwxt7\" (UID: \"50eb9b90-31e1-45a4-bfff-c8214570c5d4\") " pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"
Jul 31 01:41:59.957119 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:41:59.957099    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fc8f\" (UniqueName: \"kubernetes.io/projected/50eb9b90-31e1-45a4-bfff-c8214570c5d4-kube-api-access-9fc8f\") pod \"thanos-querier-6998c95b5c-pwxt7\" (UID: \"50eb9b90-31e1-45a4-bfff-c8214570c5d4\") " pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"
Jul 31 01:42:00.052150 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:00.052123    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"
Jul 31 01:42:00.179921 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:00.179832    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"]
Jul 31 01:42:00.182876 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:42:00.182848    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50eb9b90_31e1_45a4_bfff_c8214570c5d4.slice/crio-89b9d44d2e786ad0278599ab92f1099dac1739e9b6ec0e0120707d1daec788a0 WatchSource:0}: Error finding container 89b9d44d2e786ad0278599ab92f1099dac1739e9b6ec0e0120707d1daec788a0: Status 404 returned error can't find the container with id 89b9d44d2e786ad0278599ab92f1099dac1739e9b6ec0e0120707d1daec788a0
Jul 31 01:42:00.923777 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:00.923734    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9kqcl" event={"ID":"97255a23-484f-40db-8480-d40cd155a620","Type":"ContainerStarted","Data":"8db76430f873c4f1e757a651e29261db5eaff6a10b1c33c5f0018894a45a37d2"}
Jul 31 01:42:00.924240 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:00.923818    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9kqcl" event={"ID":"97255a23-484f-40db-8480-d40cd155a620","Type":"ContainerStarted","Data":"067f67da20e7b3b3fd32a35df91bbcc9208ff124bf5603ac6e971c5ec3c1d1ef"}
Jul 31 01:42:00.925138 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:00.925114    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7" event={"ID":"50eb9b90-31e1-45a4-bfff-c8214570c5d4","Type":"ContainerStarted","Data":"89b9d44d2e786ad0278599ab92f1099dac1739e9b6ec0e0120707d1daec788a0"}
Jul 31 01:42:00.945232 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:00.945180    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9kqcl" podStartSLOduration=3.810274288 podStartE2EDuration="4.945164351s" totalImagesPullingTime="1.066406001s" totalInitContainerRuntime="68.484062ms" isStatefulPod=true podCreationTimestamp="2026-07-31 01:41:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:42:00.943366324 +0000 UTC m=+281.523607350" watchObservedRunningTime="2026-07-31 01:42:00.945164351 +0000 UTC m=+281.525405345"
Jul 31 01:42:01.048637 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.048602    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-749dc88778-z9gkf"]
Jul 31 01:42:01.051993 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.051964    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-749dc88778-z9gkf"
Jul 31 01:42:01.054626 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.054599    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-at2ll2j4pccco\""
Jul 31 01:42:01.054626 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.054599    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-w5qbb\""
Jul 31 01:42:01.054804 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.054629    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 31 01:42:01.054804 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.054710    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 31 01:42:01.054804 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.054718    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 31 01:42:01.055051 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.054997    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 31 01:42:01.063275 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.063224    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-749dc88778-z9gkf"]
Jul 31 01:42:01.156514 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.156481    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b14026ed-4c0e-498d-89e4-4ebacc4c51e2-audit-log\") pod \"metrics-server-749dc88778-z9gkf\" (UID: \"b14026ed-4c0e-498d-89e4-4ebacc4c51e2\") " pod="openshift-monitoring/metrics-server-749dc88778-z9gkf"
Jul 31 01:42:01.156699 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.156529    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b14026ed-4c0e-498d-89e4-4ebacc4c51e2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-749dc88778-z9gkf\" (UID: \"b14026ed-4c0e-498d-89e4-4ebacc4c51e2\") " pod="openshift-monitoring/metrics-server-749dc88778-z9gkf"
Jul 31 01:42:01.156699 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.156596    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b14026ed-4c0e-498d-89e4-4ebacc4c51e2-secret-metrics-server-tls\") pod \"metrics-server-749dc88778-z9gkf\" (UID: \"b14026ed-4c0e-498d-89e4-4ebacc4c51e2\") " pod="openshift-monitoring/metrics-server-749dc88778-z9gkf"
Jul 31 01:42:01.156813 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.156717    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8j5m\" (UniqueName: \"kubernetes.io/projected/b14026ed-4c0e-498d-89e4-4ebacc4c51e2-kube-api-access-l8j5m\") pod \"metrics-server-749dc88778-z9gkf\" (UID: \"b14026ed-4c0e-498d-89e4-4ebacc4c51e2\") " pod="openshift-monitoring/metrics-server-749dc88778-z9gkf"
Jul 31 01:42:01.156813 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.156758    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b14026ed-4c0e-498d-89e4-4ebacc4c51e2-client-ca-bundle\") pod \"metrics-server-749dc88778-z9gkf\" (UID: \"b14026ed-4c0e-498d-89e4-4ebacc4c51e2\") " pod="openshift-monitoring/metrics-server-749dc88778-z9gkf"
Jul 31 01:42:01.156813 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.156800    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b14026ed-4c0e-498d-89e4-4ebacc4c51e2-metrics-server-audit-profiles\") pod \"metrics-server-749dc88778-z9gkf\" (UID: \"b14026ed-4c0e-498d-89e4-4ebacc4c51e2\") " pod="openshift-monitoring/metrics-server-749dc88778-z9gkf"
Jul 31 01:42:01.156990 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.156878    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b14026ed-4c0e-498d-89e4-4ebacc4c51e2-secret-metrics-server-client-certs\") pod \"metrics-server-749dc88778-z9gkf\" (UID: \"b14026ed-4c0e-498d-89e4-4ebacc4c51e2\") " pod="openshift-monitoring/metrics-server-749dc88778-z9gkf"
Jul 31 01:42:01.257675 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.257636    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b14026ed-4c0e-498d-89e4-4ebacc4c51e2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-749dc88778-z9gkf\" (UID: \"b14026ed-4c0e-498d-89e4-4ebacc4c51e2\") " pod="openshift-monitoring/metrics-server-749dc88778-z9gkf"
Jul 31 01:42:01.257868 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.257701    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b14026ed-4c0e-498d-89e4-4ebacc4c51e2-secret-metrics-server-tls\") pod \"metrics-server-749dc88778-z9gkf\" (UID: \"b14026ed-4c0e-498d-89e4-4ebacc4c51e2\") " pod="openshift-monitoring/metrics-server-749dc88778-z9gkf"
Jul 31 01:42:01.257868 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.257760    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8j5m\" (UniqueName: \"kubernetes.io/projected/b14026ed-4c0e-498d-89e4-4ebacc4c51e2-kube-api-access-l8j5m\") pod \"metrics-server-749dc88778-z9gkf\" (UID: \"b14026ed-4c0e-498d-89e4-4ebacc4c51e2\") " pod="openshift-monitoring/metrics-server-749dc88778-z9gkf"
Jul 31 01:42:01.257868 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.257798    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b14026ed-4c0e-498d-89e4-4ebacc4c51e2-client-ca-bundle\") pod \"metrics-server-749dc88778-z9gkf\" (UID: \"b14026ed-4c0e-498d-89e4-4ebacc4c51e2\") " pod="openshift-monitoring/metrics-server-749dc88778-z9gkf"
Jul 31 01:42:01.257868 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.257836    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b14026ed-4c0e-498d-89e4-4ebacc4c51e2-metrics-server-audit-profiles\") pod \"metrics-server-749dc88778-z9gkf\" (UID: \"b14026ed-4c0e-498d-89e4-4ebacc4c51e2\") " pod="openshift-monitoring/metrics-server-749dc88778-z9gkf"
Jul 31 01:42:01.258126 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.257875    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b14026ed-4c0e-498d-89e4-4ebacc4c51e2-secret-metrics-server-client-certs\") pod \"metrics-server-749dc88778-z9gkf\" (UID: \"b14026ed-4c0e-498d-89e4-4ebacc4c51e2\") " pod="openshift-monitoring/metrics-server-749dc88778-z9gkf"
Jul 31 01:42:01.258126 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.257945    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b14026ed-4c0e-498d-89e4-4ebacc4c51e2-audit-log\") pod \"metrics-server-749dc88778-z9gkf\" (UID: \"b14026ed-4c0e-498d-89e4-4ebacc4c51e2\") " pod="openshift-monitoring/metrics-server-749dc88778-z9gkf"
Jul 31 01:42:01.258261 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.258239    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b14026ed-4c0e-498d-89e4-4ebacc4c51e2-audit-log\") pod \"metrics-server-749dc88778-z9gkf\" (UID: \"b14026ed-4c0e-498d-89e4-4ebacc4c51e2\") " pod="openshift-monitoring/metrics-server-749dc88778-z9gkf"
Jul 31 01:42:01.258549 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.258500    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b14026ed-4c0e-498d-89e4-4ebacc4c51e2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-749dc88778-z9gkf\" (UID: \"b14026ed-4c0e-498d-89e4-4ebacc4c51e2\") " pod="openshift-monitoring/metrics-server-749dc88778-z9gkf"
Jul 31 01:42:01.259049 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.259021    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b14026ed-4c0e-498d-89e4-4ebacc4c51e2-metrics-server-audit-profiles\") pod \"metrics-server-749dc88778-z9gkf\" (UID: \"b14026ed-4c0e-498d-89e4-4ebacc4c51e2\") " pod="openshift-monitoring/metrics-server-749dc88778-z9gkf"
Jul 31 01:42:01.260623 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.260599    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b14026ed-4c0e-498d-89e4-4ebacc4c51e2-secret-metrics-server-tls\") pod \"metrics-server-749dc88778-z9gkf\" (UID: \"b14026ed-4c0e-498d-89e4-4ebacc4c51e2\") " pod="openshift-monitoring/metrics-server-749dc88778-z9gkf"
Jul 31 01:42:01.260705 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.260679    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b14026ed-4c0e-498d-89e4-4ebacc4c51e2-secret-metrics-server-client-certs\") pod \"metrics-server-749dc88778-z9gkf\" (UID: \"b14026ed-4c0e-498d-89e4-4ebacc4c51e2\") " pod="openshift-monitoring/metrics-server-749dc88778-z9gkf"
Jul 31 01:42:01.260763 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.260707    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b14026ed-4c0e-498d-89e4-4ebacc4c51e2-client-ca-bundle\") pod \"metrics-server-749dc88778-z9gkf\" (UID: \"b14026ed-4c0e-498d-89e4-4ebacc4c51e2\") " pod="openshift-monitoring/metrics-server-749dc88778-z9gkf"
Jul 31 01:42:01.266721 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.266696    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8j5m\" (UniqueName: \"kubernetes.io/projected/b14026ed-4c0e-498d-89e4-4ebacc4c51e2-kube-api-access-l8j5m\") pod \"metrics-server-749dc88778-z9gkf\" (UID: \"b14026ed-4c0e-498d-89e4-4ebacc4c51e2\") " pod="openshift-monitoring/metrics-server-749dc88778-z9gkf"
Jul 31 01:42:01.410188 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.410152    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-749dc88778-z9gkf"
Jul 31 01:42:01.530923 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.530859    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-k5kkh"]
Jul 31 01:42:01.535491 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.535469    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-k5kkh"
Jul 31 01:42:01.538174 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.537979    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 31 01:42:01.538174 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.538124    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-8z4gh\""
Jul 31 01:42:01.541295 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.541273    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-k5kkh"]
Jul 31 01:42:01.544291 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:42:01.544237    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hpfnx" podUID="7cec939f-eacf-4254-abbd-75903f407f37"
Jul 31 01:42:01.563741 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.563714    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-749dc88778-z9gkf"]
Jul 31 01:42:01.579630 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.579605    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6ff495cd74-9v9qh"]
Jul 31 01:42:01.582990 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.582969    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:42:01.585850 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.585672    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 31 01:42:01.585850 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.585697    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 31 01:42:01.585850 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.585717    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 31 01:42:01.585850 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.585719    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 31 01:42:01.585850 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.585738    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 31 01:42:01.585850 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.585782    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 31 01:42:01.585850 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.585740    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-k6fdc\""
Jul 31 01:42:01.586474 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.586454    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 31 01:42:01.590681 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.590658    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 31 01:42:01.594479 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.594455    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ff495cd74-9v9qh"]
Jul 31 01:42:01.662170 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.662139    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt48k\" (UniqueName: \"kubernetes.io/projected/b3247823-dc00-4058-ac7b-45b7155273b4-kube-api-access-tt48k\") pod \"monitoring-plugin-6dffbbd67-k5kkh\" (UID: \"b3247823-dc00-4058-ac7b-45b7155273b4\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-k5kkh"
Jul 31 01:42:01.662340 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.662186    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b3247823-dc00-4058-ac7b-45b7155273b4-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-k5kkh\" (UID: \"b3247823-dc00-4058-ac7b-45b7155273b4\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-k5kkh"
Jul 31 01:42:01.763133 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.763054    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fba5ec7-8576-494a-b79c-7a52a71e44c0-trusted-ca-bundle\") pod \"console-6ff495cd74-9v9qh\" (UID: \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\") " pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:42:01.763133 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.763098    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt48k\" (UniqueName: \"kubernetes.io/projected/b3247823-dc00-4058-ac7b-45b7155273b4-kube-api-access-tt48k\") pod \"monitoring-plugin-6dffbbd67-k5kkh\" (UID: \"b3247823-dc00-4058-ac7b-45b7155273b4\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-k5kkh"
Jul 31 01:42:01.763349 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.763168    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b3247823-dc00-4058-ac7b-45b7155273b4-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-k5kkh\" (UID: \"b3247823-dc00-4058-ac7b-45b7155273b4\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-k5kkh"
Jul 31 01:42:01.763349 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.763211    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fba5ec7-8576-494a-b79c-7a52a71e44c0-console-config\") pod \"console-6ff495cd74-9v9qh\" (UID: \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\") " pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:42:01.763349 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.763238    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fba5ec7-8576-494a-b79c-7a52a71e44c0-oauth-serving-cert\") pod \"console-6ff495cd74-9v9qh\" (UID: \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\") " pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:42:01.763349 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.763292    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fba5ec7-8576-494a-b79c-7a52a71e44c0-service-ca\") pod \"console-6ff495cd74-9v9qh\" (UID: \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\") " pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:42:01.763349 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.763321    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fba5ec7-8576-494a-b79c-7a52a71e44c0-console-oauth-config\") pod \"console-6ff495cd74-9v9qh\" (UID: \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\") " pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:42:01.763349 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:42:01.763332    2571 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 31 01:42:01.763597 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:42:01.763395    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3247823-dc00-4058-ac7b-45b7155273b4-monitoring-plugin-cert podName:b3247823-dc00-4058-ac7b-45b7155273b4 nodeName:}" failed. No retries permitted until 2026-07-31 01:42:02.263374007 +0000 UTC m=+282.843614983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/b3247823-dc00-4058-ac7b-45b7155273b4-monitoring-plugin-cert") pod "monitoring-plugin-6dffbbd67-k5kkh" (UID: "b3247823-dc00-4058-ac7b-45b7155273b4") : secret "monitoring-plugin-cert" not found
Jul 31 01:42:01.763597 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.763429    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbpcw\" (UniqueName: \"kubernetes.io/projected/2fba5ec7-8576-494a-b79c-7a52a71e44c0-kube-api-access-lbpcw\") pod \"console-6ff495cd74-9v9qh\" (UID: \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\") " pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:42:01.763597 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.763477    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fba5ec7-8576-494a-b79c-7a52a71e44c0-console-serving-cert\") pod \"console-6ff495cd74-9v9qh\" (UID: \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\") " pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:42:01.773704 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.773662    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt48k\" (UniqueName: \"kubernetes.io/projected/b3247823-dc00-4058-ac7b-45b7155273b4-kube-api-access-tt48k\") pod \"monitoring-plugin-6dffbbd67-k5kkh\" (UID: \"b3247823-dc00-4058-ac7b-45b7155273b4\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-k5kkh"
Jul 31 01:42:01.864924 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.864864    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fba5ec7-8576-494a-b79c-7a52a71e44c0-service-ca\") pod \"console-6ff495cd74-9v9qh\" (UID: \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\") " pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:42:01.864924 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.864920    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fba5ec7-8576-494a-b79c-7a52a71e44c0-console-oauth-config\") pod \"console-6ff495cd74-9v9qh\" (UID: \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\") " pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:42:01.865174 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.864963    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbpcw\" (UniqueName: \"kubernetes.io/projected/2fba5ec7-8576-494a-b79c-7a52a71e44c0-kube-api-access-lbpcw\") pod \"console-6ff495cd74-9v9qh\" (UID: \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\") " pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:42:01.865174 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.864988    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fba5ec7-8576-494a-b79c-7a52a71e44c0-console-serving-cert\") pod \"console-6ff495cd74-9v9qh\" (UID: \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\") " pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:42:01.865174 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.865036    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fba5ec7-8576-494a-b79c-7a52a71e44c0-trusted-ca-bundle\") pod \"console-6ff495cd74-9v9qh\" (UID: \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\") " pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:42:01.865174 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.865104    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fba5ec7-8576-494a-b79c-7a52a71e44c0-console-config\") pod \"console-6ff495cd74-9v9qh\" (UID: \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\") " pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:42:01.865174 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.865127    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fba5ec7-8576-494a-b79c-7a52a71e44c0-oauth-serving-cert\") pod \"console-6ff495cd74-9v9qh\" (UID: \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\") " pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:42:01.865809 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.865760    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fba5ec7-8576-494a-b79c-7a52a71e44c0-service-ca\") pod \"console-6ff495cd74-9v9qh\" (UID: \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\") " pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:42:01.865958 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.865829    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fba5ec7-8576-494a-b79c-7a52a71e44c0-oauth-serving-cert\") pod \"console-6ff495cd74-9v9qh\" (UID: \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\") " pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:42:01.866046 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.866024    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fba5ec7-8576-494a-b79c-7a52a71e44c0-trusted-ca-bundle\") pod \"console-6ff495cd74-9v9qh\" (UID: \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\") " pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:42:01.866046 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.866038    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fba5ec7-8576-494a-b79c-7a52a71e44c0-console-config\") pod \"console-6ff495cd74-9v9qh\" (UID: \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\") " pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:42:01.867909 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.867872    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fba5ec7-8576-494a-b79c-7a52a71e44c0-console-oauth-config\") pod \"console-6ff495cd74-9v9qh\" (UID: \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\") " pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:42:01.867909 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.867878    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fba5ec7-8576-494a-b79c-7a52a71e44c0-console-serving-cert\") pod \"console-6ff495cd74-9v9qh\" (UID: \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\") " pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:42:01.872363 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.872343    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbpcw\" (UniqueName: \"kubernetes.io/projected/2fba5ec7-8576-494a-b79c-7a52a71e44c0-kube-api-access-lbpcw\") pod \"console-6ff495cd74-9v9qh\" (UID: \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\") " pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:42:01.894218 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.894185    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:42:01.931417 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.931381    2571 generic.go:356] "Generic (PLEG): container finished" podID="4d3d7df3-54dc-41e8-911e-991953869562" containerID="7cb008d65f219a3f3f640474a549c3e1502117064c687152d49e02aa1f1ed09e" exitCode=0
Jul 31 01:42:01.931888 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.931470    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4d3d7df3-54dc-41e8-911e-991953869562","Type":"ContainerDied","Data":"7cb008d65f219a3f3f640474a549c3e1502117064c687152d49e02aa1f1ed09e"}
Jul 31 01:42:01.931888 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:01.931493    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hpfnx"
Jul 31 01:42:01.988366 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:42:01.988328    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb14026ed_4c0e_498d_89e4_4ebacc4c51e2.slice/crio-29fdf5e5692e618c859ccc22ce2cc0aebcdf4ce64c020b2c4be3cbc7972c862f WatchSource:0}: Error finding container 29fdf5e5692e618c859ccc22ce2cc0aebcdf4ce64c020b2c4be3cbc7972c862f: Status 404 returned error can't find the container with id 29fdf5e5692e618c859ccc22ce2cc0aebcdf4ce64c020b2c4be3cbc7972c862f
Jul 31 01:42:02.114847 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:02.114811    2571 patch_prober.go:28] interesting pod/image-registry-5744646c59-dd2zb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 31 01:42:02.114988 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:02.114869    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5744646c59-dd2zb" podUID="ab0653aa-986c-458e-9c33-d98bbcb9b39d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 01:42:02.118886 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:02.118858    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ff495cd74-9v9qh"]
Jul 31 01:42:02.122889 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:42:02.122856    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fba5ec7_8576_494a_b79c_7a52a71e44c0.slice/crio-855b785a550d5a6e562915b7846105e5e58bf070253a3fbb02773636e14fa4ed WatchSource:0}: Error finding container 855b785a550d5a6e562915b7846105e5e58bf070253a3fbb02773636e14fa4ed: Status 404 returned error can't find the container with id 855b785a550d5a6e562915b7846105e5e58bf070253a3fbb02773636e14fa4ed
Jul 31 01:42:02.269584 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:02.269546    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b3247823-dc00-4058-ac7b-45b7155273b4-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-k5kkh\" (UID: \"b3247823-dc00-4058-ac7b-45b7155273b4\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-k5kkh"
Jul 31 01:42:02.271919 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:02.271868    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b3247823-dc00-4058-ac7b-45b7155273b4-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-k5kkh\" (UID: \"b3247823-dc00-4058-ac7b-45b7155273b4\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-k5kkh"
Jul 31 01:42:02.448046 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:02.448013    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-k5kkh"
Jul 31 01:42:02.619657 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:02.619626    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-k5kkh"]
Jul 31 01:42:02.622124 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:42:02.622090    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3247823_dc00_4058_ac7b_45b7155273b4.slice/crio-6d784cf00bb67e8702de7f9d47c3d64c9ed5a46e6ebb33621797c8aad0355443 WatchSource:0}: Error finding container 6d784cf00bb67e8702de7f9d47c3d64c9ed5a46e6ebb33621797c8aad0355443: Status 404 returned error can't find the container with id 6d784cf00bb67e8702de7f9d47c3d64c9ed5a46e6ebb33621797c8aad0355443
Jul 31 01:42:02.942195 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:02.942015    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7" event={"ID":"50eb9b90-31e1-45a4-bfff-c8214570c5d4","Type":"ContainerStarted","Data":"b7f757cf0daa502409c6d2f67d2d0e00692393e38b5f505bbe758798b7fa4a65"}
Jul 31 01:42:02.942195 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:02.942100    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7" event={"ID":"50eb9b90-31e1-45a4-bfff-c8214570c5d4","Type":"ContainerStarted","Data":"5b0b50b3d1ca15ee40ae7e51237026e1e55b6446d7a5be2cb68e8d14e38bff71"}
Jul 31 01:42:02.942195 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:02.942145    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7" event={"ID":"50eb9b90-31e1-45a4-bfff-c8214570c5d4","Type":"ContainerStarted","Data":"10e40b54f919b2bdeb14428ed44ba902eca79cded9d7779312a385ee889d0780"}
Jul 31 01:42:02.944302 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:02.944229    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-k5kkh" event={"ID":"b3247823-dc00-4058-ac7b-45b7155273b4","Type":"ContainerStarted","Data":"6d784cf00bb67e8702de7f9d47c3d64c9ed5a46e6ebb33621797c8aad0355443"}
Jul 31 01:42:02.946265 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:02.946187    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-749dc88778-z9gkf" event={"ID":"b14026ed-4c0e-498d-89e4-4ebacc4c51e2","Type":"ContainerStarted","Data":"29fdf5e5692e618c859ccc22ce2cc0aebcdf4ce64c020b2c4be3cbc7972c862f"}
Jul 31 01:42:02.948016 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:02.947950    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff495cd74-9v9qh" event={"ID":"2fba5ec7-8576-494a-b79c-7a52a71e44c0","Type":"ContainerStarted","Data":"855b785a550d5a6e562915b7846105e5e58bf070253a3fbb02773636e14fa4ed"}
Jul 31 01:42:03.812513 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:03.812485    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5744646c59-dd2zb"
Jul 31 01:42:04.696355 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:04.696312    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls\") pod \"dns-default-hpfnx\" (UID: \"7cec939f-eacf-4254-abbd-75903f407f37\") " pod="openshift-dns/dns-default-hpfnx"
Jul 31 01:42:04.699154 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:04.699128    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cec939f-eacf-4254-abbd-75903f407f37-metrics-tls\") pod \"dns-default-hpfnx\" (UID: \"7cec939f-eacf-4254-abbd-75903f407f37\") " pod="openshift-dns/dns-default-hpfnx"
Jul 31 01:42:04.935417 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:04.935388    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5txjm\""
Jul 31 01:42:04.943517 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:04.943488    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hpfnx"
Jul 31 01:42:05.671104 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:05.671060    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hpfnx"]
Jul 31 01:42:05.679770 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:42:05.679742    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cec939f_eacf_4254_abbd_75903f407f37.slice/crio-8d7ae0d26773fbd648b66fb2a71d97ceaf029673dc72f91396008eba40de25b1 WatchSource:0}: Error finding container 8d7ae0d26773fbd648b66fb2a71d97ceaf029673dc72f91396008eba40de25b1: Status 404 returned error can't find the container with id 8d7ae0d26773fbd648b66fb2a71d97ceaf029673dc72f91396008eba40de25b1
Jul 31 01:42:05.965706 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:05.965672    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff495cd74-9v9qh" event={"ID":"2fba5ec7-8576-494a-b79c-7a52a71e44c0","Type":"ContainerStarted","Data":"fb8885e8e368aaf473fadcbfbd9e3bc8e331cb46c8bf3f7d0b560dcc29824c52"}
Jul 31 01:42:05.967366 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:05.967343    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hpfnx" event={"ID":"7cec939f-eacf-4254-abbd-75903f407f37","Type":"ContainerStarted","Data":"8d7ae0d26773fbd648b66fb2a71d97ceaf029673dc72f91396008eba40de25b1"}
Jul 31 01:42:05.971501 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:05.971479    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7" event={"ID":"50eb9b90-31e1-45a4-bfff-c8214570c5d4","Type":"ContainerStarted","Data":"eaa382e7d8685240acb34e9c5baf5ff5e64752a2fc663238a203ba234ec87461"}
Jul 31 01:42:05.971621 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:05.971561    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7" event={"ID":"50eb9b90-31e1-45a4-bfff-c8214570c5d4","Type":"ContainerStarted","Data":"a2aad26dbeaa022a8f49e32ee022eabc172772db24297cde261cc847c05b7f2e"}
Jul 31 01:42:05.971621 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:05.971613    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"
Jul 31 01:42:05.971734 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:05.971653    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7" event={"ID":"50eb9b90-31e1-45a4-bfff-c8214570c5d4","Type":"ContainerStarted","Data":"10d85c748a6a6e656c0628c5df928ed2ed907d8b83a005cfa3a0f7f16bbfc0e5"}
Jul 31 01:42:05.975166 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:05.975142    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4d3d7df3-54dc-41e8-911e-991953869562","Type":"ContainerStarted","Data":"94271ae9c6aca220bad67da1bc760c0f67aeb667cb6b0137a9c78de2165cd512"}
Jul 31 01:42:05.975259 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:05.975212    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4d3d7df3-54dc-41e8-911e-991953869562","Type":"ContainerStarted","Data":"5b4e2dab8fd4b6adf79e73bc9c8b47a88b95fad1d3f014dfab837f9e2505d886"}
Jul 31 01:42:05.975259 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:05.975252    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4d3d7df3-54dc-41e8-911e-991953869562","Type":"ContainerStarted","Data":"1687da7631ef7f3ec3158a17d8c73fe5f2fec83e3442429d67fedc7ddab5d0bc"}
Jul 31 01:42:05.975361 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:05.975290    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4d3d7df3-54dc-41e8-911e-991953869562","Type":"ContainerStarted","Data":"883c58d0f73b223edac49b585beb93c2371294fb9cfb15e8b21f3ae00594ed86"}
Jul 31 01:42:05.975361 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:05.975329    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4d3d7df3-54dc-41e8-911e-991953869562","Type":"ContainerStarted","Data":"5326c55a346921b67c31588b3e7ffb4c3fc5c27c55af02d5c799a1f02a1ccdc3"}
Jul 31 01:42:05.976801 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:05.976776    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-k5kkh" event={"ID":"b3247823-dc00-4058-ac7b-45b7155273b4","Type":"ContainerStarted","Data":"ba24a3a77d80c4c529cbb5a2894a23998bcf25d178580092bbe1d494c33d9fac"}
Jul 31 01:42:05.976970 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:05.976933    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-k5kkh"
Jul 31 01:42:05.978639 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:05.978622    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-749dc88778-z9gkf" event={"ID":"b14026ed-4c0e-498d-89e4-4ebacc4c51e2","Type":"ContainerStarted","Data":"bd2a2d36af86cd9e5130cb627baf61c2c4755089711f3070054d72a15021b864"}
Jul 31 01:42:05.982445 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:05.982428    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-k5kkh"
Jul 31 01:42:05.984987 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:05.984937    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6ff495cd74-9v9qh" podStartSLOduration=1.5299125999999998 podStartE2EDuration="4.984924454s" totalImagesPullingTime="3.455011854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:42:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:42:05.983652933 +0000 UTC m=+286.563893931" watchObservedRunningTime="2026-07-31 01:42:05.984924454 +0000 UTC m=+286.565165511"
Jul 31 01:42:06.000724 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:06.000684    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-749dc88778-z9gkf" podStartSLOduration=1.467566122 podStartE2EDuration="5.000668924s" totalImagesPullingTime="3.533102802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:42:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:42:05.998929868 +0000 UTC m=+286.579170857" watchObservedRunningTime="2026-07-31 01:42:06.000668924 +0000 UTC m=+286.580909919"
Jul 31 01:42:06.015170 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:06.015111    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-k5kkh" podStartSLOduration=2.116229472 podStartE2EDuration="5.015091775s" totalImagesPullingTime="2.898862303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:42:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:42:06.013032731 +0000 UTC m=+286.593273730" watchObservedRunningTime="2026-07-31 01:42:06.015091775 +0000 UTC m=+286.595332773"
Jul 31 01:42:06.041632 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:06.041584    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7" podStartSLOduration=1.9007206079999999 podStartE2EDuration="7.041568507s" totalImagesPullingTime="5.140847899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:41:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:42:06.039966187 +0000 UTC m=+286.620207183" watchObservedRunningTime="2026-07-31 01:42:06.041568507 +0000 UTC m=+286.621809502"
Jul 31 01:42:06.987291 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:06.987233    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4d3d7df3-54dc-41e8-911e-991953869562","Type":"ContainerStarted","Data":"1af9132d1176b2fa592ecfb20235b1ce6d1d877e386a08a5bca9df37b1911ba2"}
Jul 31 01:42:07.017577 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:07.017529    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.214913517 podStartE2EDuration="10.017512554s" totalImagesPullingTime="4.781548748s" totalInitContainerRuntime="21.050289ms" isStatefulPod=false podCreationTimestamp="2026-07-31 01:41:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:42:07.014378963 +0000 UTC m=+287.594619983" watchObservedRunningTime="2026-07-31 01:42:07.017512554 +0000 UTC m=+287.597753549"
Jul 31 01:42:07.992783 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:07.992752    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hpfnx" event={"ID":"7cec939f-eacf-4254-abbd-75903f407f37","Type":"ContainerStarted","Data":"688e43293ba4caa2e676990799e4ff48d7a8efdfc6e61637250c49584357d431"}
Jul 31 01:42:07.993219 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:07.992799    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hpfnx" event={"ID":"7cec939f-eacf-4254-abbd-75903f407f37","Type":"ContainerStarted","Data":"5ad57e616f28371ec793543bcd3ba0acbf6cf398f994bf4b6c439c3f4df7a94b"}
Jul 31 01:42:07.993219 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:07.992919    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hpfnx"
Jul 31 01:42:08.010005 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:08.009955    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hpfnx" podStartSLOduration=252.337100434 podStartE2EDuration="4m14.009938152s" totalImagesPullingTime="1.672837718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:37:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:42:08.008289801 +0000 UTC m=+288.588530789" watchObservedRunningTime="2026-07-31 01:42:08.009938152 +0000 UTC m=+288.590179146"
Jul 31 01:42:11.894445 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:11.894410    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:42:11.894973 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:11.894479    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:42:11.899141 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:11.899118    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:42:11.994423 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:11.994400    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6998c95b5c-pwxt7"
Jul 31 01:42:12.012615 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:12.012579    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:42:17.999684 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:17.999656    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hpfnx"
Jul 31 01:42:19.847976 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:19.847954    2571 kubelet.go:1648] "Image garbage collection succeeded"
Jul 31 01:42:21.410487 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:21.410457    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-749dc88778-z9gkf"
Jul 31 01:42:21.412849 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:21.410516    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-749dc88778-z9gkf"
Jul 31 01:42:24.057606 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:24.057575    2571 generic.go:356] "Generic (PLEG): container finished" podID="7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22" containerID="091f06dd8ccdbabac2d8aadc91c6bfe992e7177a8ca1028270996ba0ced97c15" exitCode=0
Jul 31 01:42:24.057998 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:24.057646    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-gklgq" event={"ID":"7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22","Type":"ContainerDied","Data":"091f06dd8ccdbabac2d8aadc91c6bfe992e7177a8ca1028270996ba0ced97c15"}
Jul 31 01:42:24.058042 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:24.057997    2571 scope.go:117] "RemoveContainer" containerID="091f06dd8ccdbabac2d8aadc91c6bfe992e7177a8ca1028270996ba0ced97c15"
Jul 31 01:42:25.063819 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:25.063787    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-gklgq" event={"ID":"7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22","Type":"ContainerStarted","Data":"e183f1b95a556721b33e04cff234e6af39f24d570b2a6f6b1a1e169547bfe5fe"}
Jul 31 01:42:26.893932 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:26.893903    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4d3d7df3-54dc-41e8-911e-991953869562/init-config-reloader/0.log"
Jul 31 01:42:27.094792 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:27.094740    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4d3d7df3-54dc-41e8-911e-991953869562/alertmanager/0.log"
Jul 31 01:42:27.293743 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:27.293658    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4d3d7df3-54dc-41e8-911e-991953869562/config-reloader/0.log"
Jul 31 01:42:27.493471 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:27.493441    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4d3d7df3-54dc-41e8-911e-991953869562/kube-rbac-proxy-web/0.log"
Jul 31 01:42:27.693521 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:27.693494    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4d3d7df3-54dc-41e8-911e-991953869562/kube-rbac-proxy/0.log"
Jul 31 01:42:27.893583 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:27.893558    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4d3d7df3-54dc-41e8-911e-991953869562/kube-rbac-proxy-metric/0.log"
Jul 31 01:42:28.093352 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:28.093324    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4d3d7df3-54dc-41e8-911e-991953869562/prom-label-proxy/0.log"
Jul 31 01:42:28.494203 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:28.494123    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-rc4bq_a800110d-2f4c-42b0-a1e6-89c0b3a2140c/kube-state-metrics/0.log"
Jul 31 01:42:28.693069 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:28.693043    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-rc4bq_a800110d-2f4c-42b0-a1e6-89c0b3a2140c/kube-rbac-proxy-main/0.log"
Jul 31 01:42:28.892491 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:28.892463    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-rc4bq_a800110d-2f4c-42b0-a1e6-89c0b3a2140c/kube-rbac-proxy-self/0.log"
Jul 31 01:42:29.093006 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:29.092978    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-749dc88778-z9gkf_b14026ed-4c0e-498d-89e4-4ebacc4c51e2/metrics-server/0.log"
Jul 31 01:42:29.292623 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:29.292539    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-k5kkh_b3247823-dc00-4058-ac7b-45b7155273b4/monitoring-plugin/0.log"
Jul 31 01:42:30.093101 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:30.093076    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9kqcl_97255a23-484f-40db-8480-d40cd155a620/init-textfile/0.log"
Jul 31 01:42:30.294305 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:30.294275    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9kqcl_97255a23-484f-40db-8480-d40cd155a620/node-exporter/0.log"
Jul 31 01:42:30.493278 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:30.493207    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9kqcl_97255a23-484f-40db-8480-d40cd155a620/kube-rbac-proxy/0.log"
Jul 31 01:42:33.893496 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:33.893469    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6998c95b5c-pwxt7_50eb9b90-31e1-45a4-bfff-c8214570c5d4/thanos-query/0.log"
Jul 31 01:42:34.093911 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:34.093870    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6998c95b5c-pwxt7_50eb9b90-31e1-45a4-bfff-c8214570c5d4/kube-rbac-proxy-web/0.log"
Jul 31 01:42:34.293451 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:34.293361    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6998c95b5c-pwxt7_50eb9b90-31e1-45a4-bfff-c8214570c5d4/kube-rbac-proxy/0.log"
Jul 31 01:42:34.492654 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:34.492626    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6998c95b5c-pwxt7_50eb9b90-31e1-45a4-bfff-c8214570c5d4/prom-label-proxy/0.log"
Jul 31 01:42:34.692993 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:34.692960    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6998c95b5c-pwxt7_50eb9b90-31e1-45a4-bfff-c8214570c5d4/kube-rbac-proxy-rules/0.log"
Jul 31 01:42:34.893510 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:34.893483    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6998c95b5c-pwxt7_50eb9b90-31e1-45a4-bfff-c8214570c5d4/kube-rbac-proxy-metrics/0.log"
Jul 31 01:42:36.093716 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:36.093656    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6ff495cd74-9v9qh_2fba5ec7-8576-494a-b79c-7a52a71e44c0/console/0.log"
Jul 31 01:42:37.294741 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:37.294708    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hpfnx_7cec939f-eacf-4254-abbd-75903f407f37/dns/0.log"
Jul 31 01:42:37.493707 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:37.493666    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hpfnx_7cec939f-eacf-4254-abbd-75903f407f37/kube-rbac-proxy/0.log"
Jul 31 01:42:37.893744 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:37.893718    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l4gcr_522b6666-22de-4d13-9794-07680e2375d6/dns-node-resolver/0.log"
Jul 31 01:42:38.293609 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:38.293540    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78d646dddb-6hkw9_03e216bb-cb12-4fb4-a9dd-a693daa5f657/router/0.log"
Jul 31 01:42:38.493375 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:38.493349    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-djswh_275216a4-fea3-4c16-bb45-425da974aa47/serve-healthcheck-canary/0.log"
Jul 31 01:42:41.416162 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:41.416123    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-749dc88778-z9gkf"
Jul 31 01:42:41.424728 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:42:41.424665    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-749dc88778-z9gkf"
Jul 31 01:43:21.062049 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.062009    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"]
Jul 31 01:43:21.064800 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.064780    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"
Jul 31 01:43:21.067396 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.067371    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qvhm7\""
Jul 31 01:43:21.067763 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.067741    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 31 01:43:21.067851 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.067832    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 31 01:43:21.067913 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.067884    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 31 01:43:21.067980 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.067841    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 31 01:43:21.068507 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.068206    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 31 01:43:21.078604 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.078575    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"]
Jul 31 01:43:21.079129 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.079104    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 31 01:43:21.164302 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.164261    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a60a9b09-5ec6-4b58-aeac-88ca6b97ea84-metrics-client-ca\") pod \"telemeter-client-5bb7c8956f-q9jb9\" (UID: \"a60a9b09-5ec6-4b58-aeac-88ca6b97ea84\") " pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"
Jul 31 01:43:21.164302 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.164301    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a60a9b09-5ec6-4b58-aeac-88ca6b97ea84-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bb7c8956f-q9jb9\" (UID: \"a60a9b09-5ec6-4b58-aeac-88ca6b97ea84\") " pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"
Jul 31 01:43:21.164530 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.164322    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a60a9b09-5ec6-4b58-aeac-88ca6b97ea84-telemeter-client-tls\") pod \"telemeter-client-5bb7c8956f-q9jb9\" (UID: \"a60a9b09-5ec6-4b58-aeac-88ca6b97ea84\") " pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"
Jul 31 01:43:21.164530 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.164344    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a60a9b09-5ec6-4b58-aeac-88ca6b97ea84-federate-client-tls\") pod \"telemeter-client-5bb7c8956f-q9jb9\" (UID: \"a60a9b09-5ec6-4b58-aeac-88ca6b97ea84\") " pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"
Jul 31 01:43:21.164530 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.164437    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gswbc\" (UniqueName: \"kubernetes.io/projected/a60a9b09-5ec6-4b58-aeac-88ca6b97ea84-kube-api-access-gswbc\") pod \"telemeter-client-5bb7c8956f-q9jb9\" (UID: \"a60a9b09-5ec6-4b58-aeac-88ca6b97ea84\") " pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"
Jul 31 01:43:21.164530 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.164481    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a60a9b09-5ec6-4b58-aeac-88ca6b97ea84-secret-telemeter-client\") pod \"telemeter-client-5bb7c8956f-q9jb9\" (UID: \"a60a9b09-5ec6-4b58-aeac-88ca6b97ea84\") " pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"
Jul 31 01:43:21.164530 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.164531    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a60a9b09-5ec6-4b58-aeac-88ca6b97ea84-serving-certs-ca-bundle\") pod \"telemeter-client-5bb7c8956f-q9jb9\" (UID: \"a60a9b09-5ec6-4b58-aeac-88ca6b97ea84\") " pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"
Jul 31 01:43:21.164689 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.164556    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a60a9b09-5ec6-4b58-aeac-88ca6b97ea84-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bb7c8956f-q9jb9\" (UID: \"a60a9b09-5ec6-4b58-aeac-88ca6b97ea84\") " pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"
Jul 31 01:43:21.265277 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.265232    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a60a9b09-5ec6-4b58-aeac-88ca6b97ea84-secret-telemeter-client\") pod \"telemeter-client-5bb7c8956f-q9jb9\" (UID: \"a60a9b09-5ec6-4b58-aeac-88ca6b97ea84\") " pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"
Jul 31 01:43:21.265277 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.265284    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a60a9b09-5ec6-4b58-aeac-88ca6b97ea84-serving-certs-ca-bundle\") pod \"telemeter-client-5bb7c8956f-q9jb9\" (UID: \"a60a9b09-5ec6-4b58-aeac-88ca6b97ea84\") " pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"
Jul 31 01:43:21.265542 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.265303    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a60a9b09-5ec6-4b58-aeac-88ca6b97ea84-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bb7c8956f-q9jb9\" (UID: \"a60a9b09-5ec6-4b58-aeac-88ca6b97ea84\") " pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"
Jul 31 01:43:21.265542 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.265342    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a60a9b09-5ec6-4b58-aeac-88ca6b97ea84-metrics-client-ca\") pod \"telemeter-client-5bb7c8956f-q9jb9\" (UID: \"a60a9b09-5ec6-4b58-aeac-88ca6b97ea84\") " pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"
Jul 31 01:43:21.265542 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.265363    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a60a9b09-5ec6-4b58-aeac-88ca6b97ea84-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bb7c8956f-q9jb9\" (UID: \"a60a9b09-5ec6-4b58-aeac-88ca6b97ea84\") " pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"
Jul 31 01:43:21.265542 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.265409    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a60a9b09-5ec6-4b58-aeac-88ca6b97ea84-telemeter-client-tls\") pod \"telemeter-client-5bb7c8956f-q9jb9\" (UID: \"a60a9b09-5ec6-4b58-aeac-88ca6b97ea84\") " pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"
Jul 31 01:43:21.265542 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.265444    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a60a9b09-5ec6-4b58-aeac-88ca6b97ea84-federate-client-tls\") pod \"telemeter-client-5bb7c8956f-q9jb9\" (UID: \"a60a9b09-5ec6-4b58-aeac-88ca6b97ea84\") " pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"
Jul 31 01:43:21.265542 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.265498    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gswbc\" (UniqueName: \"kubernetes.io/projected/a60a9b09-5ec6-4b58-aeac-88ca6b97ea84-kube-api-access-gswbc\") pod \"telemeter-client-5bb7c8956f-q9jb9\" (UID: \"a60a9b09-5ec6-4b58-aeac-88ca6b97ea84\") " pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"
Jul 31 01:43:21.266205 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.266178    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a60a9b09-5ec6-4b58-aeac-88ca6b97ea84-serving-certs-ca-bundle\") pod \"telemeter-client-5bb7c8956f-q9jb9\" (UID: \"a60a9b09-5ec6-4b58-aeac-88ca6b97ea84\") " pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"
Jul 31 01:43:21.266338 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.266267    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a60a9b09-5ec6-4b58-aeac-88ca6b97ea84-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bb7c8956f-q9jb9\" (UID: \"a60a9b09-5ec6-4b58-aeac-88ca6b97ea84\") " pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"
Jul 31 01:43:21.266564 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.266543    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a60a9b09-5ec6-4b58-aeac-88ca6b97ea84-metrics-client-ca\") pod \"telemeter-client-5bb7c8956f-q9jb9\" (UID: \"a60a9b09-5ec6-4b58-aeac-88ca6b97ea84\") " pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"
Jul 31 01:43:21.267950 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.267926    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a60a9b09-5ec6-4b58-aeac-88ca6b97ea84-secret-telemeter-client\") pod \"telemeter-client-5bb7c8956f-q9jb9\" (UID: \"a60a9b09-5ec6-4b58-aeac-88ca6b97ea84\") " pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"
Jul 31 01:43:21.268091 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.268069    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a60a9b09-5ec6-4b58-aeac-88ca6b97ea84-federate-client-tls\") pod \"telemeter-client-5bb7c8956f-q9jb9\" (UID: \"a60a9b09-5ec6-4b58-aeac-88ca6b97ea84\") " pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"
Jul 31 01:43:21.268207 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.268191    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a60a9b09-5ec6-4b58-aeac-88ca6b97ea84-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bb7c8956f-q9jb9\" (UID: \"a60a9b09-5ec6-4b58-aeac-88ca6b97ea84\") " pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"
Jul 31 01:43:21.268281 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.268258    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a60a9b09-5ec6-4b58-aeac-88ca6b97ea84-telemeter-client-tls\") pod \"telemeter-client-5bb7c8956f-q9jb9\" (UID: \"a60a9b09-5ec6-4b58-aeac-88ca6b97ea84\") " pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"
Jul 31 01:43:21.274290 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.274265    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gswbc\" (UniqueName: \"kubernetes.io/projected/a60a9b09-5ec6-4b58-aeac-88ca6b97ea84-kube-api-access-gswbc\") pod \"telemeter-client-5bb7c8956f-q9jb9\" (UID: \"a60a9b09-5ec6-4b58-aeac-88ca6b97ea84\") " pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"
Jul 31 01:43:21.380691 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.380664    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"
Jul 31 01:43:21.512707 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.512683    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9"]
Jul 31 01:43:21.514557 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:43:21.514534    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda60a9b09_5ec6_4b58_aeac_88ca6b97ea84.slice/crio-e7ac5b472efcad54e9b0c4f9f4662b922cfdcf845fce6f126d49add538c4ebbe WatchSource:0}: Error finding container e7ac5b472efcad54e9b0c4f9f4662b922cfdcf845fce6f126d49add538c4ebbe: Status 404 returned error can't find the container with id e7ac5b472efcad54e9b0c4f9f4662b922cfdcf845fce6f126d49add538c4ebbe
Jul 31 01:43:21.517185 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:21.517172    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 01:43:22.295565 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:22.295526    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9" event={"ID":"a60a9b09-5ec6-4b58-aeac-88ca6b97ea84","Type":"ContainerStarted","Data":"e7ac5b472efcad54e9b0c4f9f4662b922cfdcf845fce6f126d49add538c4ebbe"}
Jul 31 01:43:24.305173 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:24.305138    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9" event={"ID":"a60a9b09-5ec6-4b58-aeac-88ca6b97ea84","Type":"ContainerStarted","Data":"629cb559c936fdefca1d06a46269ad6e288688b9d157d9d8596f29a9e0d9405c"}
Jul 31 01:43:24.305604 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:24.305198    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9" event={"ID":"a60a9b09-5ec6-4b58-aeac-88ca6b97ea84","Type":"ContainerStarted","Data":"2ecf55bc70cc0b82072794db5c3ef7e6f5412c8a5e8dd707ac7624f80882fa30"}
Jul 31 01:43:24.305604 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:24.305217    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9" event={"ID":"a60a9b09-5ec6-4b58-aeac-88ca6b97ea84","Type":"ContainerStarted","Data":"5765a342b0a3a413792011f6927744410bef60a3da541cad77842c451aabbe81"}
Jul 31 01:43:24.328120 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:24.328071    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5bb7c8956f-q9jb9" podStartSLOduration=1.291172258 podStartE2EDuration="3.328055063s" totalImagesPullingTime="2.036882805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:43:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:43:24.326746215 +0000 UTC m=+364.906987213" watchObservedRunningTime="2026-07-31 01:43:24.328055063 +0000 UTC m=+364.908296059"
Jul 31 01:43:35.351218 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:43:35.351188    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ff495cd74-9v9qh"]
Jul 31 01:44:00.373516 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:00.373450    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6ff495cd74-9v9qh" podUID="2fba5ec7-8576-494a-b79c-7a52a71e44c0" containerName="console" containerID="cri-o://fb8885e8e368aaf473fadcbfbd9e3bc8e331cb46c8bf3f7d0b560dcc29824c52" gracePeriod=15
Jul 31 01:44:00.623070 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:00.623045    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:44:00.709368 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:00.709288    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fba5ec7-8576-494a-b79c-7a52a71e44c0-console-serving-cert\") pod \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\" (UID: \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\") "
Jul 31 01:44:00.709368 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:00.709341    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fba5ec7-8576-494a-b79c-7a52a71e44c0-console-oauth-config\") pod \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\" (UID: \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\") "
Jul 31 01:44:00.709368 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:00.709366    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fba5ec7-8576-494a-b79c-7a52a71e44c0-oauth-serving-cert\") pod \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\" (UID: \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\") "
Jul 31 01:44:00.709637 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:00.709391    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fba5ec7-8576-494a-b79c-7a52a71e44c0-service-ca\") pod \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\" (UID: \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\") "
Jul 31 01:44:00.709637 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:00.709407    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fba5ec7-8576-494a-b79c-7a52a71e44c0-trusted-ca-bundle\") pod \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\" (UID: \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\") "
Jul 31 01:44:00.709637 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:00.709448    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fba5ec7-8576-494a-b79c-7a52a71e44c0-console-config\") pod \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\" (UID: \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\") "
Jul 31 01:44:00.709637 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:00.709470    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbpcw\" (UniqueName: \"kubernetes.io/projected/2fba5ec7-8576-494a-b79c-7a52a71e44c0-kube-api-access-lbpcw\") pod \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\" (UID: \"2fba5ec7-8576-494a-b79c-7a52a71e44c0\") "
Jul 31 01:44:00.709885 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:00.709841    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fba5ec7-8576-494a-b79c-7a52a71e44c0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2fba5ec7-8576-494a-b79c-7a52a71e44c0" (UID: "2fba5ec7-8576-494a-b79c-7a52a71e44c0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:44:00.709967 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:00.709929    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fba5ec7-8576-494a-b79c-7a52a71e44c0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2fba5ec7-8576-494a-b79c-7a52a71e44c0" (UID: "2fba5ec7-8576-494a-b79c-7a52a71e44c0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:44:00.709967 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:00.709919    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fba5ec7-8576-494a-b79c-7a52a71e44c0-service-ca" (OuterVolumeSpecName: "service-ca") pod "2fba5ec7-8576-494a-b79c-7a52a71e44c0" (UID: "2fba5ec7-8576-494a-b79c-7a52a71e44c0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:44:00.710283 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:00.710253    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fba5ec7-8576-494a-b79c-7a52a71e44c0-console-config" (OuterVolumeSpecName: "console-config") pod "2fba5ec7-8576-494a-b79c-7a52a71e44c0" (UID: "2fba5ec7-8576-494a-b79c-7a52a71e44c0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:44:00.711682 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:00.711657    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fba5ec7-8576-494a-b79c-7a52a71e44c0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2fba5ec7-8576-494a-b79c-7a52a71e44c0" (UID: "2fba5ec7-8576-494a-b79c-7a52a71e44c0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 01:44:00.711682 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:00.711676    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fba5ec7-8576-494a-b79c-7a52a71e44c0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2fba5ec7-8576-494a-b79c-7a52a71e44c0" (UID: "2fba5ec7-8576-494a-b79c-7a52a71e44c0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 01:44:00.711805 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:00.711734    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fba5ec7-8576-494a-b79c-7a52a71e44c0-kube-api-access-lbpcw" (OuterVolumeSpecName: "kube-api-access-lbpcw") pod "2fba5ec7-8576-494a-b79c-7a52a71e44c0" (UID: "2fba5ec7-8576-494a-b79c-7a52a71e44c0"). InnerVolumeSpecName "kube-api-access-lbpcw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:44:00.810037 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:00.810005    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fba5ec7-8576-494a-b79c-7a52a71e44c0-console-config\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:44:00.810037 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:00.810028    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbpcw\" (UniqueName: \"kubernetes.io/projected/2fba5ec7-8576-494a-b79c-7a52a71e44c0-kube-api-access-lbpcw\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:44:00.810037 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:00.810037    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fba5ec7-8576-494a-b79c-7a52a71e44c0-console-serving-cert\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:44:00.810037 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:00.810046    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fba5ec7-8576-494a-b79c-7a52a71e44c0-console-oauth-config\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:44:00.810348 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:00.810057    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fba5ec7-8576-494a-b79c-7a52a71e44c0-oauth-serving-cert\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:44:00.810348 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:00.810066    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fba5ec7-8576-494a-b79c-7a52a71e44c0-service-ca\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:44:00.810348 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:00.810076    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fba5ec7-8576-494a-b79c-7a52a71e44c0-trusted-ca-bundle\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:44:01.459905 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:01.459870    2571 generic.go:356] "Generic (PLEG): container finished" podID="2fba5ec7-8576-494a-b79c-7a52a71e44c0" containerID="fb8885e8e368aaf473fadcbfbd9e3bc8e331cb46c8bf3f7d0b560dcc29824c52" exitCode=0
Jul 31 01:44:01.460445 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:01.459928    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff495cd74-9v9qh"
Jul 31 01:44:01.460445 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:01.459957    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff495cd74-9v9qh" event={"ID":"2fba5ec7-8576-494a-b79c-7a52a71e44c0","Type":"ContainerDied","Data":"fb8885e8e368aaf473fadcbfbd9e3bc8e331cb46c8bf3f7d0b560dcc29824c52"}
Jul 31 01:44:01.460445 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:01.460019    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff495cd74-9v9qh" event={"ID":"2fba5ec7-8576-494a-b79c-7a52a71e44c0","Type":"ContainerDied","Data":"855b785a550d5a6e562915b7846105e5e58bf070253a3fbb02773636e14fa4ed"}
Jul 31 01:44:01.460445 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:01.460052    2571 scope.go:117] "RemoveContainer" containerID="fb8885e8e368aaf473fadcbfbd9e3bc8e331cb46c8bf3f7d0b560dcc29824c52"
Jul 31 01:44:01.469092 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:01.469074    2571 scope.go:117] "RemoveContainer" containerID="fb8885e8e368aaf473fadcbfbd9e3bc8e331cb46c8bf3f7d0b560dcc29824c52"
Jul 31 01:44:01.469349 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:44:01.469331    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb8885e8e368aaf473fadcbfbd9e3bc8e331cb46c8bf3f7d0b560dcc29824c52\": container with ID starting with fb8885e8e368aaf473fadcbfbd9e3bc8e331cb46c8bf3f7d0b560dcc29824c52 not found: ID does not exist" containerID="fb8885e8e368aaf473fadcbfbd9e3bc8e331cb46c8bf3f7d0b560dcc29824c52"
Jul 31 01:44:01.469397 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:01.469357    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb8885e8e368aaf473fadcbfbd9e3bc8e331cb46c8bf3f7d0b560dcc29824c52"} err="failed to get container status \"fb8885e8e368aaf473fadcbfbd9e3bc8e331cb46c8bf3f7d0b560dcc29824c52\": rpc error: code = NotFound desc = could not find container \"fb8885e8e368aaf473fadcbfbd9e3bc8e331cb46c8bf3f7d0b560dcc29824c52\": container with ID starting with fb8885e8e368aaf473fadcbfbd9e3bc8e331cb46c8bf3f7d0b560dcc29824c52 not found: ID does not exist"
Jul 31 01:44:01.481759 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:01.481734    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ff495cd74-9v9qh"]
Jul 31 01:44:01.485658 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:01.485636    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6ff495cd74-9v9qh"]
Jul 31 01:44:01.992550 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:44:01.992513    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fba5ec7-8576-494a-b79c-7a52a71e44c0" path="/var/lib/kubelet/pods/2fba5ec7-8576-494a-b79c-7a52a71e44c0/volumes"
Jul 31 01:47:02.638904 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:02.638855    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7bf6d"]
Jul 31 01:47:02.639331 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:02.639176    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fba5ec7-8576-494a-b79c-7a52a71e44c0" containerName="console"
Jul 31 01:47:02.639331 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:02.639186    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fba5ec7-8576-494a-b79c-7a52a71e44c0" containerName="console"
Jul 31 01:47:02.639331 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:02.639253    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fba5ec7-8576-494a-b79c-7a52a71e44c0" containerName="console"
Jul 31 01:47:02.642085 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:02.642063    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7bf6d"
Jul 31 01:47:02.644417 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:02.644392    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 31 01:47:02.644417 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:02.644398    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-jmt25\""
Jul 31 01:47:02.645544 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:02.645526    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 31 01:47:02.651674 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:02.651649    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7bf6d"]
Jul 31 01:47:02.661427 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:02.661400    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh97w\" (UniqueName: \"kubernetes.io/projected/eb90837c-8841-4a5b-ac9e-62734e84f24d-kube-api-access-sh97w\") pod \"openshift-lws-operator-fd8ccff4c-7bf6d\" (UID: \"eb90837c-8841-4a5b-ac9e-62734e84f24d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7bf6d"
Jul 31 01:47:02.661567 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:02.661464    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb90837c-8841-4a5b-ac9e-62734e84f24d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7bf6d\" (UID: \"eb90837c-8841-4a5b-ac9e-62734e84f24d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7bf6d"
Jul 31 01:47:02.762680 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:02.762642    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh97w\" (UniqueName: \"kubernetes.io/projected/eb90837c-8841-4a5b-ac9e-62734e84f24d-kube-api-access-sh97w\") pod \"openshift-lws-operator-fd8ccff4c-7bf6d\" (UID: \"eb90837c-8841-4a5b-ac9e-62734e84f24d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7bf6d"
Jul 31 01:47:02.762883 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:02.762703    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb90837c-8841-4a5b-ac9e-62734e84f24d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7bf6d\" (UID: \"eb90837c-8841-4a5b-ac9e-62734e84f24d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7bf6d"
Jul 31 01:47:02.763068 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:02.763049    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb90837c-8841-4a5b-ac9e-62734e84f24d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7bf6d\" (UID: \"eb90837c-8841-4a5b-ac9e-62734e84f24d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7bf6d"
Jul 31 01:47:02.770601 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:02.770573    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh97w\" (UniqueName: \"kubernetes.io/projected/eb90837c-8841-4a5b-ac9e-62734e84f24d-kube-api-access-sh97w\") pod \"openshift-lws-operator-fd8ccff4c-7bf6d\" (UID: \"eb90837c-8841-4a5b-ac9e-62734e84f24d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7bf6d"
Jul 31 01:47:02.951429 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:02.951346    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7bf6d"
Jul 31 01:47:03.081540 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.081517    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7bf6d"]
Jul 31 01:47:03.083934 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:47:03.083888    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb90837c_8841_4a5b_ac9e_62734e84f24d.slice/crio-d4d84fdee875c2fe253ed4618c3798ca951a32b96f51fa91779b4103fc64f0e5 WatchSource:0}: Error finding container d4d84fdee875c2fe253ed4618c3798ca951a32b96f51fa91779b4103fc64f0e5: Status 404 returned error can't find the container with id d4d84fdee875c2fe253ed4618c3798ca951a32b96f51fa91779b4103fc64f0e5
Jul 31 01:47:03.160138 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.160101    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7bf6d" event={"ID":"eb90837c-8841-4a5b-ac9e-62734e84f24d","Type":"ContainerStarted","Data":"d4d84fdee875c2fe253ed4618c3798ca951a32b96f51fa91779b4103fc64f0e5"}
Jul 31 01:47:03.275493 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.275414    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6789d9cdbc-p8r68"]
Jul 31 01:47:03.279884 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.279863    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6789d9cdbc-p8r68"
Jul 31 01:47:03.285178 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.285156    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 31 01:47:03.285282 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.285186    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 31 01:47:03.286639 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.286600    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 31 01:47:03.286639 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.286636    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 31 01:47:03.286983 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.286653    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-k6fdc\""
Jul 31 01:47:03.286983 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.286759    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 31 01:47:03.286983 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.286871    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 31 01:47:03.287275 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.287151    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 31 01:47:03.291186 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.291168    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 31 01:47:03.305857 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.305832    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6789d9cdbc-p8r68"]
Jul 31 01:47:03.367676 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.367643    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/560907ba-2c4f-4a57-9df8-00df1b27ac28-trusted-ca-bundle\") pod \"console-6789d9cdbc-p8r68\" (UID: \"560907ba-2c4f-4a57-9df8-00df1b27ac28\") " pod="openshift-console/console-6789d9cdbc-p8r68"
Jul 31 01:47:03.367676 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.367681    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/560907ba-2c4f-4a57-9df8-00df1b27ac28-service-ca\") pod \"console-6789d9cdbc-p8r68\" (UID: \"560907ba-2c4f-4a57-9df8-00df1b27ac28\") " pod="openshift-console/console-6789d9cdbc-p8r68"
Jul 31 01:47:03.367954 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.367706    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/560907ba-2c4f-4a57-9df8-00df1b27ac28-console-serving-cert\") pod \"console-6789d9cdbc-p8r68\" (UID: \"560907ba-2c4f-4a57-9df8-00df1b27ac28\") " pod="openshift-console/console-6789d9cdbc-p8r68"
Jul 31 01:47:03.367954 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.367751    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkqk9\" (UniqueName: \"kubernetes.io/projected/560907ba-2c4f-4a57-9df8-00df1b27ac28-kube-api-access-zkqk9\") pod \"console-6789d9cdbc-p8r68\" (UID: \"560907ba-2c4f-4a57-9df8-00df1b27ac28\") " pod="openshift-console/console-6789d9cdbc-p8r68"
Jul 31 01:47:03.367954 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.367811    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/560907ba-2c4f-4a57-9df8-00df1b27ac28-console-config\") pod \"console-6789d9cdbc-p8r68\" (UID: \"560907ba-2c4f-4a57-9df8-00df1b27ac28\") " pod="openshift-console/console-6789d9cdbc-p8r68"
Jul 31 01:47:03.367954 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.367838    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/560907ba-2c4f-4a57-9df8-00df1b27ac28-console-oauth-config\") pod \"console-6789d9cdbc-p8r68\" (UID: \"560907ba-2c4f-4a57-9df8-00df1b27ac28\") " pod="openshift-console/console-6789d9cdbc-p8r68"
Jul 31 01:47:03.367954 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.367875    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/560907ba-2c4f-4a57-9df8-00df1b27ac28-oauth-serving-cert\") pod \"console-6789d9cdbc-p8r68\" (UID: \"560907ba-2c4f-4a57-9df8-00df1b27ac28\") " pod="openshift-console/console-6789d9cdbc-p8r68"
Jul 31 01:47:03.468814 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.468777    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/560907ba-2c4f-4a57-9df8-00df1b27ac28-oauth-serving-cert\") pod \"console-6789d9cdbc-p8r68\" (UID: \"560907ba-2c4f-4a57-9df8-00df1b27ac28\") " pod="openshift-console/console-6789d9cdbc-p8r68"
Jul 31 01:47:03.469020 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.468846    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/560907ba-2c4f-4a57-9df8-00df1b27ac28-trusted-ca-bundle\") pod \"console-6789d9cdbc-p8r68\" (UID: \"560907ba-2c4f-4a57-9df8-00df1b27ac28\") " pod="openshift-console/console-6789d9cdbc-p8r68"
Jul 31 01:47:03.469020 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.468886    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/560907ba-2c4f-4a57-9df8-00df1b27ac28-service-ca\") pod \"console-6789d9cdbc-p8r68\" (UID: \"560907ba-2c4f-4a57-9df8-00df1b27ac28\") " pod="openshift-console/console-6789d9cdbc-p8r68"
Jul 31 01:47:03.469159 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.469080    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/560907ba-2c4f-4a57-9df8-00df1b27ac28-console-serving-cert\") pod \"console-6789d9cdbc-p8r68\" (UID: \"560907ba-2c4f-4a57-9df8-00df1b27ac28\") " pod="openshift-console/console-6789d9cdbc-p8r68"
Jul 31 01:47:03.469159 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.469110    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkqk9\" (UniqueName: \"kubernetes.io/projected/560907ba-2c4f-4a57-9df8-00df1b27ac28-kube-api-access-zkqk9\") pod \"console-6789d9cdbc-p8r68\" (UID: \"560907ba-2c4f-4a57-9df8-00df1b27ac28\") " pod="openshift-console/console-6789d9cdbc-p8r68"
Jul 31 01:47:03.469265 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.469157    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/560907ba-2c4f-4a57-9df8-00df1b27ac28-console-config\") pod \"console-6789d9cdbc-p8r68\" (UID: \"560907ba-2c4f-4a57-9df8-00df1b27ac28\") " pod="openshift-console/console-6789d9cdbc-p8r68"
Jul 31 01:47:03.469265 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.469194    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/560907ba-2c4f-4a57-9df8-00df1b27ac28-console-oauth-config\") pod \"console-6789d9cdbc-p8r68\" (UID: \"560907ba-2c4f-4a57-9df8-00df1b27ac28\") " pod="openshift-console/console-6789d9cdbc-p8r68"
Jul 31 01:47:03.469659 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.469632    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/560907ba-2c4f-4a57-9df8-00df1b27ac28-service-ca\") pod \"console-6789d9cdbc-p8r68\" (UID: \"560907ba-2c4f-4a57-9df8-00df1b27ac28\") " pod="openshift-console/console-6789d9cdbc-p8r68"
Jul 31 01:47:03.469777 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.469637    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/560907ba-2c4f-4a57-9df8-00df1b27ac28-oauth-serving-cert\") pod \"console-6789d9cdbc-p8r68\" (UID: \"560907ba-2c4f-4a57-9df8-00df1b27ac28\") " pod="openshift-console/console-6789d9cdbc-p8r68"
Jul 31 01:47:03.469847 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.469809    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/560907ba-2c4f-4a57-9df8-00df1b27ac28-trusted-ca-bundle\") pod \"console-6789d9cdbc-p8r68\" (UID: \"560907ba-2c4f-4a57-9df8-00df1b27ac28\") " pod="openshift-console/console-6789d9cdbc-p8r68"
Jul 31 01:47:03.469919 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.469886    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/560907ba-2c4f-4a57-9df8-00df1b27ac28-console-config\") pod \"console-6789d9cdbc-p8r68\" (UID: \"560907ba-2c4f-4a57-9df8-00df1b27ac28\") " pod="openshift-console/console-6789d9cdbc-p8r68"
Jul 31 01:47:03.471786 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.471764    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/560907ba-2c4f-4a57-9df8-00df1b27ac28-console-serving-cert\") pod \"console-6789d9cdbc-p8r68\" (UID: \"560907ba-2c4f-4a57-9df8-00df1b27ac28\") " pod="openshift-console/console-6789d9cdbc-p8r68"
Jul 31 01:47:03.471888 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.471820    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/560907ba-2c4f-4a57-9df8-00df1b27ac28-console-oauth-config\") pod \"console-6789d9cdbc-p8r68\" (UID: \"560907ba-2c4f-4a57-9df8-00df1b27ac28\") " pod="openshift-console/console-6789d9cdbc-p8r68"
Jul 31 01:47:03.476788 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.476765    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkqk9\" (UniqueName: \"kubernetes.io/projected/560907ba-2c4f-4a57-9df8-00df1b27ac28-kube-api-access-zkqk9\") pod \"console-6789d9cdbc-p8r68\" (UID: \"560907ba-2c4f-4a57-9df8-00df1b27ac28\") " pod="openshift-console/console-6789d9cdbc-p8r68"
Jul 31 01:47:03.589632 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.589544    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6789d9cdbc-p8r68"
Jul 31 01:47:03.721453 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:03.721423    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6789d9cdbc-p8r68"]
Jul 31 01:47:03.724747 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:47:03.724723    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod560907ba_2c4f_4a57_9df8_00df1b27ac28.slice/crio-65e4319f7079e58e5eae01ebfae5c6c15fb68800ea0212c52c9418a0731eab57 WatchSource:0}: Error finding container 65e4319f7079e58e5eae01ebfae5c6c15fb68800ea0212c52c9418a0731eab57: Status 404 returned error can't find the container with id 65e4319f7079e58e5eae01ebfae5c6c15fb68800ea0212c52c9418a0731eab57
Jul 31 01:47:04.167963 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:04.167922    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6789d9cdbc-p8r68" event={"ID":"560907ba-2c4f-4a57-9df8-00df1b27ac28","Type":"ContainerStarted","Data":"a75fae70a5c9c02bd1c716cf9b47a7cb2ffa4f8f2cdd99db3e400733a7b39074"}
Jul 31 01:47:04.168152 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:04.167982    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6789d9cdbc-p8r68" event={"ID":"560907ba-2c4f-4a57-9df8-00df1b27ac28","Type":"ContainerStarted","Data":"65e4319f7079e58e5eae01ebfae5c6c15fb68800ea0212c52c9418a0731eab57"}
Jul 31 01:47:04.186078 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:04.186005    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6789d9cdbc-p8r68" podStartSLOduration=1.185985074 podStartE2EDuration="1.185985074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:47:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:47:04.185684533 +0000 UTC m=+584.765925509" watchObservedRunningTime="2026-07-31 01:47:04.185985074 +0000 UTC m=+584.766226071"
Jul 31 01:47:06.178678 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:06.178639    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7bf6d" event={"ID":"eb90837c-8841-4a5b-ac9e-62734e84f24d","Type":"ContainerStarted","Data":"f50e18a1fbe860a6b29e6e9fd28dc7de6910d745958335b284c65ccab71f4b09"}
Jul 31 01:47:06.195188 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:06.195141    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7bf6d" podStartSLOduration=1.613343502 podStartE2EDuration="4.195126354s" totalImagesPullingTime="2.581782852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:47:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:47:06.19441493 +0000 UTC m=+586.774655927" watchObservedRunningTime="2026-07-31 01:47:06.195126354 +0000 UTC m=+586.775367348"
Jul 31 01:47:13.590598 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:13.590557    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6789d9cdbc-p8r68"
Jul 31 01:47:13.591014 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:13.590618    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6789d9cdbc-p8r68"
Jul 31 01:47:13.595327 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:13.595304    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6789d9cdbc-p8r68"
Jul 31 01:47:14.215969 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:14.215942    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6789d9cdbc-p8r68"
Jul 31 01:47:25.956709 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:25.956672    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77df9dc58b-8bq85"]
Jul 31 01:47:25.960184 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:25.960168    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-8bq85"
Jul 31 01:47:25.962946 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:25.962921    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 31 01:47:25.963065 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:25.962985    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 31 01:47:25.963065 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:25.962995    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-r7hfn\""
Jul 31 01:47:25.963065 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:25.962985    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 31 01:47:25.963065 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:25.963057    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 31 01:47:25.975237 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:25.975216    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77df9dc58b-8bq85"]
Jul 31 01:47:26.074252 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:26.074219    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzndt\" (UniqueName: \"kubernetes.io/projected/477eada6-4571-4d0d-9150-35d28d5f40b9-kube-api-access-qzndt\") pod \"opendatahub-operator-controller-manager-77df9dc58b-8bq85\" (UID: \"477eada6-4571-4d0d-9150-35d28d5f40b9\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-8bq85"
Jul 31 01:47:26.074438 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:26.074286    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/477eada6-4571-4d0d-9150-35d28d5f40b9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77df9dc58b-8bq85\" (UID: \"477eada6-4571-4d0d-9150-35d28d5f40b9\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-8bq85"
Jul 31 01:47:26.074438 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:26.074312    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/477eada6-4571-4d0d-9150-35d28d5f40b9-webhook-cert\") pod \"opendatahub-operator-controller-manager-77df9dc58b-8bq85\" (UID: \"477eada6-4571-4d0d-9150-35d28d5f40b9\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-8bq85"
Jul 31 01:47:26.074438 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:26.074344    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/477eada6-4571-4d0d-9150-35d28d5f40b9-tmp\") pod \"opendatahub-operator-controller-manager-77df9dc58b-8bq85\" (UID: \"477eada6-4571-4d0d-9150-35d28d5f40b9\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-8bq85"
Jul 31 01:47:26.074438 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:26.074426    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/477eada6-4571-4d0d-9150-35d28d5f40b9-manifests\") pod \"opendatahub-operator-controller-manager-77df9dc58b-8bq85\" (UID: \"477eada6-4571-4d0d-9150-35d28d5f40b9\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-8bq85"
Jul 31 01:47:26.175630 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:26.175589    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/477eada6-4571-4d0d-9150-35d28d5f40b9-manifests\") pod \"opendatahub-operator-controller-manager-77df9dc58b-8bq85\" (UID: \"477eada6-4571-4d0d-9150-35d28d5f40b9\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-8bq85"
Jul 31 01:47:26.175799 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:26.175670    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzndt\" (UniqueName: \"kubernetes.io/projected/477eada6-4571-4d0d-9150-35d28d5f40b9-kube-api-access-qzndt\") pod \"opendatahub-operator-controller-manager-77df9dc58b-8bq85\" (UID: \"477eada6-4571-4d0d-9150-35d28d5f40b9\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-8bq85"
Jul 31 01:47:26.175799 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:26.175722    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/477eada6-4571-4d0d-9150-35d28d5f40b9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77df9dc58b-8bq85\" (UID: \"477eada6-4571-4d0d-9150-35d28d5f40b9\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-8bq85"
Jul 31 01:47:26.175799 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:26.175746    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/477eada6-4571-4d0d-9150-35d28d5f40b9-webhook-cert\") pod \"opendatahub-operator-controller-manager-77df9dc58b-8bq85\" (UID: \"477eada6-4571-4d0d-9150-35d28d5f40b9\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-8bq85"
Jul 31 01:47:26.175799 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:26.175779    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/477eada6-4571-4d0d-9150-35d28d5f40b9-tmp\") pod \"opendatahub-operator-controller-manager-77df9dc58b-8bq85\" (UID: \"477eada6-4571-4d0d-9150-35d28d5f40b9\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-8bq85"
Jul 31 01:47:26.176103 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:26.176079    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/477eada6-4571-4d0d-9150-35d28d5f40b9-manifests\") pod \"opendatahub-operator-controller-manager-77df9dc58b-8bq85\" (UID: \"477eada6-4571-4d0d-9150-35d28d5f40b9\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-8bq85"
Jul 31 01:47:26.177999 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:26.177973    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/477eada6-4571-4d0d-9150-35d28d5f40b9-tmp\") pod \"opendatahub-operator-controller-manager-77df9dc58b-8bq85\" (UID: \"477eada6-4571-4d0d-9150-35d28d5f40b9\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-8bq85"
Jul 31 01:47:26.178256 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:26.178240    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/477eada6-4571-4d0d-9150-35d28d5f40b9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77df9dc58b-8bq85\" (UID: \"477eada6-4571-4d0d-9150-35d28d5f40b9\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-8bq85"
Jul 31 01:47:26.178341 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:26.178288    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/477eada6-4571-4d0d-9150-35d28d5f40b9-webhook-cert\") pod \"opendatahub-operator-controller-manager-77df9dc58b-8bq85\" (UID: \"477eada6-4571-4d0d-9150-35d28d5f40b9\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-8bq85"
Jul 31 01:47:26.187757 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:26.187732    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzndt\" (UniqueName: \"kubernetes.io/projected/477eada6-4571-4d0d-9150-35d28d5f40b9-kube-api-access-qzndt\") pod \"opendatahub-operator-controller-manager-77df9dc58b-8bq85\" (UID: \"477eada6-4571-4d0d-9150-35d28d5f40b9\") " pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-8bq85"
Jul 31 01:47:26.271294 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:26.271215    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-8bq85"
Jul 31 01:47:26.430698 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:26.427827    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77df9dc58b-8bq85"]
Jul 31 01:47:26.435279 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:47:26.435251    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod477eada6_4571_4d0d_9150_35d28d5f40b9.slice/crio-5469c13693a26a6991fdc72bf6936405c6cfb50b28322f02a588e1f857083a2d WatchSource:0}: Error finding container 5469c13693a26a6991fdc72bf6936405c6cfb50b28322f02a588e1f857083a2d: Status 404 returned error can't find the container with id 5469c13693a26a6991fdc72bf6936405c6cfb50b28322f02a588e1f857083a2d
Jul 31 01:47:27.265748 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:27.265703    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-8bq85" event={"ID":"477eada6-4571-4d0d-9150-35d28d5f40b9","Type":"ContainerStarted","Data":"5469c13693a26a6991fdc72bf6936405c6cfb50b28322f02a588e1f857083a2d"}
Jul 31 01:47:30.283341 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:30.283301    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-8bq85" event={"ID":"477eada6-4571-4d0d-9150-35d28d5f40b9","Type":"ContainerStarted","Data":"13802db7b24b92805b18e004643fe350e656608190f39c1e5f155368a8a628e3"}
Jul 31 01:47:31.288685 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:31.288649    2571 generic.go:356] "Generic (PLEG): container finished" podID="477eada6-4571-4d0d-9150-35d28d5f40b9" containerID="13802db7b24b92805b18e004643fe350e656608190f39c1e5f155368a8a628e3" exitCode=0
Jul 31 01:47:31.289085 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:31.288720    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-8bq85" event={"ID":"477eada6-4571-4d0d-9150-35d28d5f40b9","Type":"ContainerDied","Data":"13802db7b24b92805b18e004643fe350e656608190f39c1e5f155368a8a628e3"}
Jul 31 01:47:32.296406 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:32.296365    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-8bq85" event={"ID":"477eada6-4571-4d0d-9150-35d28d5f40b9","Type":"ContainerStarted","Data":"5269b050b795e5e77f5ec1672de73d5e396b21ede47d6506e7c7d985c5cf9022"}
Jul 31 01:47:32.296799 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:32.296510    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-8bq85"
Jul 31 01:47:32.317747 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:32.317684    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-8bq85" podStartSLOduration=2.923781393 podStartE2EDuration="7.317659968s" totalImagesPullingTime="3.37131326s" totalInitContainerRuntime="1.022565315s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:47:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:47:32.315603199 +0000 UTC m=+612.895844203" watchObservedRunningTime="2026-07-31 01:47:32.317659968 +0000 UTC m=+612.897900963"
Jul 31 01:47:43.302923 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:43.302831    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-77df9dc58b-8bq85"
Jul 31 01:47:51.586085 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:51.586049    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-647dc4ddc5-4g7zg"]
Jul 31 01:47:51.589252 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:51.589238    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-647dc4ddc5-4g7zg"
Jul 31 01:47:51.592481 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:51.592460    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 31 01:47:51.592588 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:51.592503    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-bfkdz\""
Jul 31 01:47:51.592588 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:51.592464    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 31 01:47:51.602961 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:51.602876    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-647dc4ddc5-4g7zg"]
Jul 31 01:47:51.697020 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:51.696990    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d0f53f2-f485-47c8-ac3c-a68e2b5fe382-tmp\") pod \"kube-auth-proxy-647dc4ddc5-4g7zg\" (UID: \"8d0f53f2-f485-47c8-ac3c-a68e2b5fe382\") " pod="openshift-ingress/kube-auth-proxy-647dc4ddc5-4g7zg"
Jul 31 01:47:51.697175 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:51.697054    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d0f53f2-f485-47c8-ac3c-a68e2b5fe382-tls-certs\") pod \"kube-auth-proxy-647dc4ddc5-4g7zg\" (UID: \"8d0f53f2-f485-47c8-ac3c-a68e2b5fe382\") " pod="openshift-ingress/kube-auth-proxy-647dc4ddc5-4g7zg"
Jul 31 01:47:51.697175 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:51.697118    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25qwt\" (UniqueName: \"kubernetes.io/projected/8d0f53f2-f485-47c8-ac3c-a68e2b5fe382-kube-api-access-25qwt\") pod \"kube-auth-proxy-647dc4ddc5-4g7zg\" (UID: \"8d0f53f2-f485-47c8-ac3c-a68e2b5fe382\") " pod="openshift-ingress/kube-auth-proxy-647dc4ddc5-4g7zg"
Jul 31 01:47:51.729863 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:51.729824    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-n2p4d"]
Jul 31 01:47:51.733045 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:51.733025    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-n2p4d"
Jul 31 01:47:51.735568 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:51.735547    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-49n4r\""
Jul 31 01:47:51.735744 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:51.735727    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 31 01:47:51.746241 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:51.746216    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-n2p4d"]
Jul 31 01:47:51.798368 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:51.798331    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k89wk\" (UniqueName: \"kubernetes.io/projected/1af1fd09-ca7c-4981-a5a5-e1070360071c-kube-api-access-k89wk\") pod \"odh-model-controller-7998c67dc4-n2p4d\" (UID: \"1af1fd09-ca7c-4981-a5a5-e1070360071c\") " pod="opendatahub/odh-model-controller-7998c67dc4-n2p4d"
Jul 31 01:47:51.798523 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:51.798392    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d0f53f2-f485-47c8-ac3c-a68e2b5fe382-tmp\") pod \"kube-auth-proxy-647dc4ddc5-4g7zg\" (UID: \"8d0f53f2-f485-47c8-ac3c-a68e2b5fe382\") " pod="openshift-ingress/kube-auth-proxy-647dc4ddc5-4g7zg"
Jul 31 01:47:51.798523 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:51.798485    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d0f53f2-f485-47c8-ac3c-a68e2b5fe382-tls-certs\") pod \"kube-auth-proxy-647dc4ddc5-4g7zg\" (UID: \"8d0f53f2-f485-47c8-ac3c-a68e2b5fe382\") " pod="openshift-ingress/kube-auth-proxy-647dc4ddc5-4g7zg"
Jul 31 01:47:51.798523 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:51.798518    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1af1fd09-ca7c-4981-a5a5-e1070360071c-cert\") pod \"odh-model-controller-7998c67dc4-n2p4d\" (UID: \"1af1fd09-ca7c-4981-a5a5-e1070360071c\") " pod="opendatahub/odh-model-controller-7998c67dc4-n2p4d"
Jul 31 01:47:51.798696 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:51.798564    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25qwt\" (UniqueName: \"kubernetes.io/projected/8d0f53f2-f485-47c8-ac3c-a68e2b5fe382-kube-api-access-25qwt\") pod \"kube-auth-proxy-647dc4ddc5-4g7zg\" (UID: \"8d0f53f2-f485-47c8-ac3c-a68e2b5fe382\") " pod="openshift-ingress/kube-auth-proxy-647dc4ddc5-4g7zg"
Jul 31 01:47:51.800808 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:51.800776    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d0f53f2-f485-47c8-ac3c-a68e2b5fe382-tmp\") pod \"kube-auth-proxy-647dc4ddc5-4g7zg\" (UID: \"8d0f53f2-f485-47c8-ac3c-a68e2b5fe382\") " pod="openshift-ingress/kube-auth-proxy-647dc4ddc5-4g7zg"
Jul 31 01:47:51.801062 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:51.800965    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d0f53f2-f485-47c8-ac3c-a68e2b5fe382-tls-certs\") pod \"kube-auth-proxy-647dc4ddc5-4g7zg\" (UID: \"8d0f53f2-f485-47c8-ac3c-a68e2b5fe382\") " pod="openshift-ingress/kube-auth-proxy-647dc4ddc5-4g7zg"
Jul 31 01:47:51.805974 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:51.805951    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25qwt\" (UniqueName: \"kubernetes.io/projected/8d0f53f2-f485-47c8-ac3c-a68e2b5fe382-kube-api-access-25qwt\") pod \"kube-auth-proxy-647dc4ddc5-4g7zg\" (UID: \"8d0f53f2-f485-47c8-ac3c-a68e2b5fe382\") " pod="openshift-ingress/kube-auth-proxy-647dc4ddc5-4g7zg"
Jul 31 01:47:51.899000 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:51.898968    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-647dc4ddc5-4g7zg"
Jul 31 01:47:51.899241 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:51.899220    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1af1fd09-ca7c-4981-a5a5-e1070360071c-cert\") pod \"odh-model-controller-7998c67dc4-n2p4d\" (UID: \"1af1fd09-ca7c-4981-a5a5-e1070360071c\") " pod="opendatahub/odh-model-controller-7998c67dc4-n2p4d"
Jul 31 01:47:51.899299 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:51.899287    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k89wk\" (UniqueName: \"kubernetes.io/projected/1af1fd09-ca7c-4981-a5a5-e1070360071c-kube-api-access-k89wk\") pod \"odh-model-controller-7998c67dc4-n2p4d\" (UID: \"1af1fd09-ca7c-4981-a5a5-e1070360071c\") " pod="opendatahub/odh-model-controller-7998c67dc4-n2p4d"
Jul 31 01:47:51.899389 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:47:51.899369    2571 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 31 01:47:51.899442 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:47:51.899433    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1af1fd09-ca7c-4981-a5a5-e1070360071c-cert podName:1af1fd09-ca7c-4981-a5a5-e1070360071c nodeName:}" failed. No retries permitted until 2026-07-31 01:47:52.39941651 +0000 UTC m=+632.979657483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1af1fd09-ca7c-4981-a5a5-e1070360071c-cert") pod "odh-model-controller-7998c67dc4-n2p4d" (UID: "1af1fd09-ca7c-4981-a5a5-e1070360071c") : secret "odh-model-controller-webhook-cert" not found
Jul 31 01:47:51.909236 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:51.909210    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k89wk\" (UniqueName: \"kubernetes.io/projected/1af1fd09-ca7c-4981-a5a5-e1070360071c-kube-api-access-k89wk\") pod \"odh-model-controller-7998c67dc4-n2p4d\" (UID: \"1af1fd09-ca7c-4981-a5a5-e1070360071c\") " pod="opendatahub/odh-model-controller-7998c67dc4-n2p4d"
Jul 31 01:47:52.030958 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.030929    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-647dc4ddc5-4g7zg"]
Jul 31 01:47:52.032666 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:47:52.032638    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d0f53f2_f485_47c8_ac3c_a68e2b5fe382.slice/crio-1eae8526902dc5a5fa56fd7cc000127279008c67115953e898e50cc21cab75d0 WatchSource:0}: Error finding container 1eae8526902dc5a5fa56fd7cc000127279008c67115953e898e50cc21cab75d0: Status 404 returned error can't find the container with id 1eae8526902dc5a5fa56fd7cc000127279008c67115953e898e50cc21cab75d0
Jul 31 01:47:52.387427 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.387394    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-647dc4ddc5-4g7zg" event={"ID":"8d0f53f2-f485-47c8-ac3c-a68e2b5fe382","Type":"ContainerStarted","Data":"1eae8526902dc5a5fa56fd7cc000127279008c67115953e898e50cc21cab75d0"}
Jul 31 01:47:52.404051 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.404018    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1af1fd09-ca7c-4981-a5a5-e1070360071c-cert\") pod \"odh-model-controller-7998c67dc4-n2p4d\" (UID: \"1af1fd09-ca7c-4981-a5a5-e1070360071c\") " pod="opendatahub/odh-model-controller-7998c67dc4-n2p4d"
Jul 31 01:47:52.406300 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.406277    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1af1fd09-ca7c-4981-a5a5-e1070360071c-cert\") pod \"odh-model-controller-7998c67dc4-n2p4d\" (UID: \"1af1fd09-ca7c-4981-a5a5-e1070360071c\") " pod="opendatahub/odh-model-controller-7998c67dc4-n2p4d"
Jul 31 01:47:52.458753 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.458721    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-drmhh"]
Jul 31 01:47:52.463279 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.463262    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-drmhh"
Jul 31 01:47:52.466069 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.466051    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 31 01:47:52.473465 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.473442    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-drmhh"]
Jul 31 01:47:52.505194 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.505165    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b60fa90c-c0af-43d1-8e91-23eceb898f0e-tls-certs\") pod \"model-serving-api-54d89bd5fc-drmhh\" (UID: \"b60fa90c-c0af-43d1-8e91-23eceb898f0e\") " pod="opendatahub/model-serving-api-54d89bd5fc-drmhh"
Jul 31 01:47:52.505311 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.505209    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvmkv\" (UniqueName: \"kubernetes.io/projected/b60fa90c-c0af-43d1-8e91-23eceb898f0e-kube-api-access-zvmkv\") pod \"model-serving-api-54d89bd5fc-drmhh\" (UID: \"b60fa90c-c0af-43d1-8e91-23eceb898f0e\") " pod="opendatahub/model-serving-api-54d89bd5fc-drmhh"
Jul 31 01:47:52.606381 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.606347    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b60fa90c-c0af-43d1-8e91-23eceb898f0e-tls-certs\") pod \"model-serving-api-54d89bd5fc-drmhh\" (UID: \"b60fa90c-c0af-43d1-8e91-23eceb898f0e\") " pod="opendatahub/model-serving-api-54d89bd5fc-drmhh"
Jul 31 01:47:52.606782 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.606393    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvmkv\" (UniqueName: \"kubernetes.io/projected/b60fa90c-c0af-43d1-8e91-23eceb898f0e-kube-api-access-zvmkv\") pod \"model-serving-api-54d89bd5fc-drmhh\" (UID: \"b60fa90c-c0af-43d1-8e91-23eceb898f0e\") " pod="opendatahub/model-serving-api-54d89bd5fc-drmhh"
Jul 31 01:47:52.608723 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.608703    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b60fa90c-c0af-43d1-8e91-23eceb898f0e-tls-certs\") pod \"model-serving-api-54d89bd5fc-drmhh\" (UID: \"b60fa90c-c0af-43d1-8e91-23eceb898f0e\") " pod="opendatahub/model-serving-api-54d89bd5fc-drmhh"
Jul 31 01:47:52.614675 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.614648    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvmkv\" (UniqueName: \"kubernetes.io/projected/b60fa90c-c0af-43d1-8e91-23eceb898f0e-kube-api-access-zvmkv\") pod \"model-serving-api-54d89bd5fc-drmhh\" (UID: \"b60fa90c-c0af-43d1-8e91-23eceb898f0e\") " pod="opendatahub/model-serving-api-54d89bd5fc-drmhh"
Jul 31 01:47:52.646339 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.646260    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-n2p4d"
Jul 31 01:47:52.671007 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.670976    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"]
Jul 31 01:47:52.678654 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.678629    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"
Jul 31 01:47:52.681522 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.681476    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 31 01:47:52.681522 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.681505    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 31 01:47:52.681923 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.681754    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-ms5gd\""
Jul 31 01:47:52.681923 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.681856    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 31 01:47:52.682271 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.682196    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 31 01:47:52.685032 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.684977    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"]
Jul 31 01:47:52.707187 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.707133    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/013fe25d-2429-4866-8735-66bf7d6a3638-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-kvfvg\" (UID: \"013fe25d-2429-4866-8735-66bf7d6a3638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"
Jul 31 01:47:52.707349 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.707197    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/013fe25d-2429-4866-8735-66bf7d6a3638-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-kvfvg\" (UID: \"013fe25d-2429-4866-8735-66bf7d6a3638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"
Jul 31 01:47:52.707349 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.707233    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/013fe25d-2429-4866-8735-66bf7d6a3638-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-kvfvg\" (UID: \"013fe25d-2429-4866-8735-66bf7d6a3638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"
Jul 31 01:47:52.707349 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.707292    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd46s\" (UniqueName: \"kubernetes.io/projected/013fe25d-2429-4866-8735-66bf7d6a3638-kube-api-access-kd46s\") pod \"istiod-openshift-gateway-7b7995d5cd-kvfvg\" (UID: \"013fe25d-2429-4866-8735-66bf7d6a3638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"
Jul 31 01:47:52.707349 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.707333    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/013fe25d-2429-4866-8735-66bf7d6a3638-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-kvfvg\" (UID: \"013fe25d-2429-4866-8735-66bf7d6a3638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"
Jul 31 01:47:52.707577 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.707400    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/013fe25d-2429-4866-8735-66bf7d6a3638-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-kvfvg\" (UID: \"013fe25d-2429-4866-8735-66bf7d6a3638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"
Jul 31 01:47:52.707577 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.707455    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/013fe25d-2429-4866-8735-66bf7d6a3638-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-kvfvg\" (UID: \"013fe25d-2429-4866-8735-66bf7d6a3638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"
Jul 31 01:47:52.775530 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.775490    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-drmhh"
Jul 31 01:47:52.809926 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.808639    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/013fe25d-2429-4866-8735-66bf7d6a3638-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-kvfvg\" (UID: \"013fe25d-2429-4866-8735-66bf7d6a3638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"
Jul 31 01:47:52.809926 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.808690    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/013fe25d-2429-4866-8735-66bf7d6a3638-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-kvfvg\" (UID: \"013fe25d-2429-4866-8735-66bf7d6a3638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"
Jul 31 01:47:52.809926 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.808725    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/013fe25d-2429-4866-8735-66bf7d6a3638-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-kvfvg\" (UID: \"013fe25d-2429-4866-8735-66bf7d6a3638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"
Jul 31 01:47:52.809926 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.808757    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd46s\" (UniqueName: \"kubernetes.io/projected/013fe25d-2429-4866-8735-66bf7d6a3638-kube-api-access-kd46s\") pod \"istiod-openshift-gateway-7b7995d5cd-kvfvg\" (UID: \"013fe25d-2429-4866-8735-66bf7d6a3638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"
Jul 31 01:47:52.809926 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.808798    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/013fe25d-2429-4866-8735-66bf7d6a3638-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-kvfvg\" (UID: \"013fe25d-2429-4866-8735-66bf7d6a3638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"
Jul 31 01:47:52.809926 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.808864    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/013fe25d-2429-4866-8735-66bf7d6a3638-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-kvfvg\" (UID: \"013fe25d-2429-4866-8735-66bf7d6a3638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"
Jul 31 01:47:52.809926 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.808920    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/013fe25d-2429-4866-8735-66bf7d6a3638-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-kvfvg\" (UID: \"013fe25d-2429-4866-8735-66bf7d6a3638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"
Jul 31 01:47:52.809926 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.809098    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-n2p4d"]
Jul 31 01:47:52.809926 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.809860    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/013fe25d-2429-4866-8735-66bf7d6a3638-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-kvfvg\" (UID: \"013fe25d-2429-4866-8735-66bf7d6a3638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"
Jul 31 01:47:52.812192 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.812168    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/013fe25d-2429-4866-8735-66bf7d6a3638-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-kvfvg\" (UID: \"013fe25d-2429-4866-8735-66bf7d6a3638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"
Jul 31 01:47:52.813480 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.813442    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/013fe25d-2429-4866-8735-66bf7d6a3638-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-kvfvg\" (UID: \"013fe25d-2429-4866-8735-66bf7d6a3638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"
Jul 31 01:47:52.814502 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.814477    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/013fe25d-2429-4866-8735-66bf7d6a3638-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-kvfvg\" (UID: \"013fe25d-2429-4866-8735-66bf7d6a3638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"
Jul 31 01:47:52.815456 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.815436    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/013fe25d-2429-4866-8735-66bf7d6a3638-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-kvfvg\" (UID: \"013fe25d-2429-4866-8735-66bf7d6a3638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"
Jul 31 01:47:52.819552 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.819509    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd46s\" (UniqueName: \"kubernetes.io/projected/013fe25d-2429-4866-8735-66bf7d6a3638-kube-api-access-kd46s\") pod \"istiod-openshift-gateway-7b7995d5cd-kvfvg\" (UID: \"013fe25d-2429-4866-8735-66bf7d6a3638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"
Jul 31 01:47:52.821477 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.821452    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/013fe25d-2429-4866-8735-66bf7d6a3638-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-kvfvg\" (UID: \"013fe25d-2429-4866-8735-66bf7d6a3638\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"
Jul 31 01:47:52.937301 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.937269    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-drmhh"]
Jul 31 01:47:52.939675 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:47:52.939646    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb60fa90c_c0af_43d1_8e91_23eceb898f0e.slice/crio-7e7f42955860bf17d1daf9f0271b7186be51038477bdbbaa3979d741f486c6cb WatchSource:0}: Error finding container 7e7f42955860bf17d1daf9f0271b7186be51038477bdbbaa3979d741f486c6cb: Status 404 returned error can't find the container with id 7e7f42955860bf17d1daf9f0271b7186be51038477bdbbaa3979d741f486c6cb
Jul 31 01:47:52.993691 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:52.993654    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"
Jul 31 01:47:53.124120 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:53.124095    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"]
Jul 31 01:47:53.125952 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:47:53.125922    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod013fe25d_2429_4866_8735_66bf7d6a3638.slice/crio-58e3a8fe05f868e1734712e25a3a4526e91398ab3093043fb48585a2a2ed13c1 WatchSource:0}: Error finding container 58e3a8fe05f868e1734712e25a3a4526e91398ab3093043fb48585a2a2ed13c1: Status 404 returned error can't find the container with id 58e3a8fe05f868e1734712e25a3a4526e91398ab3093043fb48585a2a2ed13c1
Jul 31 01:47:53.398111 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:53.398051    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg" event={"ID":"013fe25d-2429-4866-8735-66bf7d6a3638","Type":"ContainerStarted","Data":"58e3a8fe05f868e1734712e25a3a4526e91398ab3093043fb48585a2a2ed13c1"}
Jul 31 01:47:53.399798 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:53.399752    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-n2p4d" event={"ID":"1af1fd09-ca7c-4981-a5a5-e1070360071c","Type":"ContainerStarted","Data":"d9915838ab3af24e0e4ecb623880674c93f630a6c9a88781b27de1e7db51788a"}
Jul 31 01:47:53.401324 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:53.401270    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-drmhh" event={"ID":"b60fa90c-c0af-43d1-8e91-23eceb898f0e","Type":"ContainerStarted","Data":"7e7f42955860bf17d1daf9f0271b7186be51038477bdbbaa3979d741f486c6cb"}
Jul 31 01:47:57.631341 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:57.631307    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 01:47:57.631614 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:57.631397    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 01:47:58.434690 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:58.434656    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-drmhh" event={"ID":"b60fa90c-c0af-43d1-8e91-23eceb898f0e","Type":"ContainerStarted","Data":"33ced33e9a001a515b113577739d7434ac6367398390d515ade04ee4de2a3fb5"}
Jul 31 01:47:58.434882 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:58.434774    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-drmhh"
Jul 31 01:47:58.436425 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:58.436402    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg" event={"ID":"013fe25d-2429-4866-8735-66bf7d6a3638","Type":"ContainerStarted","Data":"dd3b550853b91a4d268c904e497b19a4d32c0ed4afa6e8437b98edee47e70f85"}
Jul 31 01:47:58.436554 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:58.436441    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"
Jul 31 01:47:58.437975 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:58.437950    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-n2p4d" event={"ID":"1af1fd09-ca7c-4981-a5a5-e1070360071c","Type":"ContainerStarted","Data":"a0ce541477cb815b64f5db5ec59111b2947b0ae4bff80617286f13a15bc62447"}
Jul 31 01:47:58.438079 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:58.438008    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-n2p4d"
Jul 31 01:47:58.438373 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:58.438347    2571 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-kvfvg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 31 01:47:58.438482 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:58.438393    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg" podUID="013fe25d-2429-4866-8735-66bf7d6a3638" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 01:47:58.439515 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:58.439496    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-647dc4ddc5-4g7zg" event={"ID":"8d0f53f2-f485-47c8-ac3c-a68e2b5fe382","Type":"ContainerStarted","Data":"add608fabb9beb158e4c48bed01e3dee87de63ed1545d84e7ae38c4675940e7f"}
Jul 31 01:47:58.453624 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:58.453581    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-drmhh" podStartSLOduration=1.83213965 podStartE2EDuration="6.453569509s" totalImagesPullingTime="4.621429859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:47:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:47:58.45272047 +0000 UTC m=+639.032961466" watchObservedRunningTime="2026-07-31 01:47:58.453569509 +0000 UTC m=+639.033810503"
Jul 31 01:47:58.469450 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:58.469406    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-n2p4d" podStartSLOduration=2.718964181 podStartE2EDuration="7.469393198s" totalImagesPullingTime="4.750429017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:47:58.468397878 +0000 UTC m=+639.048638874" watchObservedRunningTime="2026-07-31 01:47:58.469393198 +0000 UTC m=+639.049634200"
Jul 31 01:47:58.487697 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:58.487652    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg" podStartSLOduration=1.984735464 podStartE2EDuration="6.487637949s" totalImagesPullingTime="4.502902485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:47:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:47:58.486805459 +0000 UTC m=+639.067046467" watchObservedRunningTime="2026-07-31 01:47:58.487637949 +0000 UTC m=+639.067878943"
Jul 31 01:47:58.504975 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:58.504928    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-647dc4ddc5-4g7zg" podStartSLOduration=1.9757932519999999 podStartE2EDuration="7.504913352s" totalImagesPullingTime="5.5291201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:47:58.503456479 +0000 UTC m=+639.083697474" watchObservedRunningTime="2026-07-31 01:47:58.504913352 +0000 UTC m=+639.085154344"
Jul 31 01:47:59.236204 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.236170    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"]
Jul 31 01:47:59.243911 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.243869    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.246607 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.246584    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-bg8lv\""
Jul 31 01:47:59.258064 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.258037    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"]
Jul 31 01:47:59.376364 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.376328    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a88687a-ceee-4892-aa46-a7ba43f9e5c4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc\" (UID: \"7a88687a-ceee-4892-aa46-a7ba43f9e5c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.376364 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.376365    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a88687a-ceee-4892-aa46-a7ba43f9e5c4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc\" (UID: \"7a88687a-ceee-4892-aa46-a7ba43f9e5c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.376613 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.376408    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dr2r\" (UniqueName: \"kubernetes.io/projected/7a88687a-ceee-4892-aa46-a7ba43f9e5c4-kube-api-access-7dr2r\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc\" (UID: \"7a88687a-ceee-4892-aa46-a7ba43f9e5c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.376613 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.376479    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a88687a-ceee-4892-aa46-a7ba43f9e5c4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc\" (UID: \"7a88687a-ceee-4892-aa46-a7ba43f9e5c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.376613 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.376520    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a88687a-ceee-4892-aa46-a7ba43f9e5c4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc\" (UID: \"7a88687a-ceee-4892-aa46-a7ba43f9e5c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.376613 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.376555    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a88687a-ceee-4892-aa46-a7ba43f9e5c4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc\" (UID: \"7a88687a-ceee-4892-aa46-a7ba43f9e5c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.376613 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.376612    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a88687a-ceee-4892-aa46-a7ba43f9e5c4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc\" (UID: \"7a88687a-ceee-4892-aa46-a7ba43f9e5c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.376823 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.376631    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a88687a-ceee-4892-aa46-a7ba43f9e5c4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc\" (UID: \"7a88687a-ceee-4892-aa46-a7ba43f9e5c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.376823 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.376678    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a88687a-ceee-4892-aa46-a7ba43f9e5c4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc\" (UID: \"7a88687a-ceee-4892-aa46-a7ba43f9e5c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.449971 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.449940    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"
Jul 31 01:47:59.477233 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.477194    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a88687a-ceee-4892-aa46-a7ba43f9e5c4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc\" (UID: \"7a88687a-ceee-4892-aa46-a7ba43f9e5c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.477447 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.477265    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a88687a-ceee-4892-aa46-a7ba43f9e5c4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc\" (UID: \"7a88687a-ceee-4892-aa46-a7ba43f9e5c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.477447 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.477294    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a88687a-ceee-4892-aa46-a7ba43f9e5c4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc\" (UID: \"7a88687a-ceee-4892-aa46-a7ba43f9e5c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.477447 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.477348    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a88687a-ceee-4892-aa46-a7ba43f9e5c4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc\" (UID: \"7a88687a-ceee-4892-aa46-a7ba43f9e5c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.477447 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.477394    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a88687a-ceee-4892-aa46-a7ba43f9e5c4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc\" (UID: \"7a88687a-ceee-4892-aa46-a7ba43f9e5c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.477447 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.477417    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a88687a-ceee-4892-aa46-a7ba43f9e5c4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc\" (UID: \"7a88687a-ceee-4892-aa46-a7ba43f9e5c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.477711 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.477460    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dr2r\" (UniqueName: \"kubernetes.io/projected/7a88687a-ceee-4892-aa46-a7ba43f9e5c4-kube-api-access-7dr2r\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc\" (UID: \"7a88687a-ceee-4892-aa46-a7ba43f9e5c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.477711 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.477495    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a88687a-ceee-4892-aa46-a7ba43f9e5c4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc\" (UID: \"7a88687a-ceee-4892-aa46-a7ba43f9e5c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.477711 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.477529    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a88687a-ceee-4892-aa46-a7ba43f9e5c4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc\" (UID: \"7a88687a-ceee-4892-aa46-a7ba43f9e5c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.477851 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.477755    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a88687a-ceee-4892-aa46-a7ba43f9e5c4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc\" (UID: \"7a88687a-ceee-4892-aa46-a7ba43f9e5c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.477851 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.477812    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a88687a-ceee-4892-aa46-a7ba43f9e5c4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc\" (UID: \"7a88687a-ceee-4892-aa46-a7ba43f9e5c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.477992 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.477850    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a88687a-ceee-4892-aa46-a7ba43f9e5c4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc\" (UID: \"7a88687a-ceee-4892-aa46-a7ba43f9e5c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.477992 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.477914    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a88687a-ceee-4892-aa46-a7ba43f9e5c4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc\" (UID: \"7a88687a-ceee-4892-aa46-a7ba43f9e5c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.478543 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.478514    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a88687a-ceee-4892-aa46-a7ba43f9e5c4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc\" (UID: \"7a88687a-ceee-4892-aa46-a7ba43f9e5c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.480119 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.480099    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a88687a-ceee-4892-aa46-a7ba43f9e5c4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc\" (UID: \"7a88687a-ceee-4892-aa46-a7ba43f9e5c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.480387 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.480370    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a88687a-ceee-4892-aa46-a7ba43f9e5c4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc\" (UID: \"7a88687a-ceee-4892-aa46-a7ba43f9e5c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.497000 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.496920    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a88687a-ceee-4892-aa46-a7ba43f9e5c4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc\" (UID: \"7a88687a-ceee-4892-aa46-a7ba43f9e5c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.499697 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.499650    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dr2r\" (UniqueName: \"kubernetes.io/projected/7a88687a-ceee-4892-aa46-a7ba43f9e5c4-kube-api-access-7dr2r\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc\" (UID: \"7a88687a-ceee-4892-aa46-a7ba43f9e5c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.555095 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.555064    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:47:59.734180 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:47:59.734153    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"]
Jul 31 01:47:59.735944 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:47:59.735920    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a88687a_ceee_4892_aa46_a7ba43f9e5c4.slice/crio-6a0d79119d6ec56d4b3e5a01478b044162dd0de7d22737e0786ff9ab5ac42992 WatchSource:0}: Error finding container 6a0d79119d6ec56d4b3e5a01478b044162dd0de7d22737e0786ff9ab5ac42992: Status 404 returned error can't find the container with id 6a0d79119d6ec56d4b3e5a01478b044162dd0de7d22737e0786ff9ab5ac42992
Jul 31 01:48:00.452384 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:00.452350    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc" event={"ID":"7a88687a-ceee-4892-aa46-a7ba43f9e5c4","Type":"ContainerStarted","Data":"6a0d79119d6ec56d4b3e5a01478b044162dd0de7d22737e0786ff9ab5ac42992"}
Jul 31 01:48:01.895567 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:01.895529    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-j99bz"]
Jul 31 01:48:01.899105 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:01.899080    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mlh8q"]
Jul 31 01:48:01.899235 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:01.899190    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j99bz"
Jul 31 01:48:01.901549 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:01.901526    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mlh8q"
Jul 31 01:48:01.901994 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:01.901973    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 31 01:48:01.902089 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:01.901984    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-68rxt\""
Jul 31 01:48:01.904046 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:01.904026    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 31 01:48:01.904191 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:01.904164    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-h2gp2\""
Jul 31 01:48:01.911364 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:01.911294    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-j99bz"]
Jul 31 01:48:01.913307 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:01.913283    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mlh8q"]
Jul 31 01:48:02.001435 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:02.001397    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq9dq\" (UniqueName: \"kubernetes.io/projected/69736619-a3ac-401f-b5d9-d87c27c4e016-kube-api-access-sq9dq\") pod \"llmisvc-controller-manager-777c6bd7d5-mlh8q\" (UID: \"69736619-a3ac-401f-b5d9-d87c27c4e016\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mlh8q"
Jul 31 01:48:02.001623 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:02.001458    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69736619-a3ac-401f-b5d9-d87c27c4e016-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mlh8q\" (UID: \"69736619-a3ac-401f-b5d9-d87c27c4e016\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mlh8q"
Jul 31 01:48:02.001623 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:02.001503    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28b7c570-b419-4cf3-ad97-2a449e9f2e50-cert\") pod \"kserve-controller-manager-d6f4b65b8-j99bz\" (UID: \"28b7c570-b419-4cf3-ad97-2a449e9f2e50\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j99bz"
Jul 31 01:48:02.001623 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:02.001531    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx4n7\" (UniqueName: \"kubernetes.io/projected/28b7c570-b419-4cf3-ad97-2a449e9f2e50-kube-api-access-lx4n7\") pod \"kserve-controller-manager-d6f4b65b8-j99bz\" (UID: \"28b7c570-b419-4cf3-ad97-2a449e9f2e50\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j99bz"
Jul 31 01:48:02.102715 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:02.102677    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq9dq\" (UniqueName: \"kubernetes.io/projected/69736619-a3ac-401f-b5d9-d87c27c4e016-kube-api-access-sq9dq\") pod \"llmisvc-controller-manager-777c6bd7d5-mlh8q\" (UID: \"69736619-a3ac-401f-b5d9-d87c27c4e016\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mlh8q"
Jul 31 01:48:02.102715 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:02.102724    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69736619-a3ac-401f-b5d9-d87c27c4e016-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mlh8q\" (UID: \"69736619-a3ac-401f-b5d9-d87c27c4e016\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mlh8q"
Jul 31 01:48:02.103035 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:02.102761    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28b7c570-b419-4cf3-ad97-2a449e9f2e50-cert\") pod \"kserve-controller-manager-d6f4b65b8-j99bz\" (UID: \"28b7c570-b419-4cf3-ad97-2a449e9f2e50\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j99bz"
Jul 31 01:48:02.103035 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:02.102779    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx4n7\" (UniqueName: \"kubernetes.io/projected/28b7c570-b419-4cf3-ad97-2a449e9f2e50-kube-api-access-lx4n7\") pod \"kserve-controller-manager-d6f4b65b8-j99bz\" (UID: \"28b7c570-b419-4cf3-ad97-2a449e9f2e50\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j99bz"
Jul 31 01:48:02.105363 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:02.105335    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69736619-a3ac-401f-b5d9-d87c27c4e016-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mlh8q\" (UID: \"69736619-a3ac-401f-b5d9-d87c27c4e016\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mlh8q"
Jul 31 01:48:02.105363 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:02.105361    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28b7c570-b419-4cf3-ad97-2a449e9f2e50-cert\") pod \"kserve-controller-manager-d6f4b65b8-j99bz\" (UID: \"28b7c570-b419-4cf3-ad97-2a449e9f2e50\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j99bz"
Jul 31 01:48:02.120280 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:02.120250    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx4n7\" (UniqueName: \"kubernetes.io/projected/28b7c570-b419-4cf3-ad97-2a449e9f2e50-kube-api-access-lx4n7\") pod \"kserve-controller-manager-d6f4b65b8-j99bz\" (UID: \"28b7c570-b419-4cf3-ad97-2a449e9f2e50\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j99bz"
Jul 31 01:48:02.120546 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:02.120523    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq9dq\" (UniqueName: \"kubernetes.io/projected/69736619-a3ac-401f-b5d9-d87c27c4e016-kube-api-access-sq9dq\") pod \"llmisvc-controller-manager-777c6bd7d5-mlh8q\" (UID: \"69736619-a3ac-401f-b5d9-d87c27c4e016\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mlh8q"
Jul 31 01:48:02.214554 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:02.214469    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j99bz"
Jul 31 01:48:02.220937 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:02.220853    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mlh8q"
Jul 31 01:48:02.398481 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:02.398441    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-j99bz"]
Jul 31 01:48:02.404162 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:48:02.404122    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28b7c570_b419_4cf3_ad97_2a449e9f2e50.slice/crio-2f9aab95a9d6e3b94622eac170c26645708f2d805c102c8e5b55e5486665a739 WatchSource:0}: Error finding container 2f9aab95a9d6e3b94622eac170c26645708f2d805c102c8e5b55e5486665a739: Status 404 returned error can't find the container with id 2f9aab95a9d6e3b94622eac170c26645708f2d805c102c8e5b55e5486665a739
Jul 31 01:48:02.452362 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:02.452329    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mlh8q"]
Jul 31 01:48:02.454923 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:48:02.454872    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod69736619_a3ac_401f_b5d9_d87c27c4e016.slice/crio-9d60b4328217099815939c7a4bd9392e4745f910e9d8885cece60995d81364ff WatchSource:0}: Error finding container 9d60b4328217099815939c7a4bd9392e4745f910e9d8885cece60995d81364ff: Status 404 returned error can't find the container with id 9d60b4328217099815939c7a4bd9392e4745f910e9d8885cece60995d81364ff
Jul 31 01:48:02.470574 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:02.470483    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mlh8q" event={"ID":"69736619-a3ac-401f-b5d9-d87c27c4e016","Type":"ContainerStarted","Data":"9d60b4328217099815939c7a4bd9392e4745f910e9d8885cece60995d81364ff"}
Jul 31 01:48:02.472360 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:02.472300    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j99bz" event={"ID":"28b7c570-b419-4cf3-ad97-2a449e9f2e50","Type":"ContainerStarted","Data":"2f9aab95a9d6e3b94622eac170c26645708f2d805c102c8e5b55e5486665a739"}
Jul 31 01:48:04.427693 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:04.427070    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"]
Jul 31 01:48:04.427693 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:04.427274    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg" podUID="013fe25d-2429-4866-8735-66bf7d6a3638" containerName="discovery" containerID="cri-o://dd3b550853b91a4d268c904e497b19a4d32c0ed4afa6e8437b98edee47e70f85" gracePeriod=30
Jul 31 01:48:05.474643 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.474615    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"
Jul 31 01:48:05.491551 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.491518    2571 generic.go:356] "Generic (PLEG): container finished" podID="013fe25d-2429-4866-8735-66bf7d6a3638" containerID="dd3b550853b91a4d268c904e497b19a4d32c0ed4afa6e8437b98edee47e70f85" exitCode=0
Jul 31 01:48:05.491551 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.491552    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"
Jul 31 01:48:05.491729 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.491573    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg" event={"ID":"013fe25d-2429-4866-8735-66bf7d6a3638","Type":"ContainerDied","Data":"dd3b550853b91a4d268c904e497b19a4d32c0ed4afa6e8437b98edee47e70f85"}
Jul 31 01:48:05.491729 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.491651    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg" event={"ID":"013fe25d-2429-4866-8735-66bf7d6a3638","Type":"ContainerDied","Data":"58e3a8fe05f868e1734712e25a3a4526e91398ab3093043fb48585a2a2ed13c1"}
Jul 31 01:48:05.491729 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.491673    2571 scope.go:117] "RemoveContainer" containerID="dd3b550853b91a4d268c904e497b19a4d32c0ed4afa6e8437b98edee47e70f85"
Jul 31 01:48:05.540070 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.540043    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/013fe25d-2429-4866-8735-66bf7d6a3638-local-certs\") pod \"013fe25d-2429-4866-8735-66bf7d6a3638\" (UID: \"013fe25d-2429-4866-8735-66bf7d6a3638\") "
Jul 31 01:48:05.540070 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.540074    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/013fe25d-2429-4866-8735-66bf7d6a3638-cacerts\") pod \"013fe25d-2429-4866-8735-66bf7d6a3638\" (UID: \"013fe25d-2429-4866-8735-66bf7d6a3638\") "
Jul 31 01:48:05.540298 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.540098    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kd46s\" (UniqueName: \"kubernetes.io/projected/013fe25d-2429-4866-8735-66bf7d6a3638-kube-api-access-kd46s\") pod \"013fe25d-2429-4866-8735-66bf7d6a3638\" (UID: \"013fe25d-2429-4866-8735-66bf7d6a3638\") "
Jul 31 01:48:05.540298 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.540150    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/013fe25d-2429-4866-8735-66bf7d6a3638-istio-csr-dns-cert\") pod \"013fe25d-2429-4866-8735-66bf7d6a3638\" (UID: \"013fe25d-2429-4866-8735-66bf7d6a3638\") "
Jul 31 01:48:05.540298 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.540188    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/013fe25d-2429-4866-8735-66bf7d6a3638-istio-kubeconfig\") pod \"013fe25d-2429-4866-8735-66bf7d6a3638\" (UID: \"013fe25d-2429-4866-8735-66bf7d6a3638\") "
Jul 31 01:48:05.540298 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.540293    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/013fe25d-2429-4866-8735-66bf7d6a3638-istio-csr-ca-configmap\") pod \"013fe25d-2429-4866-8735-66bf7d6a3638\" (UID: \"013fe25d-2429-4866-8735-66bf7d6a3638\") "
Jul 31 01:48:05.540510 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.540315    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/013fe25d-2429-4866-8735-66bf7d6a3638-istio-token\") pod \"013fe25d-2429-4866-8735-66bf7d6a3638\" (UID: \"013fe25d-2429-4866-8735-66bf7d6a3638\") "
Jul 31 01:48:05.541132 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.541087    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/013fe25d-2429-4866-8735-66bf7d6a3638-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "013fe25d-2429-4866-8735-66bf7d6a3638" (UID: "013fe25d-2429-4866-8735-66bf7d6a3638"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 01:48:05.542990 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.542945    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/013fe25d-2429-4866-8735-66bf7d6a3638-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "013fe25d-2429-4866-8735-66bf7d6a3638" (UID: "013fe25d-2429-4866-8735-66bf7d6a3638"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 01:48:05.543255 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.543226    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/013fe25d-2429-4866-8735-66bf7d6a3638-local-certs" (OuterVolumeSpecName: "local-certs") pod "013fe25d-2429-4866-8735-66bf7d6a3638" (UID: "013fe25d-2429-4866-8735-66bf7d6a3638"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:48:05.543402 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.543368    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/013fe25d-2429-4866-8735-66bf7d6a3638-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "013fe25d-2429-4866-8735-66bf7d6a3638" (UID: "013fe25d-2429-4866-8735-66bf7d6a3638"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 01:48:05.543472 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.543439    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/013fe25d-2429-4866-8735-66bf7d6a3638-cacerts" (OuterVolumeSpecName: "cacerts") pod "013fe25d-2429-4866-8735-66bf7d6a3638" (UID: "013fe25d-2429-4866-8735-66bf7d6a3638"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 01:48:05.544175 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.544136    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/013fe25d-2429-4866-8735-66bf7d6a3638-kube-api-access-kd46s" (OuterVolumeSpecName: "kube-api-access-kd46s") pod "013fe25d-2429-4866-8735-66bf7d6a3638" (UID: "013fe25d-2429-4866-8735-66bf7d6a3638"). InnerVolumeSpecName "kube-api-access-kd46s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:48:05.544279 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.544192    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/013fe25d-2429-4866-8735-66bf7d6a3638-istio-token" (OuterVolumeSpecName: "istio-token") pod "013fe25d-2429-4866-8735-66bf7d6a3638" (UID: "013fe25d-2429-4866-8735-66bf7d6a3638"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:48:05.562983 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.562963    2571 scope.go:117] "RemoveContainer" containerID="dd3b550853b91a4d268c904e497b19a4d32c0ed4afa6e8437b98edee47e70f85"
Jul 31 01:48:05.563310 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:48:05.563290    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd3b550853b91a4d268c904e497b19a4d32c0ed4afa6e8437b98edee47e70f85\": container with ID starting with dd3b550853b91a4d268c904e497b19a4d32c0ed4afa6e8437b98edee47e70f85 not found: ID does not exist" containerID="dd3b550853b91a4d268c904e497b19a4d32c0ed4afa6e8437b98edee47e70f85"
Jul 31 01:48:05.563377 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.563318    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd3b550853b91a4d268c904e497b19a4d32c0ed4afa6e8437b98edee47e70f85"} err="failed to get container status \"dd3b550853b91a4d268c904e497b19a4d32c0ed4afa6e8437b98edee47e70f85\": rpc error: code = NotFound desc = could not find container \"dd3b550853b91a4d268c904e497b19a4d32c0ed4afa6e8437b98edee47e70f85\": container with ID starting with dd3b550853b91a4d268c904e497b19a4d32c0ed4afa6e8437b98edee47e70f85 not found: ID does not exist"
Jul 31 01:48:05.641376 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.641343    2571 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/013fe25d-2429-4866-8735-66bf7d6a3638-istio-kubeconfig\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:48:05.641376 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.641374    2571 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/013fe25d-2429-4866-8735-66bf7d6a3638-istio-csr-ca-configmap\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:48:05.641572 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.641387    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/013fe25d-2429-4866-8735-66bf7d6a3638-istio-token\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:48:05.641572 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.641401    2571 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/013fe25d-2429-4866-8735-66bf7d6a3638-local-certs\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:48:05.641572 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.641410    2571 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/013fe25d-2429-4866-8735-66bf7d6a3638-cacerts\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:48:05.641572 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.641421    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kd46s\" (UniqueName: \"kubernetes.io/projected/013fe25d-2429-4866-8735-66bf7d6a3638-kube-api-access-kd46s\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:48:05.641572 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.641431    2571 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/013fe25d-2429-4866-8735-66bf7d6a3638-istio-csr-dns-cert\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:48:05.817045 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.817009    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"]
Jul 31 01:48:05.819961 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.819936    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg"]
Jul 31 01:48:05.993874 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:05.993837    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="013fe25d-2429-4866-8735-66bf7d6a3638" path="/var/lib/kubelet/pods/013fe25d-2429-4866-8735-66bf7d6a3638/volumes"
Jul 31 01:48:06.094259 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:06.094220    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 01:48:06.094432 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:06.094303    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 01:48:06.094432 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:06.094367    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 01:48:06.498591 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:06.498490    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mlh8q" event={"ID":"69736619-a3ac-401f-b5d9-d87c27c4e016","Type":"ContainerStarted","Data":"bf9f008e6f5f93cae603a2ae660ee1218722323574a8d191efdaabfa5423d144"}
Jul 31 01:48:06.499070 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:06.498614    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mlh8q"
Jul 31 01:48:06.500067 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:06.500040    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j99bz" event={"ID":"28b7c570-b419-4cf3-ad97-2a449e9f2e50","Type":"ContainerStarted","Data":"fe0b62e3137cbab9060686e199fa0659144c2d595dfc4aa39e79c0563d9ae254"}
Jul 31 01:48:06.500202 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:06.500104    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j99bz"
Jul 31 01:48:06.501597 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:06.501571    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc" event={"ID":"7a88687a-ceee-4892-aa46-a7ba43f9e5c4","Type":"ContainerStarted","Data":"a1590b5ff3f65a9621f4ba9a3b6140f82a2304dc0dbc5947820e9cf59150fc53"}
Jul 31 01:48:06.517194 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:06.517143    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mlh8q" podStartSLOduration=1.826319613 podStartE2EDuration="5.517123736s" totalImagesPullingTime="3.690804123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:48:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:48:06.515192074 +0000 UTC m=+647.095433069" watchObservedRunningTime="2026-07-31 01:48:06.517123736 +0000 UTC m=+647.097364729"
Jul 31 01:48:06.534632 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:06.534572    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc" podStartSLOduration=1.178774996 podStartE2EDuration="7.534558783s" totalImagesPullingTime="6.355783787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:48:06.533461785 +0000 UTC m=+647.113702780" watchObservedRunningTime="2026-07-31 01:48:06.534558783 +0000 UTC m=+647.114799777"
Jul 31 01:48:06.550505 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:06.550447    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j99bz" podStartSLOduration=1.861873225 podStartE2EDuration="5.55042567s" totalImagesPullingTime="3.688552445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:48:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:48:06.548574746 +0000 UTC m=+647.128815766" watchObservedRunningTime="2026-07-31 01:48:06.55042567 +0000 UTC m=+647.130666666"
Jul 31 01:48:06.555917 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:06.555884    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:48:07.560743 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:07.560712    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:48:08.512397 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:08.512356    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:48:08.513371 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:08.513353    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc"
Jul 31 01:48:09.449742 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:09.449685    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-n2p4d"
Jul 31 01:48:09.451610 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:09.451590    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-drmhh"
Jul 31 01:48:10.448936 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:10.448874    2571 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-kvfvg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.29:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 31 01:48:10.449123 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:10.448963    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kvfvg" podUID="013fe25d-2429-4866-8735-66bf7d6a3638" containerName="discovery" probeResult="failure" output="Get \"http://10.133.0.29:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 31 01:48:37.508882 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:37.508849    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mlh8q"
Jul 31 01:48:37.511723 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:48:37.511706    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j99bz"
Jul 31 01:49:03.460724 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:03.460682    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j"]
Jul 31 01:49:03.461194 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:03.461099    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="013fe25d-2429-4866-8735-66bf7d6a3638" containerName="discovery"
Jul 31 01:49:03.461194 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:03.461111    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="013fe25d-2429-4866-8735-66bf7d6a3638" containerName="discovery"
Jul 31 01:49:03.461194 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:03.461180    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="013fe25d-2429-4866-8735-66bf7d6a3638" containerName="discovery"
Jul 31 01:49:03.463340 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:03.463321    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j"
Jul 31 01:49:03.466370 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:03.466348    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 31 01:49:03.466498 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:03.466348    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 31 01:49:03.466498 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:03.466348    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-n5crf\""
Jul 31 01:49:03.477107 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:03.477083    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j"]
Jul 31 01:49:03.477295 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:03.477271    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b178b4e-f030-4fe6-9ff1-3fba59030e34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-2l99j\" (UID: \"1b178b4e-f030-4fe6-9ff1-3fba59030e34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j"
Jul 31 01:49:03.477373 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:03.477340    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqmh8\" (UniqueName: \"kubernetes.io/projected/1b178b4e-f030-4fe6-9ff1-3fba59030e34-kube-api-access-cqmh8\") pod \"kuadrant-operator-controller-manager-58fc56757c-2l99j\" (UID: \"1b178b4e-f030-4fe6-9ff1-3fba59030e34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j"
Jul 31 01:49:03.578529 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:03.578494    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqmh8\" (UniqueName: \"kubernetes.io/projected/1b178b4e-f030-4fe6-9ff1-3fba59030e34-kube-api-access-cqmh8\") pod \"kuadrant-operator-controller-manager-58fc56757c-2l99j\" (UID: \"1b178b4e-f030-4fe6-9ff1-3fba59030e34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j"
Jul 31 01:49:03.578713 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:03.578576    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b178b4e-f030-4fe6-9ff1-3fba59030e34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-2l99j\" (UID: \"1b178b4e-f030-4fe6-9ff1-3fba59030e34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j"
Jul 31 01:49:03.578949 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:03.578933    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b178b4e-f030-4fe6-9ff1-3fba59030e34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-2l99j\" (UID: \"1b178b4e-f030-4fe6-9ff1-3fba59030e34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j"
Jul 31 01:49:03.594414 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:03.594388    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqmh8\" (UniqueName: \"kubernetes.io/projected/1b178b4e-f030-4fe6-9ff1-3fba59030e34-kube-api-access-cqmh8\") pod \"kuadrant-operator-controller-manager-58fc56757c-2l99j\" (UID: \"1b178b4e-f030-4fe6-9ff1-3fba59030e34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j"
Jul 31 01:49:03.773973 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:03.773851    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j"
Jul 31 01:49:03.943172 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:03.943147    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j"]
Jul 31 01:49:03.945770 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:49:03.945741    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b178b4e_f030_4fe6_9ff1_3fba59030e34.slice/crio-204edfe8887b0b558d003bebb95ade1bb20c2870c3f12ecb86a57a2d91c562f4 WatchSource:0}: Error finding container 204edfe8887b0b558d003bebb95ade1bb20c2870c3f12ecb86a57a2d91c562f4: Status 404 returned error can't find the container with id 204edfe8887b0b558d003bebb95ade1bb20c2870c3f12ecb86a57a2d91c562f4
Jul 31 01:49:03.948809 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:03.948794    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 01:49:04.773743 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:04.773707    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j" event={"ID":"1b178b4e-f030-4fe6-9ff1-3fba59030e34","Type":"ContainerStarted","Data":"204edfe8887b0b558d003bebb95ade1bb20c2870c3f12ecb86a57a2d91c562f4"}
Jul 31 01:49:05.970279 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:05.970241    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-knlpw"]
Jul 31 01:49:05.977444 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:05.977413    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-knlpw"
Jul 31 01:49:05.984464 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:05.984437    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-znn59\""
Jul 31 01:49:05.995430 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:05.995404    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-knlpw"]
Jul 31 01:49:06.010962 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:06.010924    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct8d8\" (UniqueName: \"kubernetes.io/projected/cce2ebb9-e2b3-48c9-8d22-cf870c2e69c9-kube-api-access-ct8d8\") pod \"authorino-operator-68d88948d8-knlpw\" (UID: \"cce2ebb9-e2b3-48c9-8d22-cf870c2e69c9\") " pod="kuadrant-system/authorino-operator-68d88948d8-knlpw"
Jul 31 01:49:06.112276 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:06.112239    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct8d8\" (UniqueName: \"kubernetes.io/projected/cce2ebb9-e2b3-48c9-8d22-cf870c2e69c9-kube-api-access-ct8d8\") pod \"authorino-operator-68d88948d8-knlpw\" (UID: \"cce2ebb9-e2b3-48c9-8d22-cf870c2e69c9\") " pod="kuadrant-system/authorino-operator-68d88948d8-knlpw"
Jul 31 01:49:06.122881 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:06.122845    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct8d8\" (UniqueName: \"kubernetes.io/projected/cce2ebb9-e2b3-48c9-8d22-cf870c2e69c9-kube-api-access-ct8d8\") pod \"authorino-operator-68d88948d8-knlpw\" (UID: \"cce2ebb9-e2b3-48c9-8d22-cf870c2e69c9\") " pod="kuadrant-system/authorino-operator-68d88948d8-knlpw"
Jul 31 01:49:06.294933 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:06.294844    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-knlpw"
Jul 31 01:49:06.448576 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:06.448553    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-knlpw"]
Jul 31 01:49:06.450127 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:49:06.450102    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcce2ebb9_e2b3_48c9_8d22_cf870c2e69c9.slice/crio-a91734c1532862f133c0289e5b21cd96b05d04b1395279b1b55bc2b1163b49fd WatchSource:0}: Error finding container a91734c1532862f133c0289e5b21cd96b05d04b1395279b1b55bc2b1163b49fd: Status 404 returned error can't find the container with id a91734c1532862f133c0289e5b21cd96b05d04b1395279b1b55bc2b1163b49fd
Jul 31 01:49:06.787419 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:06.787381    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-knlpw" event={"ID":"cce2ebb9-e2b3-48c9-8d22-cf870c2e69c9","Type":"ContainerStarted","Data":"a91734c1532862f133c0289e5b21cd96b05d04b1395279b1b55bc2b1163b49fd"}
Jul 31 01:49:08.281714 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:08.281664    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-w5qcq"]
Jul 31 01:49:08.284575 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:08.284554    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-w5qcq"
Jul 31 01:49:08.287330 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:08.287306    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-sp6mm\""
Jul 31 01:49:08.303060 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:08.303032    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-w5qcq"]
Jul 31 01:49:08.337518 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:08.337396    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnn66\" (UniqueName: \"kubernetes.io/projected/138f189f-f041-4df3-be66-feb29e50ec4b-kube-api-access-lnn66\") pod \"limitador-operator-controller-manager-6c549b6d85-w5qcq\" (UID: \"138f189f-f041-4df3-be66-feb29e50ec4b\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-w5qcq"
Jul 31 01:49:08.438671 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:08.438627    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnn66\" (UniqueName: \"kubernetes.io/projected/138f189f-f041-4df3-be66-feb29e50ec4b-kube-api-access-lnn66\") pod \"limitador-operator-controller-manager-6c549b6d85-w5qcq\" (UID: \"138f189f-f041-4df3-be66-feb29e50ec4b\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-w5qcq"
Jul 31 01:49:08.451253 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:08.451192    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnn66\" (UniqueName: \"kubernetes.io/projected/138f189f-f041-4df3-be66-feb29e50ec4b-kube-api-access-lnn66\") pod \"limitador-operator-controller-manager-6c549b6d85-w5qcq\" (UID: \"138f189f-f041-4df3-be66-feb29e50ec4b\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-w5qcq"
Jul 31 01:49:08.597999 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:08.597908    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-w5qcq"
Jul 31 01:49:09.615909 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:09.615782    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-w5qcq"]
Jul 31 01:49:09.618174 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:49:09.618151    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod138f189f_f041_4df3_be66_feb29e50ec4b.slice/crio-2b8905190305e86a513af1960d170eba8df42c1a22ee4e2668d78050fb91f61d WatchSource:0}: Error finding container 2b8905190305e86a513af1960d170eba8df42c1a22ee4e2668d78050fb91f61d: Status 404 returned error can't find the container with id 2b8905190305e86a513af1960d170eba8df42c1a22ee4e2668d78050fb91f61d
Jul 31 01:49:09.805653 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:09.805562    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j" event={"ID":"1b178b4e-f030-4fe6-9ff1-3fba59030e34","Type":"ContainerStarted","Data":"0c0dad770b6611d8c0223c24cb86cdc76e49afa18f2b5e998e27c7146ee6df82"}
Jul 31 01:49:09.805835 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:09.805673    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j"
Jul 31 01:49:09.807313 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:09.807289    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-knlpw" event={"ID":"cce2ebb9-e2b3-48c9-8d22-cf870c2e69c9","Type":"ContainerStarted","Data":"c81d318509ee0de4336a23d7c22921ebf8e4bef8e3b60d3046cda28c675f5948"}
Jul 31 01:49:09.807437 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:09.807357    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-knlpw"
Jul 31 01:49:09.808565 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:09.808547    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-w5qcq" event={"ID":"138f189f-f041-4df3-be66-feb29e50ec4b","Type":"ContainerStarted","Data":"2b8905190305e86a513af1960d170eba8df42c1a22ee4e2668d78050fb91f61d"}
Jul 31 01:49:09.833201 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:09.833151    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j" podStartSLOduration=1.306141664 podStartE2EDuration="6.833136152s" totalImagesPullingTime="5.526994488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:49:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:49:09.830646402 +0000 UTC m=+710.410887397" watchObservedRunningTime="2026-07-31 01:49:09.833136152 +0000 UTC m=+710.413377148"
Jul 31 01:49:09.854740 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:09.854694    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-knlpw" podStartSLOduration=1.843229944 podStartE2EDuration="4.854678834s" totalImagesPullingTime="3.01144889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:49:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:49:09.853283923 +0000 UTC m=+710.433524931" watchObservedRunningTime="2026-07-31 01:49:09.854678834 +0000 UTC m=+710.434919821"
Jul 31 01:49:12.826347 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:12.826311    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-w5qcq" event={"ID":"138f189f-f041-4df3-be66-feb29e50ec4b","Type":"ContainerStarted","Data":"d30655920ea770f6ca6be6792d1c10a1e3f3fb1ebcfcec57f2246e307a0a534d"}
Jul 31 01:49:12.826789 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:12.826437    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-w5qcq"
Jul 31 01:49:12.846418 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:12.846368    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-w5qcq" podStartSLOduration=2.463496898 podStartE2EDuration="4.846350751s" totalImagesPullingTime="2.382853853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:49:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:49:12.845121966 +0000 UTC m=+713.425362962" watchObservedRunningTime="2026-07-31 01:49:12.846350751 +0000 UTC m=+713.426591745"
Jul 31 01:49:20.815560 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:20.815528    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-knlpw"
Jul 31 01:49:20.816029 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:20.815618    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j"
Jul 31 01:49:22.877060 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:22.877026    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j"]
Jul 31 01:49:22.877547 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:22.877274    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j" podUID="1b178b4e-f030-4fe6-9ff1-3fba59030e34" containerName="manager" containerID="cri-o://0c0dad770b6611d8c0223c24cb86cdc76e49afa18f2b5e998e27c7146ee6df82" gracePeriod=2
Jul 31 01:49:22.885931 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:22.885880    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j"]
Jul 31 01:49:22.897104 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:22.897072    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vhbdl"]
Jul 31 01:49:22.898139 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:22.898117    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b178b4e-f030-4fe6-9ff1-3fba59030e34" containerName="manager"
Jul 31 01:49:22.898275 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:22.898264    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b178b4e-f030-4fe6-9ff1-3fba59030e34" containerName="manager"
Jul 31 01:49:22.898455 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:22.898441    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b178b4e-f030-4fe6-9ff1-3fba59030e34" containerName="manager"
Jul 31 01:49:22.902003 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:22.901985    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-w5qcq"]
Jul 31 01:49:22.902119 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:22.902091    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vhbdl"
Jul 31 01:49:22.902190 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:22.902167    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-w5qcq" podUID="138f189f-f041-4df3-be66-feb29e50ec4b" containerName="manager" containerID="cri-o://d30655920ea770f6ca6be6792d1c10a1e3f3fb1ebcfcec57f2246e307a0a534d" gracePeriod=2
Jul 31 01:49:22.904031 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:22.904010    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-w5qcq"
Jul 31 01:49:22.909444 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:22.909421    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-qgdk4"]
Jul 31 01:49:22.912967 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:22.912863    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-qgdk4"
Jul 31 01:49:22.915914 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:22.915869    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vhbdl"]
Jul 31 01:49:22.917617 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:22.917597    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-w5qcq"]
Jul 31 01:49:22.921951 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:49:22.921877    2571 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"138f189f-f041-4df3-be66-feb29e50ec4b\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-6c549b6d85-w5qcq\": pods \"limitador-operator-controller-manager-6c549b6d85-w5qcq\" not found" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-w5qcq"
Jul 31 01:49:22.924199 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:49:22.924169    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-2l99j\" is forbidden: User \"system:node:ip-10-0-133-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-91.ec2.internal' and this object" podUID="1b178b4e-f030-4fe6-9ff1-3fba59030e34" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j"
Jul 31 01:49:22.925028 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:22.925009    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kkkph"]
Jul 31 01:49:22.925412 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:22.925399    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="138f189f-f041-4df3-be66-feb29e50ec4b" containerName="manager"
Jul 31 01:49:22.925450 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:22.925414    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="138f189f-f041-4df3-be66-feb29e50ec4b" containerName="manager"
Jul 31 01:49:22.925495 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:22.925486    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="138f189f-f041-4df3-be66-feb29e50ec4b" containerName="manager"
Jul 31 01:49:22.926334 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:49:22.926308    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-w5qcq\" is forbidden: User \"system:node:ip-10-0-133-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-91.ec2.internal' and this object" podUID="138f189f-f041-4df3-be66-feb29e50ec4b" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-w5qcq"
Jul 31 01:49:22.928560 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:22.928543    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kkkph"
Jul 31 01:49:22.928641 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:49:22.928542    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-2l99j\" is forbidden: User \"system:node:ip-10-0-133-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-91.ec2.internal' and this object" podUID="1b178b4e-f030-4fe6-9ff1-3fba59030e34" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j"
Jul 31 01:49:22.937672 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:22.937647    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-qgdk4"]
Jul 31 01:49:22.941975 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:22.941951    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kkkph"]
Jul 31 01:49:22.976723 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:49:22.976688    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-2l99j\" is forbidden: User \"system:node:ip-10-0-133-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-91.ec2.internal' and this object" podUID="1b178b4e-f030-4fe6-9ff1-3fba59030e34" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j"
Jul 31 01:49:22.978596 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:49:22.978577    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-w5qcq\" is forbidden: User \"system:node:ip-10-0-133-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-91.ec2.internal' and this object" podUID="138f189f-f041-4df3-be66-feb29e50ec4b" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-w5qcq"
Jul 31 01:49:22.979997 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:22.979978    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-qgdk4\" (UID: \"aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-qgdk4"
Jul 31 01:49:22.980048 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:22.980033    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vz5f\" (UniqueName: \"kubernetes.io/projected/cc2d4b70-9509-4fc4-8761-bfad0b90dc68-kube-api-access-8vz5f\") pod \"kuadrant-operator-controller-manager-68cf589589-vhbdl\" (UID: \"cc2d4b70-9509-4fc4-8761-bfad0b90dc68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vhbdl"
Jul 31 01:49:22.980084 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:22.980075    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s27q\" (UniqueName: \"kubernetes.io/projected/aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5-kube-api-access-5s27q\") pod \"kuadrant-operator-controller-manager-58fc56757c-qgdk4\" (UID: \"aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-qgdk4"
Jul 31 01:49:22.980117 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:22.980110    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc2d4b70-9509-4fc4-8761-bfad0b90dc68-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-vhbdl\" (UID: \"cc2d4b70-9509-4fc4-8761-bfad0b90dc68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vhbdl"
Jul 31 01:49:23.081564 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.081523    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s27q\" (UniqueName: \"kubernetes.io/projected/aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5-kube-api-access-5s27q\") pod \"kuadrant-operator-controller-manager-58fc56757c-qgdk4\" (UID: \"aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-qgdk4"
Jul 31 01:49:23.081734 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.081583    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96zvd\" (UniqueName: \"kubernetes.io/projected/b0c0becd-8b5b-4e72-9ac4-874e0aa24576-kube-api-access-96zvd\") pod \"limitador-operator-controller-manager-6c549b6d85-kkkph\" (UID: \"b0c0becd-8b5b-4e72-9ac4-874e0aa24576\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kkkph"
Jul 31 01:49:23.081734 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.081620    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc2d4b70-9509-4fc4-8761-bfad0b90dc68-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-vhbdl\" (UID: \"cc2d4b70-9509-4fc4-8761-bfad0b90dc68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vhbdl"
Jul 31 01:49:23.081967 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.081944    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-qgdk4\" (UID: \"aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-qgdk4"
Jul 31 01:49:23.082067 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.082034    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vz5f\" (UniqueName: \"kubernetes.io/projected/cc2d4b70-9509-4fc4-8761-bfad0b90dc68-kube-api-access-8vz5f\") pod \"kuadrant-operator-controller-manager-68cf589589-vhbdl\" (UID: \"cc2d4b70-9509-4fc4-8761-bfad0b90dc68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vhbdl"
Jul 31 01:49:23.082270 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.082031    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc2d4b70-9509-4fc4-8761-bfad0b90dc68-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-vhbdl\" (UID: \"cc2d4b70-9509-4fc4-8761-bfad0b90dc68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vhbdl"
Jul 31 01:49:23.082389 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.082350    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-qgdk4\" (UID: \"aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-qgdk4"
Jul 31 01:49:23.092615 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.092081    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vz5f\" (UniqueName: \"kubernetes.io/projected/cc2d4b70-9509-4fc4-8761-bfad0b90dc68-kube-api-access-8vz5f\") pod \"kuadrant-operator-controller-manager-68cf589589-vhbdl\" (UID: \"cc2d4b70-9509-4fc4-8761-bfad0b90dc68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vhbdl"
Jul 31 01:49:23.093331 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.093266    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s27q\" (UniqueName: \"kubernetes.io/projected/aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5-kube-api-access-5s27q\") pod \"kuadrant-operator-controller-manager-58fc56757c-qgdk4\" (UID: \"aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-qgdk4"
Jul 31 01:49:23.143605 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.143577    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j"
Jul 31 01:49:23.146040 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:49:23.146012    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-w5qcq\" is forbidden: User \"system:node:ip-10-0-133-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-91.ec2.internal' and this object" podUID="138f189f-f041-4df3-be66-feb29e50ec4b" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-w5qcq"
Jul 31 01:49:23.147076 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.147059    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-w5qcq"
Jul 31 01:49:23.148116 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:49:23.148096    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-2l99j\" is forbidden: User \"system:node:ip-10-0-133-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-91.ec2.internal' and this object" podUID="1b178b4e-f030-4fe6-9ff1-3fba59030e34" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j"
Jul 31 01:49:23.150316 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:49:23.150291    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-w5qcq\" is forbidden: User \"system:node:ip-10-0-133-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-91.ec2.internal' and this object" podUID="138f189f-f041-4df3-be66-feb29e50ec4b" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-w5qcq"
Jul 31 01:49:23.152328 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:49:23.152305    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-2l99j\" is forbidden: User \"system:node:ip-10-0-133-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-91.ec2.internal' and this object" podUID="1b178b4e-f030-4fe6-9ff1-3fba59030e34" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j"
Jul 31 01:49:23.182563 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.182529    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96zvd\" (UniqueName: \"kubernetes.io/projected/b0c0becd-8b5b-4e72-9ac4-874e0aa24576-kube-api-access-96zvd\") pod \"limitador-operator-controller-manager-6c549b6d85-kkkph\" (UID: \"b0c0becd-8b5b-4e72-9ac4-874e0aa24576\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kkkph"
Jul 31 01:49:23.192819 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.192791    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96zvd\" (UniqueName: \"kubernetes.io/projected/b0c0becd-8b5b-4e72-9ac4-874e0aa24576-kube-api-access-96zvd\") pod \"limitador-operator-controller-manager-6c549b6d85-kkkph\" (UID: \"b0c0becd-8b5b-4e72-9ac4-874e0aa24576\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kkkph"
Jul 31 01:49:23.283864 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.283831    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnn66\" (UniqueName: \"kubernetes.io/projected/138f189f-f041-4df3-be66-feb29e50ec4b-kube-api-access-lnn66\") pod \"138f189f-f041-4df3-be66-feb29e50ec4b\" (UID: \"138f189f-f041-4df3-be66-feb29e50ec4b\") "
Jul 31 01:49:23.284046 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.283886    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqmh8\" (UniqueName: \"kubernetes.io/projected/1b178b4e-f030-4fe6-9ff1-3fba59030e34-kube-api-access-cqmh8\") pod \"1b178b4e-f030-4fe6-9ff1-3fba59030e34\" (UID: \"1b178b4e-f030-4fe6-9ff1-3fba59030e34\") "
Jul 31 01:49:23.284046 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.283950    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b178b4e-f030-4fe6-9ff1-3fba59030e34-extensions-socket-volume\") pod \"1b178b4e-f030-4fe6-9ff1-3fba59030e34\" (UID: \"1b178b4e-f030-4fe6-9ff1-3fba59030e34\") "
Jul 31 01:49:23.284407 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.284372    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b178b4e-f030-4fe6-9ff1-3fba59030e34-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1b178b4e-f030-4fe6-9ff1-3fba59030e34" (UID: "1b178b4e-f030-4fe6-9ff1-3fba59030e34"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:49:23.286166 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.286142    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b178b4e-f030-4fe6-9ff1-3fba59030e34-kube-api-access-cqmh8" (OuterVolumeSpecName: "kube-api-access-cqmh8") pod "1b178b4e-f030-4fe6-9ff1-3fba59030e34" (UID: "1b178b4e-f030-4fe6-9ff1-3fba59030e34"). InnerVolumeSpecName "kube-api-access-cqmh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:49:23.286248 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.286161    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/138f189f-f041-4df3-be66-feb29e50ec4b-kube-api-access-lnn66" (OuterVolumeSpecName: "kube-api-access-lnn66") pod "138f189f-f041-4df3-be66-feb29e50ec4b" (UID: "138f189f-f041-4df3-be66-feb29e50ec4b"). InnerVolumeSpecName "kube-api-access-lnn66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:49:23.313228 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.313199    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vhbdl"
Jul 31 01:49:23.321261 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.321237    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-qgdk4"
Jul 31 01:49:23.329251 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.329222    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kkkph"
Jul 31 01:49:23.386887 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.386753    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b178b4e-f030-4fe6-9ff1-3fba59030e34-extensions-socket-volume\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:49:23.386887 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.386791    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnn66\" (UniqueName: \"kubernetes.io/projected/138f189f-f041-4df3-be66-feb29e50ec4b-kube-api-access-lnn66\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:49:23.386887 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.386808    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqmh8\" (UniqueName: \"kubernetes.io/projected/1b178b4e-f030-4fe6-9ff1-3fba59030e34-kube-api-access-cqmh8\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:49:23.497589 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.497553    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vhbdl"]
Jul 31 01:49:23.499165 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:49:23.499135    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc2d4b70_9509_4fc4_8761_bfad0b90dc68.slice/crio-ebb5cc0c97d5d87f38ea2b8c946143296eeb90515b04c58a62be3ffda1d25702 WatchSource:0}: Error finding container ebb5cc0c97d5d87f38ea2b8c946143296eeb90515b04c58a62be3ffda1d25702: Status 404 returned error can't find the container with id ebb5cc0c97d5d87f38ea2b8c946143296eeb90515b04c58a62be3ffda1d25702
Jul 31 01:49:23.729501 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.729478    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kkkph"]
Jul 31 01:49:23.731546 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:49:23.731520    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0c0becd_8b5b_4e72_9ac4_874e0aa24576.slice/crio-b7d9b039f30ac0faf612c8c3e5fa45825fd3842fa2327237d90def714b5cb202 WatchSource:0}: Error finding container b7d9b039f30ac0faf612c8c3e5fa45825fd3842fa2327237d90def714b5cb202: Status 404 returned error can't find the container with id b7d9b039f30ac0faf612c8c3e5fa45825fd3842fa2327237d90def714b5cb202
Jul 31 01:49:23.732055 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.732032    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-qgdk4"]
Jul 31 01:49:23.732534 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:49:23.732515    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa45062e_0d94_4fb3_9cbc_b6bfb2f534b5.slice/crio-126a6cd04d5f7717358e3718c1e18e5bce63f7bbd10ce63d6821e44e73ed27c4 WatchSource:0}: Error finding container 126a6cd04d5f7717358e3718c1e18e5bce63f7bbd10ce63d6821e44e73ed27c4: Status 404 returned error can't find the container with id 126a6cd04d5f7717358e3718c1e18e5bce63f7bbd10ce63d6821e44e73ed27c4
Jul 31 01:49:23.884049 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.884009    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-qgdk4" event={"ID":"aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5","Type":"ContainerStarted","Data":"60d6227b2961c26afa964c965229675664a361d859daf438ef4e4d7a42cb52ee"}
Jul 31 01:49:23.884534 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.884074    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-qgdk4"
Jul 31 01:49:23.884534 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.884099    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-qgdk4" event={"ID":"aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5","Type":"ContainerStarted","Data":"126a6cd04d5f7717358e3718c1e18e5bce63f7bbd10ce63d6821e44e73ed27c4"}
Jul 31 01:49:23.885448 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.885423    2571 generic.go:356] "Generic (PLEG): container finished" podID="1b178b4e-f030-4fe6-9ff1-3fba59030e34" containerID="0c0dad770b6611d8c0223c24cb86cdc76e49afa18f2b5e998e27c7146ee6df82" exitCode=0
Jul 31 01:49:23.885552 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.885460    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j"
Jul 31 01:49:23.885606 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.885563    2571 scope.go:117] "RemoveContainer" containerID="0c0dad770b6611d8c0223c24cb86cdc76e49afa18f2b5e998e27c7146ee6df82"
Jul 31 01:49:23.886312 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:49:23.886287    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-w5qcq\" is forbidden: User \"system:node:ip-10-0-133-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-91.ec2.internal' and this object" podUID="138f189f-f041-4df3-be66-feb29e50ec4b" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-w5qcq"
Jul 31 01:49:23.887200 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.887169    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kkkph" event={"ID":"b0c0becd-8b5b-4e72-9ac4-874e0aa24576","Type":"ContainerStarted","Data":"2c024d19384a34e45927ef549e74092cd33dd3238b140ad142c0e611aef7ca34"}
Jul 31 01:49:23.887291 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.887216    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kkkph" event={"ID":"b0c0becd-8b5b-4e72-9ac4-874e0aa24576","Type":"ContainerStarted","Data":"b7d9b039f30ac0faf612c8c3e5fa45825fd3842fa2327237d90def714b5cb202"}
Jul 31 01:49:23.887291 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.887244    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kkkph"
Jul 31 01:49:23.888251 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:49:23.888225    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-2l99j\" is forbidden: User \"system:node:ip-10-0-133-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-91.ec2.internal' and this object" podUID="1b178b4e-f030-4fe6-9ff1-3fba59030e34" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j"
Jul 31 01:49:23.889345 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.889320    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vhbdl" event={"ID":"cc2d4b70-9509-4fc4-8761-bfad0b90dc68","Type":"ContainerStarted","Data":"f1a4be4fafed406f9fc7ecec23ea7542ee0c06e13e809a96d72dc1cdeb485af6"}
Jul 31 01:49:23.889464 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.889369    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vhbdl" event={"ID":"cc2d4b70-9509-4fc4-8761-bfad0b90dc68","Type":"ContainerStarted","Data":"ebb5cc0c97d5d87f38ea2b8c946143296eeb90515b04c58a62be3ffda1d25702"}
Jul 31 01:49:23.889464 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.889415    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vhbdl"
Jul 31 01:49:23.890992 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.890970    2571 generic.go:356] "Generic (PLEG): container finished" podID="138f189f-f041-4df3-be66-feb29e50ec4b" containerID="d30655920ea770f6ca6be6792d1c10a1e3f3fb1ebcfcec57f2246e307a0a534d" exitCode=0
Jul 31 01:49:23.891093 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.891024    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-w5qcq"
Jul 31 01:49:23.905771 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.905728    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-qgdk4" podStartSLOduration=1.905710994 podStartE2EDuration="1.905710994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:49:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:49:23.904626069 +0000 UTC m=+724.484867094" watchObservedRunningTime="2026-07-31 01:49:23.905710994 +0000 UTC m=+724.485951989"
Jul 31 01:49:23.915484 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.915463    2571 scope.go:117] "RemoveContainer" containerID="0c0dad770b6611d8c0223c24cb86cdc76e49afa18f2b5e998e27c7146ee6df82"
Jul 31 01:49:23.915764 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:49:23.915746    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c0dad770b6611d8c0223c24cb86cdc76e49afa18f2b5e998e27c7146ee6df82\": container with ID starting with 0c0dad770b6611d8c0223c24cb86cdc76e49afa18f2b5e998e27c7146ee6df82 not found: ID does not exist" containerID="0c0dad770b6611d8c0223c24cb86cdc76e49afa18f2b5e998e27c7146ee6df82"
Jul 31 01:49:23.915813 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.915772    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c0dad770b6611d8c0223c24cb86cdc76e49afa18f2b5e998e27c7146ee6df82"} err="failed to get container status \"0c0dad770b6611d8c0223c24cb86cdc76e49afa18f2b5e998e27c7146ee6df82\": rpc error: code = NotFound desc = could not find container \"0c0dad770b6611d8c0223c24cb86cdc76e49afa18f2b5e998e27c7146ee6df82\": container with ID starting with 0c0dad770b6611d8c0223c24cb86cdc76e49afa18f2b5e998e27c7146ee6df82 not found: ID does not exist"
Jul 31 01:49:23.915813 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.915789    2571 scope.go:117] "RemoveContainer" containerID="d30655920ea770f6ca6be6792d1c10a1e3f3fb1ebcfcec57f2246e307a0a534d"
Jul 31 01:49:23.922743 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.922705    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kkkph" podStartSLOduration=1.9226916539999999 podStartE2EDuration="1.922691654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:49:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:49:23.921997647 +0000 UTC m=+724.502238642" watchObservedRunningTime="2026-07-31 01:49:23.922691654 +0000 UTC m=+724.502932649"
Jul 31 01:49:23.924000 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:49:23.923979    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-2l99j\" is forbidden: User \"system:node:ip-10-0-133-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-91.ec2.internal' and this object" podUID="1b178b4e-f030-4fe6-9ff1-3fba59030e34" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j"
Jul 31 01:49:23.924363 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.924349    2571 scope.go:117] "RemoveContainer" containerID="d30655920ea770f6ca6be6792d1c10a1e3f3fb1ebcfcec57f2246e307a0a534d"
Jul 31 01:49:23.924640 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:49:23.924622    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d30655920ea770f6ca6be6792d1c10a1e3f3fb1ebcfcec57f2246e307a0a534d\": container with ID starting with d30655920ea770f6ca6be6792d1c10a1e3f3fb1ebcfcec57f2246e307a0a534d not found: ID does not exist" containerID="d30655920ea770f6ca6be6792d1c10a1e3f3fb1ebcfcec57f2246e307a0a534d"
Jul 31 01:49:23.924684 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.924648    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d30655920ea770f6ca6be6792d1c10a1e3f3fb1ebcfcec57f2246e307a0a534d"} err="failed to get container status \"d30655920ea770f6ca6be6792d1c10a1e3f3fb1ebcfcec57f2246e307a0a534d\": rpc error: code = NotFound desc = could not find container \"d30655920ea770f6ca6be6792d1c10a1e3f3fb1ebcfcec57f2246e307a0a534d\": container with ID starting with d30655920ea770f6ca6be6792d1c10a1e3f3fb1ebcfcec57f2246e307a0a534d not found: ID does not exist"
Jul 31 01:49:23.944938 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.944867    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vhbdl" podStartSLOduration=1.944850768 podStartE2EDuration="1.944850768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:49:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:49:23.943748377 +0000 UTC m=+724.523989375" watchObservedRunningTime="2026-07-31 01:49:23.944850768 +0000 UTC m=+724.525091763"
Jul 31 01:49:23.945813 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:49:23.945782    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-w5qcq\" is forbidden: User \"system:node:ip-10-0-133-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-91.ec2.internal' and this object" podUID="138f189f-f041-4df3-be66-feb29e50ec4b" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-w5qcq"
Jul 31 01:49:23.947726 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:49:23.947697    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-2l99j\" is forbidden: User \"system:node:ip-10-0-133-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-91.ec2.internal' and this object" podUID="1b178b4e-f030-4fe6-9ff1-3fba59030e34" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2l99j"
Jul 31 01:49:23.949597 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:49:23.949572    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-w5qcq\" is forbidden: User \"system:node:ip-10-0-133-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-91.ec2.internal' and this object" podUID="138f189f-f041-4df3-be66-feb29e50ec4b" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-w5qcq"
Jul 31 01:49:23.992622 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.992542    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="138f189f-f041-4df3-be66-feb29e50ec4b" path="/var/lib/kubelet/pods/138f189f-f041-4df3-be66-feb29e50ec4b/volumes"
Jul 31 01:49:23.992925 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:23.992883    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b178b4e-f030-4fe6-9ff1-3fba59030e34" path="/var/lib/kubelet/pods/1b178b4e-f030-4fe6-9ff1-3fba59030e34/volumes"
Jul 31 01:49:34.901168 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:34.901136    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-qgdk4"
Jul 31 01:49:34.901591 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:34.901218    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-kkkph"
Jul 31 01:49:34.901591 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:34.901264    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vhbdl"
Jul 31 01:49:34.989441 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:34.989406    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-qgdk4"]
Jul 31 01:49:34.989687 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:34.989621    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-qgdk4" podUID="aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5" containerName="manager" containerID="cri-o://60d6227b2961c26afa964c965229675664a361d859daf438ef4e4d7a42cb52ee" gracePeriod=10
Jul 31 01:49:35.254730 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:35.254660    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-qgdk4"
Jul 31 01:49:35.394041 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:35.394006    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5-extensions-socket-volume\") pod \"aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5\" (UID: \"aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5\") "
Jul 31 01:49:35.394239 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:35.394115    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5s27q\" (UniqueName: \"kubernetes.io/projected/aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5-kube-api-access-5s27q\") pod \"aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5\" (UID: \"aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5\") "
Jul 31 01:49:35.394389 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:35.394364    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5" (UID: "aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 01:49:35.396275 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:35.396248    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5-kube-api-access-5s27q" (OuterVolumeSpecName: "kube-api-access-5s27q") pod "aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5" (UID: "aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5"). InnerVolumeSpecName "kube-api-access-5s27q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:49:35.495672 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:35.495586    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5-extensions-socket-volume\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:49:35.495672 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:35.495614    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5s27q\" (UniqueName: \"kubernetes.io/projected/aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5-kube-api-access-5s27q\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:49:35.957912 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:35.957863    2571 generic.go:356] "Generic (PLEG): container finished" podID="aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5" containerID="60d6227b2961c26afa964c965229675664a361d859daf438ef4e4d7a42cb52ee" exitCode=0
Jul 31 01:49:35.958447 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:35.957920    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-qgdk4"
Jul 31 01:49:35.958447 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:35.957945    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-qgdk4" event={"ID":"aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5","Type":"ContainerDied","Data":"60d6227b2961c26afa964c965229675664a361d859daf438ef4e4d7a42cb52ee"}
Jul 31 01:49:35.958447 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:35.958000    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-qgdk4" event={"ID":"aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5","Type":"ContainerDied","Data":"126a6cd04d5f7717358e3718c1e18e5bce63f7bbd10ce63d6821e44e73ed27c4"}
Jul 31 01:49:35.958447 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:35.958022    2571 scope.go:117] "RemoveContainer" containerID="60d6227b2961c26afa964c965229675664a361d859daf438ef4e4d7a42cb52ee"
Jul 31 01:49:35.967169 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:35.967151    2571 scope.go:117] "RemoveContainer" containerID="60d6227b2961c26afa964c965229675664a361d859daf438ef4e4d7a42cb52ee"
Jul 31 01:49:35.967450 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:49:35.967431    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60d6227b2961c26afa964c965229675664a361d859daf438ef4e4d7a42cb52ee\": container with ID starting with 60d6227b2961c26afa964c965229675664a361d859daf438ef4e4d7a42cb52ee not found: ID does not exist" containerID="60d6227b2961c26afa964c965229675664a361d859daf438ef4e4d7a42cb52ee"
Jul 31 01:49:35.967497 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:35.967459    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60d6227b2961c26afa964c965229675664a361d859daf438ef4e4d7a42cb52ee"} err="failed to get container status \"60d6227b2961c26afa964c965229675664a361d859daf438ef4e4d7a42cb52ee\": rpc error: code = NotFound desc = could not find container \"60d6227b2961c26afa964c965229675664a361d859daf438ef4e4d7a42cb52ee\": container with ID starting with 60d6227b2961c26afa964c965229675664a361d859daf438ef4e4d7a42cb52ee not found: ID does not exist"
Jul 31 01:49:35.983928 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:35.983880    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-qgdk4"]
Jul 31 01:49:35.999953 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:35.999920    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-qgdk4"]
Jul 31 01:49:37.992217 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:37.992181    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5" path="/var/lib/kubelet/pods/aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5/volumes"
Jul 31 01:49:51.400233 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.400181    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"]
Jul 31 01:49:51.400848 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.400767    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5" containerName="manager"
Jul 31 01:49:51.400848 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.400786    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5" containerName="manager"
Jul 31 01:49:51.401001 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.400925    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa45062e-0d94-4fb3-9cbc-b6bfb2f534b5" containerName="manager"
Jul 31 01:49:51.403277 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.403261    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.405830 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.405811    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-rd4cm\""
Jul 31 01:49:51.415694 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.415668    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"]
Jul 31 01:49:51.438159 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.438127    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90a0eefd-19e3-44f9-8390-2e82d93e10f3-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-58nx6\" (UID: \"90a0eefd-19e3-44f9-8390-2e82d93e10f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.438335 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.438173    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7gsv\" (UniqueName: \"kubernetes.io/projected/90a0eefd-19e3-44f9-8390-2e82d93e10f3-kube-api-access-r7gsv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-58nx6\" (UID: \"90a0eefd-19e3-44f9-8390-2e82d93e10f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.438335 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.438200    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90a0eefd-19e3-44f9-8390-2e82d93e10f3-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-58nx6\" (UID: \"90a0eefd-19e3-44f9-8390-2e82d93e10f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.438335 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.438220    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90a0eefd-19e3-44f9-8390-2e82d93e10f3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-58nx6\" (UID: \"90a0eefd-19e3-44f9-8390-2e82d93e10f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.438457 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.438356    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90a0eefd-19e3-44f9-8390-2e82d93e10f3-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-58nx6\" (UID: \"90a0eefd-19e3-44f9-8390-2e82d93e10f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.438457 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.438397    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90a0eefd-19e3-44f9-8390-2e82d93e10f3-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-58nx6\" (UID: \"90a0eefd-19e3-44f9-8390-2e82d93e10f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.438529 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.438476    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90a0eefd-19e3-44f9-8390-2e82d93e10f3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-58nx6\" (UID: \"90a0eefd-19e3-44f9-8390-2e82d93e10f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.438529 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.438514    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90a0eefd-19e3-44f9-8390-2e82d93e10f3-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-58nx6\" (UID: \"90a0eefd-19e3-44f9-8390-2e82d93e10f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.438593 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.438544    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90a0eefd-19e3-44f9-8390-2e82d93e10f3-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-58nx6\" (UID: \"90a0eefd-19e3-44f9-8390-2e82d93e10f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.539582 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.539542    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90a0eefd-19e3-44f9-8390-2e82d93e10f3-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-58nx6\" (UID: \"90a0eefd-19e3-44f9-8390-2e82d93e10f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.539582 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.539581    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90a0eefd-19e3-44f9-8390-2e82d93e10f3-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-58nx6\" (UID: \"90a0eefd-19e3-44f9-8390-2e82d93e10f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.539807 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.539703    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90a0eefd-19e3-44f9-8390-2e82d93e10f3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-58nx6\" (UID: \"90a0eefd-19e3-44f9-8390-2e82d93e10f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.539807 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.539753    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90a0eefd-19e3-44f9-8390-2e82d93e10f3-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-58nx6\" (UID: \"90a0eefd-19e3-44f9-8390-2e82d93e10f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.539807 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.539793    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90a0eefd-19e3-44f9-8390-2e82d93e10f3-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-58nx6\" (UID: \"90a0eefd-19e3-44f9-8390-2e82d93e10f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.539987 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.539818    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90a0eefd-19e3-44f9-8390-2e82d93e10f3-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-58nx6\" (UID: \"90a0eefd-19e3-44f9-8390-2e82d93e10f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.539987 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.539855    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7gsv\" (UniqueName: \"kubernetes.io/projected/90a0eefd-19e3-44f9-8390-2e82d93e10f3-kube-api-access-r7gsv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-58nx6\" (UID: \"90a0eefd-19e3-44f9-8390-2e82d93e10f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.539987 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.539883    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90a0eefd-19e3-44f9-8390-2e82d93e10f3-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-58nx6\" (UID: \"90a0eefd-19e3-44f9-8390-2e82d93e10f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.539987 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.539936    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90a0eefd-19e3-44f9-8390-2e82d93e10f3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-58nx6\" (UID: \"90a0eefd-19e3-44f9-8390-2e82d93e10f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.539987 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.539962    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90a0eefd-19e3-44f9-8390-2e82d93e10f3-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-58nx6\" (UID: \"90a0eefd-19e3-44f9-8390-2e82d93e10f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.540220 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.540026    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90a0eefd-19e3-44f9-8390-2e82d93e10f3-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-58nx6\" (UID: \"90a0eefd-19e3-44f9-8390-2e82d93e10f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.540220 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.540157    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90a0eefd-19e3-44f9-8390-2e82d93e10f3-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-58nx6\" (UID: \"90a0eefd-19e3-44f9-8390-2e82d93e10f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.540429 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.540409    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90a0eefd-19e3-44f9-8390-2e82d93e10f3-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-58nx6\" (UID: \"90a0eefd-19e3-44f9-8390-2e82d93e10f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.540555 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.540537    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90a0eefd-19e3-44f9-8390-2e82d93e10f3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-58nx6\" (UID: \"90a0eefd-19e3-44f9-8390-2e82d93e10f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.542162 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.542140    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90a0eefd-19e3-44f9-8390-2e82d93e10f3-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-58nx6\" (UID: \"90a0eefd-19e3-44f9-8390-2e82d93e10f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.542297 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.542280    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90a0eefd-19e3-44f9-8390-2e82d93e10f3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-58nx6\" (UID: \"90a0eefd-19e3-44f9-8390-2e82d93e10f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.549362 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.549305    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90a0eefd-19e3-44f9-8390-2e82d93e10f3-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-58nx6\" (UID: \"90a0eefd-19e3-44f9-8390-2e82d93e10f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.549362 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.549318    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7gsv\" (UniqueName: \"kubernetes.io/projected/90a0eefd-19e3-44f9-8390-2e82d93e10f3-kube-api-access-r7gsv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-58nx6\" (UID: \"90a0eefd-19e3-44f9-8390-2e82d93e10f3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.716503 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.716408    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:51.856670 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.856640    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"]
Jul 31 01:49:51.858276 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:49:51.858253    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90a0eefd_19e3_44f9_8390_2e82d93e10f3.slice/crio-65d17d13c700dae368ab93167b363059543d485a78e787f5a93bde1325a0edbb WatchSource:0}: Error finding container 65d17d13c700dae368ab93167b363059543d485a78e787f5a93bde1325a0edbb: Status 404 returned error can't find the container with id 65d17d13c700dae368ab93167b363059543d485a78e787f5a93bde1325a0edbb
Jul 31 01:49:51.860400 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.860371    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 01:49:51.860472 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.860460    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 01:49:51.860511 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:51.860492    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 01:49:52.046017 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:52.045885    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6" event={"ID":"90a0eefd-19e3-44f9-8390-2e82d93e10f3","Type":"ContainerStarted","Data":"c97efae50d2aefa8c84c1041562261972157a751931bd9d747a7dac2980158c2"}
Jul 31 01:49:52.046017 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:52.045967    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6" event={"ID":"90a0eefd-19e3-44f9-8390-2e82d93e10f3","Type":"ContainerStarted","Data":"65d17d13c700dae368ab93167b363059543d485a78e787f5a93bde1325a0edbb"}
Jul 31 01:49:52.066598 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:52.066547    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6" podStartSLOduration=1.066530623 podStartE2EDuration="1.066530623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:49:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:49:52.064887752 +0000 UTC m=+752.645128758" watchObservedRunningTime="2026-07-31 01:49:52.066530623 +0000 UTC m=+752.646771683"
Jul 31 01:49:52.717416 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:52.717379    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:52.722218 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:52.722190    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:53.051517 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:53.051415    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:53.052529 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:53.052502    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:49:53.880135 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:53.880104    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-8f85v"]
Jul 31 01:49:53.882669 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:53.882653    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-8f85v"
Jul 31 01:49:53.885338 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:53.885317    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jxhng\""
Jul 31 01:49:53.891671 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:53.891645    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-8f85v"]
Jul 31 01:49:53.962071 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:53.962040    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cttb8\" (UniqueName: \"kubernetes.io/projected/e6958f47-5e97-473d-b7f4-95cbc0f3bc44-kube-api-access-cttb8\") pod \"authorino-b54df94b4-8f85v\" (UID: \"e6958f47-5e97-473d-b7f4-95cbc0f3bc44\") " pod="kuadrant-system/authorino-b54df94b4-8f85v"
Jul 31 01:49:54.062709 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:54.062676    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cttb8\" (UniqueName: \"kubernetes.io/projected/e6958f47-5e97-473d-b7f4-95cbc0f3bc44-kube-api-access-cttb8\") pod \"authorino-b54df94b4-8f85v\" (UID: \"e6958f47-5e97-473d-b7f4-95cbc0f3bc44\") " pod="kuadrant-system/authorino-b54df94b4-8f85v"
Jul 31 01:49:54.072441 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:54.072402    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cttb8\" (UniqueName: \"kubernetes.io/projected/e6958f47-5e97-473d-b7f4-95cbc0f3bc44-kube-api-access-cttb8\") pod \"authorino-b54df94b4-8f85v\" (UID: \"e6958f47-5e97-473d-b7f4-95cbc0f3bc44\") " pod="kuadrant-system/authorino-b54df94b4-8f85v"
Jul 31 01:49:54.076086 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:54.076058    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-hhckd"]
Jul 31 01:49:54.078710 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:54.078689    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-hhckd"
Jul 31 01:49:54.085740 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:54.085713    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-hhckd"]
Jul 31 01:49:54.163502 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:54.163411    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmfrm\" (UniqueName: \"kubernetes.io/projected/114e8304-0379-481c-9e3f-a7bb9d9695b2-kube-api-access-lmfrm\") pod \"authorino-c548b5d7d-hhckd\" (UID: \"114e8304-0379-481c-9e3f-a7bb9d9695b2\") " pod="kuadrant-system/authorino-c548b5d7d-hhckd"
Jul 31 01:49:54.194485 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:54.194445    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-8f85v"
Jul 31 01:49:54.265138 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:54.265109    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmfrm\" (UniqueName: \"kubernetes.io/projected/114e8304-0379-481c-9e3f-a7bb9d9695b2-kube-api-access-lmfrm\") pod \"authorino-c548b5d7d-hhckd\" (UID: \"114e8304-0379-481c-9e3f-a7bb9d9695b2\") " pod="kuadrant-system/authorino-c548b5d7d-hhckd"
Jul 31 01:49:54.273479 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:54.273448    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmfrm\" (UniqueName: \"kubernetes.io/projected/114e8304-0379-481c-9e3f-a7bb9d9695b2-kube-api-access-lmfrm\") pod \"authorino-c548b5d7d-hhckd\" (UID: \"114e8304-0379-481c-9e3f-a7bb9d9695b2\") " pod="kuadrant-system/authorino-c548b5d7d-hhckd"
Jul 31 01:49:54.328738 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:54.328707    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-8f85v"]
Jul 31 01:49:54.330776 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:49:54.330752    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6958f47_5e97_473d_b7f4_95cbc0f3bc44.slice/crio-53adecdda5a57ec81c8de227eebdf939e6a825b7a0009ae32523cb8065d1cb0a WatchSource:0}: Error finding container 53adecdda5a57ec81c8de227eebdf939e6a825b7a0009ae32523cb8065d1cb0a: Status 404 returned error can't find the container with id 53adecdda5a57ec81c8de227eebdf939e6a825b7a0009ae32523cb8065d1cb0a
Jul 31 01:49:54.391156 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:54.391119    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-hhckd"
Jul 31 01:49:54.526102 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:54.525993    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-hhckd"]
Jul 31 01:49:54.528236 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:49:54.528204    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod114e8304_0379_481c_9e3f_a7bb9d9695b2.slice/crio-9f2af3df94ccfedf34a6ba73b1c41e8f59cfd235ce83665029f9c2082d9409be WatchSource:0}: Error finding container 9f2af3df94ccfedf34a6ba73b1c41e8f59cfd235ce83665029f9c2082d9409be: Status 404 returned error can't find the container with id 9f2af3df94ccfedf34a6ba73b1c41e8f59cfd235ce83665029f9c2082d9409be
Jul 31 01:49:55.063080 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:55.063046    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-hhckd" event={"ID":"114e8304-0379-481c-9e3f-a7bb9d9695b2","Type":"ContainerStarted","Data":"9f2af3df94ccfedf34a6ba73b1c41e8f59cfd235ce83665029f9c2082d9409be"}
Jul 31 01:49:55.064293 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:55.064272    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-8f85v" event={"ID":"e6958f47-5e97-473d-b7f4-95cbc0f3bc44","Type":"ContainerStarted","Data":"53adecdda5a57ec81c8de227eebdf939e6a825b7a0009ae32523cb8065d1cb0a"}
Jul 31 01:49:58.088087 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:58.088053    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-hhckd" event={"ID":"114e8304-0379-481c-9e3f-a7bb9d9695b2","Type":"ContainerStarted","Data":"6e90e998de6dae6c2631e6374fc138ee5187a5687577650225e857d3075301a8"}
Jul 31 01:49:58.089521 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:58.089498    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-8f85v" event={"ID":"e6958f47-5e97-473d-b7f4-95cbc0f3bc44","Type":"ContainerStarted","Data":"cf228f5a491a86f2971d1d462d2609c69d5d7a1dc3d4ae1f432aec9b8a33724d"}
Jul 31 01:49:58.103735 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:58.103691    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-hhckd" podStartSLOduration=1.064821055 podStartE2EDuration="4.103677963s" totalImagesPullingTime="3.038856908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:49:58.102842879 +0000 UTC m=+758.683083873" watchObservedRunningTime="2026-07-31 01:49:58.103677963 +0000 UTC m=+758.683918992"
Jul 31 01:49:58.118323 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:58.118273    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-8f85v" podStartSLOduration=1.7728415690000001 podStartE2EDuration="5.118257243s" totalImagesPullingTime="3.345415674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:49:58.11630209 +0000 UTC m=+758.696543089" watchObservedRunningTime="2026-07-31 01:49:58.118257243 +0000 UTC m=+758.698498237"
Jul 31 01:49:58.142759 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:49:58.142721    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-8f85v"]
Jul 31 01:50:00.100244 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:00.100206    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-8f85v" podUID="e6958f47-5e97-473d-b7f4-95cbc0f3bc44" containerName="authorino" containerID="cri-o://cf228f5a491a86f2971d1d462d2609c69d5d7a1dc3d4ae1f432aec9b8a33724d" gracePeriod=30
Jul 31 01:50:00.343621 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:00.343592    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-8f85v"
Jul 31 01:50:00.423393 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:00.423304    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cttb8\" (UniqueName: \"kubernetes.io/projected/e6958f47-5e97-473d-b7f4-95cbc0f3bc44-kube-api-access-cttb8\") pod \"e6958f47-5e97-473d-b7f4-95cbc0f3bc44\" (UID: \"e6958f47-5e97-473d-b7f4-95cbc0f3bc44\") "
Jul 31 01:50:00.425450 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:00.425416    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6958f47-5e97-473d-b7f4-95cbc0f3bc44-kube-api-access-cttb8" (OuterVolumeSpecName: "kube-api-access-cttb8") pod "e6958f47-5e97-473d-b7f4-95cbc0f3bc44" (UID: "e6958f47-5e97-473d-b7f4-95cbc0f3bc44"). InnerVolumeSpecName "kube-api-access-cttb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:50:00.524172 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:00.524129    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cttb8\" (UniqueName: \"kubernetes.io/projected/e6958f47-5e97-473d-b7f4-95cbc0f3bc44-kube-api-access-cttb8\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:50:01.106773 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:01.106741    2571 generic.go:356] "Generic (PLEG): container finished" podID="e6958f47-5e97-473d-b7f4-95cbc0f3bc44" containerID="cf228f5a491a86f2971d1d462d2609c69d5d7a1dc3d4ae1f432aec9b8a33724d" exitCode=0
Jul 31 01:50:01.107229 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:01.106786    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-8f85v"
Jul 31 01:50:01.107229 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:01.106823    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-8f85v" event={"ID":"e6958f47-5e97-473d-b7f4-95cbc0f3bc44","Type":"ContainerDied","Data":"cf228f5a491a86f2971d1d462d2609c69d5d7a1dc3d4ae1f432aec9b8a33724d"}
Jul 31 01:50:01.107229 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:01.106864    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-8f85v" event={"ID":"e6958f47-5e97-473d-b7f4-95cbc0f3bc44","Type":"ContainerDied","Data":"53adecdda5a57ec81c8de227eebdf939e6a825b7a0009ae32523cb8065d1cb0a"}
Jul 31 01:50:01.107229 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:01.106884    2571 scope.go:117] "RemoveContainer" containerID="cf228f5a491a86f2971d1d462d2609c69d5d7a1dc3d4ae1f432aec9b8a33724d"
Jul 31 01:50:01.115682 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:01.115667    2571 scope.go:117] "RemoveContainer" containerID="cf228f5a491a86f2971d1d462d2609c69d5d7a1dc3d4ae1f432aec9b8a33724d"
Jul 31 01:50:01.115949 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:50:01.115926    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf228f5a491a86f2971d1d462d2609c69d5d7a1dc3d4ae1f432aec9b8a33724d\": container with ID starting with cf228f5a491a86f2971d1d462d2609c69d5d7a1dc3d4ae1f432aec9b8a33724d not found: ID does not exist" containerID="cf228f5a491a86f2971d1d462d2609c69d5d7a1dc3d4ae1f432aec9b8a33724d"
Jul 31 01:50:01.116007 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:01.115957    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf228f5a491a86f2971d1d462d2609c69d5d7a1dc3d4ae1f432aec9b8a33724d"} err="failed to get container status \"cf228f5a491a86f2971d1d462d2609c69d5d7a1dc3d4ae1f432aec9b8a33724d\": rpc error: code = NotFound desc = could not find container \"cf228f5a491a86f2971d1d462d2609c69d5d7a1dc3d4ae1f432aec9b8a33724d\": container with ID starting with cf228f5a491a86f2971d1d462d2609c69d5d7a1dc3d4ae1f432aec9b8a33724d not found: ID does not exist"
Jul 31 01:50:01.129016 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:01.128992    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-8f85v"]
Jul 31 01:50:01.132812 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:01.132792    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-8f85v"]
Jul 31 01:50:01.993606 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:01.993573    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6958f47-5e97-473d-b7f4-95cbc0f3bc44" path="/var/lib/kubelet/pods/e6958f47-5e97-473d-b7f4-95cbc0f3bc44/volumes"
Jul 31 01:50:29.444620 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:29.444591    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-zn9p4"]
Jul 31 01:50:29.445148 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:29.445104    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6958f47-5e97-473d-b7f4-95cbc0f3bc44" containerName="authorino"
Jul 31 01:50:29.445148 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:29.445122    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6958f47-5e97-473d-b7f4-95cbc0f3bc44" containerName="authorino"
Jul 31 01:50:29.445259 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:29.445233    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6958f47-5e97-473d-b7f4-95cbc0f3bc44" containerName="authorino"
Jul 31 01:50:29.450529 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:29.450512    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-zn9p4"
Jul 31 01:50:29.454342 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:29.454319    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-zn9p4"]
Jul 31 01:50:29.599737 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:29.599704    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wmn6\" (UniqueName: \"kubernetes.io/projected/42372c12-9481-42df-bcb6-2b055ed34870-kube-api-access-9wmn6\") pod \"authorino-5dc7ccb5f-zn9p4\" (UID: \"42372c12-9481-42df-bcb6-2b055ed34870\") " pod="kuadrant-system/authorino-5dc7ccb5f-zn9p4"
Jul 31 01:50:29.614918 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:29.614876    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-zn9p4"]
Jul 31 01:50:29.615184 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:50:29.615164    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-9wmn6], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5dc7ccb5f-zn9p4" podUID="42372c12-9481-42df-bcb6-2b055ed34870"
Jul 31 01:50:29.643020 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:29.642993    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-687bd45585-mgn2q"]
Jul 31 01:50:29.647370 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:29.647349    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-mgn2q"
Jul 31 01:50:29.649863 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:29.649840    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 31 01:50:29.652767 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:29.652737    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687bd45585-mgn2q"]
Jul 31 01:50:29.689249 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:29.689219    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-mgn2q"]
Jul 31 01:50:29.689544 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:50:29.689524    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-j4k4q tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-j4k4q tls-cert]: context canceled" pod="kuadrant-system/authorino-687bd45585-mgn2q" podUID="ff5f4047-fefa-4150-b976-73bbee6748de"
Jul 31 01:50:29.700527 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:29.700456    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wmn6\" (UniqueName: \"kubernetes.io/projected/42372c12-9481-42df-bcb6-2b055ed34870-kube-api-access-9wmn6\") pod \"authorino-5dc7ccb5f-zn9p4\" (UID: \"42372c12-9481-42df-bcb6-2b055ed34870\") " pod="kuadrant-system/authorino-5dc7ccb5f-zn9p4"
Jul 31 01:50:29.711673 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:29.711648    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wmn6\" (UniqueName: \"kubernetes.io/projected/42372c12-9481-42df-bcb6-2b055ed34870-kube-api-access-9wmn6\") pod \"authorino-5dc7ccb5f-zn9p4\" (UID: \"42372c12-9481-42df-bcb6-2b055ed34870\") " pod="kuadrant-system/authorino-5dc7ccb5f-zn9p4"
Jul 31 01:50:29.715822 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:29.715803    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7b64fdf4cb-rhh9r"]
Jul 31 01:50:29.720235 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:29.720214    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b64fdf4cb-rhh9r"
Jul 31 01:50:29.729090 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:29.729067    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b64fdf4cb-rhh9r"]
Jul 31 01:50:29.801371 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:29.801334    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff5f4047-fefa-4150-b976-73bbee6748de-tls-cert\") pod \"authorino-687bd45585-mgn2q\" (UID: \"ff5f4047-fefa-4150-b976-73bbee6748de\") " pod="kuadrant-system/authorino-687bd45585-mgn2q"
Jul 31 01:50:29.801509 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:29.801399    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4k4q\" (UniqueName: \"kubernetes.io/projected/ff5f4047-fefa-4150-b976-73bbee6748de-kube-api-access-j4k4q\") pod \"authorino-687bd45585-mgn2q\" (UID: \"ff5f4047-fefa-4150-b976-73bbee6748de\") " pod="kuadrant-system/authorino-687bd45585-mgn2q"
Jul 31 01:50:29.902195 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:29.902160    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff5f4047-fefa-4150-b976-73bbee6748de-tls-cert\") pod \"authorino-687bd45585-mgn2q\" (UID: \"ff5f4047-fefa-4150-b976-73bbee6748de\") " pod="kuadrant-system/authorino-687bd45585-mgn2q"
Jul 31 01:50:29.902362 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:29.902206    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6mg7\" (UniqueName: \"kubernetes.io/projected/df618cfe-7f2a-4f08-94f4-56a1dda0600d-kube-api-access-z6mg7\") pod \"authorino-7b64fdf4cb-rhh9r\" (UID: \"df618cfe-7f2a-4f08-94f4-56a1dda0600d\") " pod="kuadrant-system/authorino-7b64fdf4cb-rhh9r"
Jul 31 01:50:29.902362 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:29.902259    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4k4q\" (UniqueName: \"kubernetes.io/projected/ff5f4047-fefa-4150-b976-73bbee6748de-kube-api-access-j4k4q\") pod \"authorino-687bd45585-mgn2q\" (UID: \"ff5f4047-fefa-4150-b976-73bbee6748de\") " pod="kuadrant-system/authorino-687bd45585-mgn2q"
Jul 31 01:50:29.902362 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:29.902286    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/df618cfe-7f2a-4f08-94f4-56a1dda0600d-tls-cert\") pod \"authorino-7b64fdf4cb-rhh9r\" (UID: \"df618cfe-7f2a-4f08-94f4-56a1dda0600d\") " pod="kuadrant-system/authorino-7b64fdf4cb-rhh9r"
Jul 31 01:50:29.904548 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:29.904520    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff5f4047-fefa-4150-b976-73bbee6748de-tls-cert\") pod \"authorino-687bd45585-mgn2q\" (UID: \"ff5f4047-fefa-4150-b976-73bbee6748de\") " pod="kuadrant-system/authorino-687bd45585-mgn2q"
Jul 31 01:50:29.910516 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:29.910490    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4k4q\" (UniqueName: \"kubernetes.io/projected/ff5f4047-fefa-4150-b976-73bbee6748de-kube-api-access-j4k4q\") pod \"authorino-687bd45585-mgn2q\" (UID: \"ff5f4047-fefa-4150-b976-73bbee6748de\") " pod="kuadrant-system/authorino-687bd45585-mgn2q"
Jul 31 01:50:30.003079 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:30.003005    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6mg7\" (UniqueName: \"kubernetes.io/projected/df618cfe-7f2a-4f08-94f4-56a1dda0600d-kube-api-access-z6mg7\") pod \"authorino-7b64fdf4cb-rhh9r\" (UID: \"df618cfe-7f2a-4f08-94f4-56a1dda0600d\") " pod="kuadrant-system/authorino-7b64fdf4cb-rhh9r"
Jul 31 01:50:30.003079 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:30.003060    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/df618cfe-7f2a-4f08-94f4-56a1dda0600d-tls-cert\") pod \"authorino-7b64fdf4cb-rhh9r\" (UID: \"df618cfe-7f2a-4f08-94f4-56a1dda0600d\") " pod="kuadrant-system/authorino-7b64fdf4cb-rhh9r"
Jul 31 01:50:30.005345 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:30.005314    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/df618cfe-7f2a-4f08-94f4-56a1dda0600d-tls-cert\") pod \"authorino-7b64fdf4cb-rhh9r\" (UID: \"df618cfe-7f2a-4f08-94f4-56a1dda0600d\") " pod="kuadrant-system/authorino-7b64fdf4cb-rhh9r"
Jul 31 01:50:30.010878 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:30.010855    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6mg7\" (UniqueName: \"kubernetes.io/projected/df618cfe-7f2a-4f08-94f4-56a1dda0600d-kube-api-access-z6mg7\") pod \"authorino-7b64fdf4cb-rhh9r\" (UID: \"df618cfe-7f2a-4f08-94f4-56a1dda0600d\") " pod="kuadrant-system/authorino-7b64fdf4cb-rhh9r"
Jul 31 01:50:30.031259 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:30.031243    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b64fdf4cb-rhh9r"
Jul 31 01:50:30.162160 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:30.162134    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b64fdf4cb-rhh9r"]
Jul 31 01:50:30.164098 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:50:30.164071    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf618cfe_7f2a_4f08_94f4_56a1dda0600d.slice/crio-5680db19a411954044b2b6dd743b84d8261fe612af550536a7748a641799c092 WatchSource:0}: Error finding container 5680db19a411954044b2b6dd743b84d8261fe612af550536a7748a641799c092: Status 404 returned error can't find the container with id 5680db19a411954044b2b6dd743b84d8261fe612af550536a7748a641799c092
Jul 31 01:50:30.264677 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:30.264594    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b64fdf4cb-rhh9r" event={"ID":"df618cfe-7f2a-4f08-94f4-56a1dda0600d","Type":"ContainerStarted","Data":"5680db19a411954044b2b6dd743b84d8261fe612af550536a7748a641799c092"}
Jul 31 01:50:30.264677 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:30.264657    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-mgn2q"
Jul 31 01:50:30.264846 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:30.264657    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-zn9p4"
Jul 31 01:50:30.273930 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:30.273906    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-mgn2q"
Jul 31 01:50:30.276401 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:30.276387    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-zn9p4"
Jul 31 01:50:30.306969 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:30.306941    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff5f4047-fefa-4150-b976-73bbee6748de-tls-cert\") pod \"ff5f4047-fefa-4150-b976-73bbee6748de\" (UID: \"ff5f4047-fefa-4150-b976-73bbee6748de\") "
Jul 31 01:50:30.307103 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:30.306984    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4k4q\" (UniqueName: \"kubernetes.io/projected/ff5f4047-fefa-4150-b976-73bbee6748de-kube-api-access-j4k4q\") pod \"ff5f4047-fefa-4150-b976-73bbee6748de\" (UID: \"ff5f4047-fefa-4150-b976-73bbee6748de\") "
Jul 31 01:50:30.307103 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:30.307099    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wmn6\" (UniqueName: \"kubernetes.io/projected/42372c12-9481-42df-bcb6-2b055ed34870-kube-api-access-9wmn6\") pod \"42372c12-9481-42df-bcb6-2b055ed34870\" (UID: \"42372c12-9481-42df-bcb6-2b055ed34870\") "
Jul 31 01:50:30.309169 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:30.309144    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff5f4047-fefa-4150-b976-73bbee6748de-kube-api-access-j4k4q" (OuterVolumeSpecName: "kube-api-access-j4k4q") pod "ff5f4047-fefa-4150-b976-73bbee6748de" (UID: "ff5f4047-fefa-4150-b976-73bbee6748de"). InnerVolumeSpecName "kube-api-access-j4k4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:50:30.309169 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:30.309162    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff5f4047-fefa-4150-b976-73bbee6748de-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "ff5f4047-fefa-4150-b976-73bbee6748de" (UID: "ff5f4047-fefa-4150-b976-73bbee6748de"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 01:50:30.309328 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:30.309205    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42372c12-9481-42df-bcb6-2b055ed34870-kube-api-access-9wmn6" (OuterVolumeSpecName: "kube-api-access-9wmn6") pod "42372c12-9481-42df-bcb6-2b055ed34870" (UID: "42372c12-9481-42df-bcb6-2b055ed34870"). InnerVolumeSpecName "kube-api-access-9wmn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:50:30.408619 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:30.408574    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wmn6\" (UniqueName: \"kubernetes.io/projected/42372c12-9481-42df-bcb6-2b055ed34870-kube-api-access-9wmn6\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:50:30.408619 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:30.408613    2571 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ff5f4047-fefa-4150-b976-73bbee6748de-tls-cert\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:50:30.408619 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:30.408630    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4k4q\" (UniqueName: \"kubernetes.io/projected/ff5f4047-fefa-4150-b976-73bbee6748de-kube-api-access-j4k4q\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:50:31.270916 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:31.270853    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b64fdf4cb-rhh9r" event={"ID":"df618cfe-7f2a-4f08-94f4-56a1dda0600d","Type":"ContainerStarted","Data":"deca0209881a65326552d08a61aa50fd2d1b096f76620b47545f274214147d08"}
Jul 31 01:50:31.271331 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:31.270920    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-mgn2q"
Jul 31 01:50:31.271331 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:31.271022    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-zn9p4"
Jul 31 01:50:31.293737 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:31.293673    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7b64fdf4cb-rhh9r" podStartSLOduration=1.342766862 podStartE2EDuration="2.293659483s" totalImagesPullingTime="950.892621ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:50:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:50:31.292214001 +0000 UTC m=+791.872454995" watchObservedRunningTime="2026-07-31 01:50:31.293659483 +0000 UTC m=+791.873900478"
Jul 31 01:50:31.321405 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:31.321351    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-hhckd"]
Jul 31 01:50:31.321562 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:31.321542    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-hhckd" podUID="114e8304-0379-481c-9e3f-a7bb9d9695b2" containerName="authorino" containerID="cri-o://6e90e998de6dae6c2631e6374fc138ee5187a5687577650225e857d3075301a8" gracePeriod=30
Jul 31 01:50:31.324641 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:31.324615    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-zn9p4"]
Jul 31 01:50:31.332329 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:31.332306    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-zn9p4"]
Jul 31 01:50:31.354212 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:31.354188    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-mgn2q"]
Jul 31 01:50:31.359539 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:31.359516    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-687bd45585-mgn2q"]
Jul 31 01:50:31.568554 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:31.568530    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-hhckd"
Jul 31 01:50:31.620158 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:31.620134    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmfrm\" (UniqueName: \"kubernetes.io/projected/114e8304-0379-481c-9e3f-a7bb9d9695b2-kube-api-access-lmfrm\") pod \"114e8304-0379-481c-9e3f-a7bb9d9695b2\" (UID: \"114e8304-0379-481c-9e3f-a7bb9d9695b2\") "
Jul 31 01:50:31.622093 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:31.622074    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/114e8304-0379-481c-9e3f-a7bb9d9695b2-kube-api-access-lmfrm" (OuterVolumeSpecName: "kube-api-access-lmfrm") pod "114e8304-0379-481c-9e3f-a7bb9d9695b2" (UID: "114e8304-0379-481c-9e3f-a7bb9d9695b2"). InnerVolumeSpecName "kube-api-access-lmfrm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:50:31.721513 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:31.721484    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmfrm\" (UniqueName: \"kubernetes.io/projected/114e8304-0379-481c-9e3f-a7bb9d9695b2-kube-api-access-lmfrm\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:50:31.993086 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:31.993010    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42372c12-9481-42df-bcb6-2b055ed34870" path="/var/lib/kubelet/pods/42372c12-9481-42df-bcb6-2b055ed34870/volumes"
Jul 31 01:50:31.993347 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:31.993325    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff5f4047-fefa-4150-b976-73bbee6748de" path="/var/lib/kubelet/pods/ff5f4047-fefa-4150-b976-73bbee6748de/volumes"
Jul 31 01:50:32.278191 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:32.278111    2571 generic.go:356] "Generic (PLEG): container finished" podID="114e8304-0379-481c-9e3f-a7bb9d9695b2" containerID="6e90e998de6dae6c2631e6374fc138ee5187a5687577650225e857d3075301a8" exitCode=0
Jul 31 01:50:32.278191 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:32.278153    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-hhckd"
Jul 31 01:50:32.278650 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:32.278198    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-hhckd" event={"ID":"114e8304-0379-481c-9e3f-a7bb9d9695b2","Type":"ContainerDied","Data":"6e90e998de6dae6c2631e6374fc138ee5187a5687577650225e857d3075301a8"}
Jul 31 01:50:32.278650 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:32.278247    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-hhckd" event={"ID":"114e8304-0379-481c-9e3f-a7bb9d9695b2","Type":"ContainerDied","Data":"9f2af3df94ccfedf34a6ba73b1c41e8f59cfd235ce83665029f9c2082d9409be"}
Jul 31 01:50:32.278650 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:32.278267    2571 scope.go:117] "RemoveContainer" containerID="6e90e998de6dae6c2631e6374fc138ee5187a5687577650225e857d3075301a8"
Jul 31 01:50:32.287943 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:32.287924    2571 scope.go:117] "RemoveContainer" containerID="6e90e998de6dae6c2631e6374fc138ee5187a5687577650225e857d3075301a8"
Jul 31 01:50:32.288216 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:50:32.288198    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e90e998de6dae6c2631e6374fc138ee5187a5687577650225e857d3075301a8\": container with ID starting with 6e90e998de6dae6c2631e6374fc138ee5187a5687577650225e857d3075301a8 not found: ID does not exist" containerID="6e90e998de6dae6c2631e6374fc138ee5187a5687577650225e857d3075301a8"
Jul 31 01:50:32.288295 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:32.288224    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e90e998de6dae6c2631e6374fc138ee5187a5687577650225e857d3075301a8"} err="failed to get container status \"6e90e998de6dae6c2631e6374fc138ee5187a5687577650225e857d3075301a8\": rpc error: code = NotFound desc = could not find container \"6e90e998de6dae6c2631e6374fc138ee5187a5687577650225e857d3075301a8\": container with ID starting with 6e90e998de6dae6c2631e6374fc138ee5187a5687577650225e857d3075301a8 not found: ID does not exist"
Jul 31 01:50:32.295350 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:32.295325    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-hhckd"]
Jul 31 01:50:32.298818 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:32.298796    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-hhckd"]
Jul 31 01:50:33.994545 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:50:33.994505    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="114e8304-0379-481c-9e3f-a7bb9d9695b2" path="/var/lib/kubelet/pods/114e8304-0379-481c-9e3f-a7bb9d9695b2/volumes"
Jul 31 01:51:22.534252 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:22.534218    2571 generic.go:356] "Generic (PLEG): container finished" podID="90a0eefd-19e3-44f9-8390-2e82d93e10f3" containerID="c97efae50d2aefa8c84c1041562261972157a751931bd9d747a7dac2980158c2" exitCode=0
Jul 31 01:51:22.534704 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:22.534302    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6" event={"ID":"90a0eefd-19e3-44f9-8390-2e82d93e10f3","Type":"ContainerDied","Data":"c97efae50d2aefa8c84c1041562261972157a751931bd9d747a7dac2980158c2"}
Jul 31 01:51:22.534748 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:22.534710    2571 scope.go:117] "RemoveContainer" containerID="c97efae50d2aefa8c84c1041562261972157a751931bd9d747a7dac2980158c2"
Jul 31 01:51:22.535750 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:22.535718    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 01:51:22.535859 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:22.535784    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 01:51:22.535859 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:22.535816    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 01:51:23.052134 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:23.052077    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:51:23.576015 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:23.574581    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6" event={"ID":"90a0eefd-19e3-44f9-8390-2e82d93e10f3","Type":"ContainerStarted","Data":"926d2c6e28ab0160e6847edd8b49cc9c065eaeb33cafe340d1672e4a6d94f163"}
Jul 31 01:51:23.717224 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:23.717189    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:51:23.718436 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:23.718410    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-58nx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 31 01:51:23.718548 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:23.718461    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6" podUID="90a0eefd-19e3-44f9-8390-2e82d93e10f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 31 01:51:24.717313 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:24.717270    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-58nx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 31 01:51:24.717801 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:24.717343    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6" podUID="90a0eefd-19e3-44f9-8390-2e82d93e10f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 31 01:51:25.717037 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:25.717003    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-58nx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 31 01:51:25.717238 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:25.717063    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6" podUID="90a0eefd-19e3-44f9-8390-2e82d93e10f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 31 01:51:26.717795 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:26.717754    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-58nx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 31 01:51:26.718218 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:26.717829    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6" podUID="90a0eefd-19e3-44f9-8390-2e82d93e10f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 31 01:51:27.717128 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:27.717095    2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-58nx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 31 01:51:27.717310 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:27.717148    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6" podUID="90a0eefd-19e3-44f9-8390-2e82d93e10f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 31 01:51:28.732872 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:28.732843    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:51:28.733361 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:28.733267    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:51:28.733997 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:28.733977    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-58nx6"
Jul 31 01:51:52.796096 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:52.795817    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz"]
Jul 31 01:51:52.796767 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:52.796519    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="114e8304-0379-481c-9e3f-a7bb9d9695b2" containerName="authorino"
Jul 31 01:51:52.796767 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:52.796536    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="114e8304-0379-481c-9e3f-a7bb9d9695b2" containerName="authorino"
Jul 31 01:51:52.796767 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:52.796618    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="114e8304-0379-481c-9e3f-a7bb9d9695b2" containerName="authorino"
Jul 31 01:51:52.799734 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:52.799714    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz"
Jul 31 01:51:52.802593 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:52.802573    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 31 01:51:52.804022 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:52.803995    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 31 01:51:52.804022 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:52.804010    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4vc5j\""
Jul 31 01:51:52.804269 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:52.804258    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 31 01:51:52.810203 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:52.810178    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz"]
Jul 31 01:51:52.946082 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:52.946051    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3ed9fe3-fd2d-4712-997b-df2445e98a00-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pbbz\" (UID: \"e3ed9fe3-fd2d-4712-997b-df2445e98a00\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz"
Jul 31 01:51:52.946251 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:52.946155    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3ed9fe3-fd2d-4712-997b-df2445e98a00-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pbbz\" (UID: \"e3ed9fe3-fd2d-4712-997b-df2445e98a00\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz"
Jul 31 01:51:52.946251 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:52.946190    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hgp2\" (UniqueName: \"kubernetes.io/projected/e3ed9fe3-fd2d-4712-997b-df2445e98a00-kube-api-access-6hgp2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pbbz\" (UID: \"e3ed9fe3-fd2d-4712-997b-df2445e98a00\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz"
Jul 31 01:51:52.946356 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:52.946328    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3ed9fe3-fd2d-4712-997b-df2445e98a00-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pbbz\" (UID: \"e3ed9fe3-fd2d-4712-997b-df2445e98a00\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz"
Jul 31 01:51:52.946415 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:52.946399    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3ed9fe3-fd2d-4712-997b-df2445e98a00-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pbbz\" (UID: \"e3ed9fe3-fd2d-4712-997b-df2445e98a00\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz"
Jul 31 01:51:52.946457 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:52.946438    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3ed9fe3-fd2d-4712-997b-df2445e98a00-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pbbz\" (UID: \"e3ed9fe3-fd2d-4712-997b-df2445e98a00\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz"
Jul 31 01:51:53.047710 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:53.047625    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3ed9fe3-fd2d-4712-997b-df2445e98a00-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pbbz\" (UID: \"e3ed9fe3-fd2d-4712-997b-df2445e98a00\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz"
Jul 31 01:51:53.047710 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:53.047668    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hgp2\" (UniqueName: \"kubernetes.io/projected/e3ed9fe3-fd2d-4712-997b-df2445e98a00-kube-api-access-6hgp2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pbbz\" (UID: \"e3ed9fe3-fd2d-4712-997b-df2445e98a00\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz"
Jul 31 01:51:53.047931 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:53.047734    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3ed9fe3-fd2d-4712-997b-df2445e98a00-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pbbz\" (UID: \"e3ed9fe3-fd2d-4712-997b-df2445e98a00\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz"
Jul 31 01:51:53.047931 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:53.047881    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3ed9fe3-fd2d-4712-997b-df2445e98a00-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pbbz\" (UID: \"e3ed9fe3-fd2d-4712-997b-df2445e98a00\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz"
Jul 31 01:51:53.048027 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:53.047953    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3ed9fe3-fd2d-4712-997b-df2445e98a00-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pbbz\" (UID: \"e3ed9fe3-fd2d-4712-997b-df2445e98a00\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz"
Jul 31 01:51:53.048027 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:53.047991    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3ed9fe3-fd2d-4712-997b-df2445e98a00-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pbbz\" (UID: \"e3ed9fe3-fd2d-4712-997b-df2445e98a00\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz"
Jul 31 01:51:53.048182 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:53.048160    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3ed9fe3-fd2d-4712-997b-df2445e98a00-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pbbz\" (UID: \"e3ed9fe3-fd2d-4712-997b-df2445e98a00\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz"
Jul 31 01:51:53.048311 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:53.048294    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3ed9fe3-fd2d-4712-997b-df2445e98a00-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pbbz\" (UID: \"e3ed9fe3-fd2d-4712-997b-df2445e98a00\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz"
Jul 31 01:51:53.048370 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:53.048344    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3ed9fe3-fd2d-4712-997b-df2445e98a00-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pbbz\" (UID: \"e3ed9fe3-fd2d-4712-997b-df2445e98a00\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz"
Jul 31 01:51:53.049948 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:53.049927    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3ed9fe3-fd2d-4712-997b-df2445e98a00-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pbbz\" (UID: \"e3ed9fe3-fd2d-4712-997b-df2445e98a00\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz"
Jul 31 01:51:53.050271 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:53.050253    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3ed9fe3-fd2d-4712-997b-df2445e98a00-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pbbz\" (UID: \"e3ed9fe3-fd2d-4712-997b-df2445e98a00\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz"
Jul 31 01:51:53.055555 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:53.055531    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hgp2\" (UniqueName: \"kubernetes.io/projected/e3ed9fe3-fd2d-4712-997b-df2445e98a00-kube-api-access-6hgp2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6pbbz\" (UID: \"e3ed9fe3-fd2d-4712-997b-df2445e98a00\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz"
Jul 31 01:51:53.113625 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:53.113589    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz"
Jul 31 01:51:53.247192 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:53.247169    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz"]
Jul 31 01:51:53.249802 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:51:53.249776    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3ed9fe3_fd2d_4712_997b_df2445e98a00.slice/crio-f5df0ade741ab6e9248bd0fc5aaff492a596010449561c9c5d4454c674fad57d WatchSource:0}: Error finding container f5df0ade741ab6e9248bd0fc5aaff492a596010449561c9c5d4454c674fad57d: Status 404 returned error can't find the container with id f5df0ade741ab6e9248bd0fc5aaff492a596010449561c9c5d4454c674fad57d
Jul 31 01:51:53.744640 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:53.744591    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz" event={"ID":"e3ed9fe3-fd2d-4712-997b-df2445e98a00","Type":"ContainerStarted","Data":"f5df0ade741ab6e9248bd0fc5aaff492a596010449561c9c5d4454c674fad57d"}
Jul 31 01:51:54.750951 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:54.750845    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz" event={"ID":"e3ed9fe3-fd2d-4712-997b-df2445e98a00","Type":"ContainerStarted","Data":"3c6b4ba6078860d1cf26ffe414fc64360577916e00ec17e26757f06180a2b49c"}
Jul 31 01:51:54.769801 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:51:54.769751    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz" podStartSLOduration=1.668796838 podStartE2EDuration="2.769735419s" totalImagesPullingTime="1.100938581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:51:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:51:54.767373192 +0000 UTC m=+875.347614190" watchObservedRunningTime="2026-07-31 01:51:54.769735419 +0000 UTC m=+875.349976413"
Jul 31 01:52:03.114496 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:03.114453    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz"
Jul 31 01:52:03.114925 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:03.114514    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz"
Jul 31 01:52:03.127111 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:03.127085    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz"
Jul 31 01:52:03.806650 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:03.806616    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6pbbz"
Jul 31 01:52:14.799321 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:14.799221    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7"]
Jul 31 01:52:14.803645 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:14.803624    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7"
Jul 31 01:52:14.806433 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:14.806411    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 31 01:52:14.810429 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:14.810401    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7"]
Jul 31 01:52:14.858552 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:14.858523    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff87645b-4a15-41a6-8d6f-03efc0163c33-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zmgg7\" (UID: \"ff87645b-4a15-41a6-8d6f-03efc0163c33\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7"
Jul 31 01:52:14.858716 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:14.858575    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff87645b-4a15-41a6-8d6f-03efc0163c33-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zmgg7\" (UID: \"ff87645b-4a15-41a6-8d6f-03efc0163c33\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7"
Jul 31 01:52:14.858716 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:14.858599    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff87645b-4a15-41a6-8d6f-03efc0163c33-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zmgg7\" (UID: \"ff87645b-4a15-41a6-8d6f-03efc0163c33\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7"
Jul 31 01:52:14.858716 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:14.858658    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhhn4\" (UniqueName: \"kubernetes.io/projected/ff87645b-4a15-41a6-8d6f-03efc0163c33-kube-api-access-mhhn4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zmgg7\" (UID: \"ff87645b-4a15-41a6-8d6f-03efc0163c33\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7"
Jul 31 01:52:14.858904 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:14.858726    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff87645b-4a15-41a6-8d6f-03efc0163c33-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zmgg7\" (UID: \"ff87645b-4a15-41a6-8d6f-03efc0163c33\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7"
Jul 31 01:52:14.858904 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:14.858765    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff87645b-4a15-41a6-8d6f-03efc0163c33-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zmgg7\" (UID: \"ff87645b-4a15-41a6-8d6f-03efc0163c33\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7"
Jul 31 01:52:14.959544 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:14.959507    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff87645b-4a15-41a6-8d6f-03efc0163c33-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zmgg7\" (UID: \"ff87645b-4a15-41a6-8d6f-03efc0163c33\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7"
Jul 31 01:52:14.959544 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:14.959542    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff87645b-4a15-41a6-8d6f-03efc0163c33-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zmgg7\" (UID: \"ff87645b-4a15-41a6-8d6f-03efc0163c33\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7"
Jul 31 01:52:14.959795 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:14.959566    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhhn4\" (UniqueName: \"kubernetes.io/projected/ff87645b-4a15-41a6-8d6f-03efc0163c33-kube-api-access-mhhn4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zmgg7\" (UID: \"ff87645b-4a15-41a6-8d6f-03efc0163c33\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7"
Jul 31 01:52:14.959795 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:14.959617    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff87645b-4a15-41a6-8d6f-03efc0163c33-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zmgg7\" (UID: \"ff87645b-4a15-41a6-8d6f-03efc0163c33\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7"
Jul 31 01:52:14.959795 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:14.959644    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff87645b-4a15-41a6-8d6f-03efc0163c33-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zmgg7\" (UID: \"ff87645b-4a15-41a6-8d6f-03efc0163c33\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7"
Jul 31 01:52:14.959795 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:14.959752    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff87645b-4a15-41a6-8d6f-03efc0163c33-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zmgg7\" (UID: \"ff87645b-4a15-41a6-8d6f-03efc0163c33\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7"
Jul 31 01:52:14.960099 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:14.960078    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff87645b-4a15-41a6-8d6f-03efc0163c33-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zmgg7\" (UID: \"ff87645b-4a15-41a6-8d6f-03efc0163c33\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7"
Jul 31 01:52:14.960156 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:14.960120    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff87645b-4a15-41a6-8d6f-03efc0163c33-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zmgg7\" (UID: \"ff87645b-4a15-41a6-8d6f-03efc0163c33\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7"
Jul 31 01:52:14.960156 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:14.960137    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff87645b-4a15-41a6-8d6f-03efc0163c33-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zmgg7\" (UID: \"ff87645b-4a15-41a6-8d6f-03efc0163c33\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7"
Jul 31 01:52:14.961984 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:14.961953    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff87645b-4a15-41a6-8d6f-03efc0163c33-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zmgg7\" (UID: \"ff87645b-4a15-41a6-8d6f-03efc0163c33\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7"
Jul 31 01:52:14.962095 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:14.962065    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff87645b-4a15-41a6-8d6f-03efc0163c33-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zmgg7\" (UID: \"ff87645b-4a15-41a6-8d6f-03efc0163c33\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7"
Jul 31 01:52:14.967161 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:14.967143    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhhn4\" (UniqueName: \"kubernetes.io/projected/ff87645b-4a15-41a6-8d6f-03efc0163c33-kube-api-access-mhhn4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zmgg7\" (UID: \"ff87645b-4a15-41a6-8d6f-03efc0163c33\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7"
Jul 31 01:52:15.139078 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:15.139037    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7"
Jul 31 01:52:15.275749 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:15.275720    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7"]
Jul 31 01:52:15.277258 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:52:15.277236    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff87645b_4a15_41a6_8d6f_03efc0163c33.slice/crio-570c938153470e706107c0e254177476433607a6828170a8fe7867080cc432e0 WatchSource:0}: Error finding container 570c938153470e706107c0e254177476433607a6828170a8fe7867080cc432e0: Status 404 returned error can't find the container with id 570c938153470e706107c0e254177476433607a6828170a8fe7867080cc432e0
Jul 31 01:52:15.859660 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:15.859621    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7" event={"ID":"ff87645b-4a15-41a6-8d6f-03efc0163c33","Type":"ContainerStarted","Data":"3d160865d44e08e037d42021de1c787d348e3128457582f3aa1d86372f2f7686"}
Jul 31 01:52:15.860080 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:15.859694    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7" event={"ID":"ff87645b-4a15-41a6-8d6f-03efc0163c33","Type":"ContainerStarted","Data":"570c938153470e706107c0e254177476433607a6828170a8fe7867080cc432e0"}
Jul 31 01:52:25.139704 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:25.139668    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7"
Jul 31 01:52:25.140210 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:25.139722    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7"
Jul 31 01:52:25.152535 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:25.152515    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7"
Jul 31 01:52:25.173165 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:25.173115    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7" podStartSLOduration=10.988226649 podStartE2EDuration="11.173102362s" totalImagesPullingTime="184.875713ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:52:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:52:15.881210496 +0000 UTC m=+896.461451495" watchObservedRunningTime="2026-07-31 01:52:25.173102362 +0000 UTC m=+905.753343358"
Jul 31 01:52:25.922347 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:52:25.922311    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zmgg7"
Jul 31 01:53:29.858554 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:29.858517    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c58894fcc-t9hck"]
Jul 31 01:53:29.862108 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:29.862093    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c58894fcc-t9hck"
Jul 31 01:53:29.869092 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:29.869062    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c58894fcc-t9hck"]
Jul 31 01:53:29.869772 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:29.869736    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/61847e0e-da0b-4006-9cf5-2b7a5a601a2a-tls-cert\") pod \"authorino-5c58894fcc-t9hck\" (UID: \"61847e0e-da0b-4006-9cf5-2b7a5a601a2a\") " pod="kuadrant-system/authorino-5c58894fcc-t9hck"
Jul 31 01:53:29.869914 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:29.869810    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwdvg\" (UniqueName: \"kubernetes.io/projected/61847e0e-da0b-4006-9cf5-2b7a5a601a2a-kube-api-access-zwdvg\") pod \"authorino-5c58894fcc-t9hck\" (UID: \"61847e0e-da0b-4006-9cf5-2b7a5a601a2a\") " pod="kuadrant-system/authorino-5c58894fcc-t9hck"
Jul 31 01:53:29.971327 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:29.971294    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/61847e0e-da0b-4006-9cf5-2b7a5a601a2a-tls-cert\") pod \"authorino-5c58894fcc-t9hck\" (UID: \"61847e0e-da0b-4006-9cf5-2b7a5a601a2a\") " pod="kuadrant-system/authorino-5c58894fcc-t9hck"
Jul 31 01:53:29.971501 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:29.971342    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwdvg\" (UniqueName: \"kubernetes.io/projected/61847e0e-da0b-4006-9cf5-2b7a5a601a2a-kube-api-access-zwdvg\") pod \"authorino-5c58894fcc-t9hck\" (UID: \"61847e0e-da0b-4006-9cf5-2b7a5a601a2a\") " pod="kuadrant-system/authorino-5c58894fcc-t9hck"
Jul 31 01:53:29.973734 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:29.973705    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/61847e0e-da0b-4006-9cf5-2b7a5a601a2a-tls-cert\") pod \"authorino-5c58894fcc-t9hck\" (UID: \"61847e0e-da0b-4006-9cf5-2b7a5a601a2a\") " pod="kuadrant-system/authorino-5c58894fcc-t9hck"
Jul 31 01:53:29.979288 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:29.979264    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwdvg\" (UniqueName: \"kubernetes.io/projected/61847e0e-da0b-4006-9cf5-2b7a5a601a2a-kube-api-access-zwdvg\") pod \"authorino-5c58894fcc-t9hck\" (UID: \"61847e0e-da0b-4006-9cf5-2b7a5a601a2a\") " pod="kuadrant-system/authorino-5c58894fcc-t9hck"
Jul 31 01:53:30.172236 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:30.172142    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c58894fcc-t9hck"
Jul 31 01:53:30.307228 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:30.307199    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c58894fcc-t9hck"]
Jul 31 01:53:30.309289 ip-10-0-133-91 kubenswrapper[2571]: W0731 01:53:30.309264    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61847e0e_da0b_4006_9cf5_2b7a5a601a2a.slice/crio-9bd282ea0f42f799b40e57518036ac89cfbcf0fe8f5f0266e840710fa7e4fad3 WatchSource:0}: Error finding container 9bd282ea0f42f799b40e57518036ac89cfbcf0fe8f5f0266e840710fa7e4fad3: Status 404 returned error can't find the container with id 9bd282ea0f42f799b40e57518036ac89cfbcf0fe8f5f0266e840710fa7e4fad3
Jul 31 01:53:31.256093 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:31.256051    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c58894fcc-t9hck" event={"ID":"61847e0e-da0b-4006-9cf5-2b7a5a601a2a","Type":"ContainerStarted","Data":"9bd282ea0f42f799b40e57518036ac89cfbcf0fe8f5f0266e840710fa7e4fad3"}
Jul 31 01:53:34.275250 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:34.275215    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c58894fcc-t9hck" event={"ID":"61847e0e-da0b-4006-9cf5-2b7a5a601a2a","Type":"ContainerStarted","Data":"f550f72b771224d0ccc34968254278cd1b7157e8d96e5a18a954adccf2091df8"}
Jul 31 01:53:34.291764 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:34.291695    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5c58894fcc-t9hck" podStartSLOduration=2.324079422 podStartE2EDuration="5.291679198s" totalImagesPullingTime="2.967599776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 01:53:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 01:53:34.289746049 +0000 UTC m=+974.869987044" watchObservedRunningTime="2026-07-31 01:53:34.291679198 +0000 UTC m=+974.871920191"
Jul 31 01:53:34.325531 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:34.325496    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b64fdf4cb-rhh9r"]
Jul 31 01:53:34.325747 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:34.325712    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7b64fdf4cb-rhh9r" podUID="df618cfe-7f2a-4f08-94f4-56a1dda0600d" containerName="authorino" containerID="cri-o://deca0209881a65326552d08a61aa50fd2d1b096f76620b47545f274214147d08" gracePeriod=30
Jul 31 01:53:34.577260 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:34.577235    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b64fdf4cb-rhh9r"
Jul 31 01:53:34.616351 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:34.616322    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6mg7\" (UniqueName: \"kubernetes.io/projected/df618cfe-7f2a-4f08-94f4-56a1dda0600d-kube-api-access-z6mg7\") pod \"df618cfe-7f2a-4f08-94f4-56a1dda0600d\" (UID: \"df618cfe-7f2a-4f08-94f4-56a1dda0600d\") "
Jul 31 01:53:34.616545 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:34.616425    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/df618cfe-7f2a-4f08-94f4-56a1dda0600d-tls-cert\") pod \"df618cfe-7f2a-4f08-94f4-56a1dda0600d\" (UID: \"df618cfe-7f2a-4f08-94f4-56a1dda0600d\") "
Jul 31 01:53:34.618664 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:34.618611    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df618cfe-7f2a-4f08-94f4-56a1dda0600d-kube-api-access-z6mg7" (OuterVolumeSpecName: "kube-api-access-z6mg7") pod "df618cfe-7f2a-4f08-94f4-56a1dda0600d" (UID: "df618cfe-7f2a-4f08-94f4-56a1dda0600d"). InnerVolumeSpecName "kube-api-access-z6mg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 01:53:34.628208 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:34.628183    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df618cfe-7f2a-4f08-94f4-56a1dda0600d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "df618cfe-7f2a-4f08-94f4-56a1dda0600d" (UID: "df618cfe-7f2a-4f08-94f4-56a1dda0600d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 01:53:34.718260 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:34.718220    2571 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/df618cfe-7f2a-4f08-94f4-56a1dda0600d-tls-cert\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:53:34.718260 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:34.718255    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6mg7\" (UniqueName: \"kubernetes.io/projected/df618cfe-7f2a-4f08-94f4-56a1dda0600d-kube-api-access-z6mg7\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 01:53:35.282037 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:35.282005    2571 generic.go:356] "Generic (PLEG): container finished" podID="df618cfe-7f2a-4f08-94f4-56a1dda0600d" containerID="deca0209881a65326552d08a61aa50fd2d1b096f76620b47545f274214147d08" exitCode=0
Jul 31 01:53:35.282498 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:35.282060    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b64fdf4cb-rhh9r"
Jul 31 01:53:35.282498 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:35.282095    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b64fdf4cb-rhh9r" event={"ID":"df618cfe-7f2a-4f08-94f4-56a1dda0600d","Type":"ContainerDied","Data":"deca0209881a65326552d08a61aa50fd2d1b096f76620b47545f274214147d08"}
Jul 31 01:53:35.282498 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:35.282140    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b64fdf4cb-rhh9r" event={"ID":"df618cfe-7f2a-4f08-94f4-56a1dda0600d","Type":"ContainerDied","Data":"5680db19a411954044b2b6dd743b84d8261fe612af550536a7748a641799c092"}
Jul 31 01:53:35.282498 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:35.282160    2571 scope.go:117] "RemoveContainer" containerID="deca0209881a65326552d08a61aa50fd2d1b096f76620b47545f274214147d08"
Jul 31 01:53:35.292865 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:35.292848    2571 scope.go:117] "RemoveContainer" containerID="deca0209881a65326552d08a61aa50fd2d1b096f76620b47545f274214147d08"
Jul 31 01:53:35.293173 ip-10-0-133-91 kubenswrapper[2571]: E0731 01:53:35.293152    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"deca0209881a65326552d08a61aa50fd2d1b096f76620b47545f274214147d08\": container with ID starting with deca0209881a65326552d08a61aa50fd2d1b096f76620b47545f274214147d08 not found: ID does not exist" containerID="deca0209881a65326552d08a61aa50fd2d1b096f76620b47545f274214147d08"
Jul 31 01:53:35.293226 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:35.293183    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"deca0209881a65326552d08a61aa50fd2d1b096f76620b47545f274214147d08"} err="failed to get container status \"deca0209881a65326552d08a61aa50fd2d1b096f76620b47545f274214147d08\": rpc error: code = NotFound desc = could not find container \"deca0209881a65326552d08a61aa50fd2d1b096f76620b47545f274214147d08\": container with ID starting with deca0209881a65326552d08a61aa50fd2d1b096f76620b47545f274214147d08 not found: ID does not exist"
Jul 31 01:53:35.302953 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:35.302930    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b64fdf4cb-rhh9r"]
Jul 31 01:53:35.308461 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:35.308440    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7b64fdf4cb-rhh9r"]
Jul 31 01:53:35.992633 ip-10-0-133-91 kubenswrapper[2571]: I0731 01:53:35.992600    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df618cfe-7f2a-4f08-94f4-56a1dda0600d" path="/var/lib/kubelet/pods/df618cfe-7f2a-4f08-94f4-56a1dda0600d/volumes"
Jul 31 02:02:08.239747 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:02:08.239708    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vhbdl"]
Jul 31 02:02:08.240407 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:02:08.240070    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vhbdl" podUID="cc2d4b70-9509-4fc4-8761-bfad0b90dc68" containerName="manager" containerID="cri-o://f1a4be4fafed406f9fc7ecec23ea7542ee0c06e13e809a96d72dc1cdeb485af6" gracePeriod=10
Jul 31 02:02:08.496868 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:02:08.496806    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vhbdl"
Jul 31 02:02:08.523737 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:02:08.523704    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vz5f\" (UniqueName: \"kubernetes.io/projected/cc2d4b70-9509-4fc4-8761-bfad0b90dc68-kube-api-access-8vz5f\") pod \"cc2d4b70-9509-4fc4-8761-bfad0b90dc68\" (UID: \"cc2d4b70-9509-4fc4-8761-bfad0b90dc68\") "
Jul 31 02:02:08.523946 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:02:08.523874    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc2d4b70-9509-4fc4-8761-bfad0b90dc68-extensions-socket-volume\") pod \"cc2d4b70-9509-4fc4-8761-bfad0b90dc68\" (UID: \"cc2d4b70-9509-4fc4-8761-bfad0b90dc68\") "
Jul 31 02:02:08.524358 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:02:08.524315    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc2d4b70-9509-4fc4-8761-bfad0b90dc68-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cc2d4b70-9509-4fc4-8761-bfad0b90dc68" (UID: "cc2d4b70-9509-4fc4-8761-bfad0b90dc68"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:02:08.526314 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:02:08.526281    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc2d4b70-9509-4fc4-8761-bfad0b90dc68-kube-api-access-8vz5f" (OuterVolumeSpecName: "kube-api-access-8vz5f") pod "cc2d4b70-9509-4fc4-8761-bfad0b90dc68" (UID: "cc2d4b70-9509-4fc4-8761-bfad0b90dc68"). InnerVolumeSpecName "kube-api-access-8vz5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:02:08.625250 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:02:08.625208    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vz5f\" (UniqueName: \"kubernetes.io/projected/cc2d4b70-9509-4fc4-8761-bfad0b90dc68-kube-api-access-8vz5f\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:02:08.625250 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:02:08.625247    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc2d4b70-9509-4fc4-8761-bfad0b90dc68-extensions-socket-volume\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:02:09.015741 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:02:09.015703    2571 generic.go:356] "Generic (PLEG): container finished" podID="cc2d4b70-9509-4fc4-8761-bfad0b90dc68" containerID="f1a4be4fafed406f9fc7ecec23ea7542ee0c06e13e809a96d72dc1cdeb485af6" exitCode=0
Jul 31 02:02:09.015944 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:02:09.015753    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vhbdl"
Jul 31 02:02:09.015944 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:02:09.015768    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vhbdl" event={"ID":"cc2d4b70-9509-4fc4-8761-bfad0b90dc68","Type":"ContainerDied","Data":"f1a4be4fafed406f9fc7ecec23ea7542ee0c06e13e809a96d72dc1cdeb485af6"}
Jul 31 02:02:09.015944 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:02:09.015822    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vhbdl" event={"ID":"cc2d4b70-9509-4fc4-8761-bfad0b90dc68","Type":"ContainerDied","Data":"ebb5cc0c97d5d87f38ea2b8c946143296eeb90515b04c58a62be3ffda1d25702"}
Jul 31 02:02:09.015944 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:02:09.015853    2571 scope.go:117] "RemoveContainer" containerID="f1a4be4fafed406f9fc7ecec23ea7542ee0c06e13e809a96d72dc1cdeb485af6"
Jul 31 02:02:09.026461 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:02:09.026446    2571 scope.go:117] "RemoveContainer" containerID="f1a4be4fafed406f9fc7ecec23ea7542ee0c06e13e809a96d72dc1cdeb485af6"
Jul 31 02:02:09.026720 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:02:09.026704    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1a4be4fafed406f9fc7ecec23ea7542ee0c06e13e809a96d72dc1cdeb485af6\": container with ID starting with f1a4be4fafed406f9fc7ecec23ea7542ee0c06e13e809a96d72dc1cdeb485af6 not found: ID does not exist" containerID="f1a4be4fafed406f9fc7ecec23ea7542ee0c06e13e809a96d72dc1cdeb485af6"
Jul 31 02:02:09.026764 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:02:09.026727    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1a4be4fafed406f9fc7ecec23ea7542ee0c06e13e809a96d72dc1cdeb485af6"} err="failed to get container status \"f1a4be4fafed406f9fc7ecec23ea7542ee0c06e13e809a96d72dc1cdeb485af6\": rpc error: code = NotFound desc = could not find container \"f1a4be4fafed406f9fc7ecec23ea7542ee0c06e13e809a96d72dc1cdeb485af6\": container with ID starting with f1a4be4fafed406f9fc7ecec23ea7542ee0c06e13e809a96d72dc1cdeb485af6 not found: ID does not exist"
Jul 31 02:02:09.045471 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:02:09.045434    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vhbdl"]
Jul 31 02:02:09.045862 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:02:09.045832    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vhbdl"]
Jul 31 02:02:09.992571 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:02:09.992528    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc2d4b70-9509-4fc4-8761-bfad0b90dc68" path="/var/lib/kubelet/pods/cc2d4b70-9509-4fc4-8761-bfad0b90dc68/volumes"
Jul 31 02:03:08.958239 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:03:08.958161    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-rdphb"]
Jul 31 02:03:08.958696 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:03:08.958576    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df618cfe-7f2a-4f08-94f4-56a1dda0600d" containerName="authorino"
Jul 31 02:03:08.958696 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:03:08.958588    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="df618cfe-7f2a-4f08-94f4-56a1dda0600d" containerName="authorino"
Jul 31 02:03:08.958696 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:03:08.958613    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc2d4b70-9509-4fc4-8761-bfad0b90dc68" containerName="manager"
Jul 31 02:03:08.958696 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:03:08.958618    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc2d4b70-9509-4fc4-8761-bfad0b90dc68" containerName="manager"
Jul 31 02:03:08.958696 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:03:08.958686    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc2d4b70-9509-4fc4-8761-bfad0b90dc68" containerName="manager"
Jul 31 02:03:08.958696 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:03:08.958696    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="df618cfe-7f2a-4f08-94f4-56a1dda0600d" containerName="authorino"
Jul 31 02:03:08.961937 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:03:08.961917    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-rdphb"
Jul 31 02:03:08.964690 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:03:08.964667    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-n5crf\""
Jul 31 02:03:08.975121 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:03:08.975093    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-rdphb"]
Jul 31 02:03:09.109740 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:03:09.109699    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg6lb\" (UniqueName: \"kubernetes.io/projected/ae2e8940-f602-4e4d-9901-fdd19e4c2f3e-kube-api-access-tg6lb\") pod \"kuadrant-operator-controller-manager-68cf589589-rdphb\" (UID: \"ae2e8940-f602-4e4d-9901-fdd19e4c2f3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-rdphb"
Jul 31 02:03:09.109941 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:03:09.109766    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae2e8940-f602-4e4d-9901-fdd19e4c2f3e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-rdphb\" (UID: \"ae2e8940-f602-4e4d-9901-fdd19e4c2f3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-rdphb"
Jul 31 02:03:09.210719 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:03:09.210614    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg6lb\" (UniqueName: \"kubernetes.io/projected/ae2e8940-f602-4e4d-9901-fdd19e4c2f3e-kube-api-access-tg6lb\") pod \"kuadrant-operator-controller-manager-68cf589589-rdphb\" (UID: \"ae2e8940-f602-4e4d-9901-fdd19e4c2f3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-rdphb"
Jul 31 02:03:09.210940 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:03:09.210777    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae2e8940-f602-4e4d-9901-fdd19e4c2f3e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-rdphb\" (UID: \"ae2e8940-f602-4e4d-9901-fdd19e4c2f3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-rdphb"
Jul 31 02:03:09.211206 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:03:09.211184    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae2e8940-f602-4e4d-9901-fdd19e4c2f3e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-rdphb\" (UID: \"ae2e8940-f602-4e4d-9901-fdd19e4c2f3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-rdphb"
Jul 31 02:03:09.221471 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:03:09.221438    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg6lb\" (UniqueName: \"kubernetes.io/projected/ae2e8940-f602-4e4d-9901-fdd19e4c2f3e-kube-api-access-tg6lb\") pod \"kuadrant-operator-controller-manager-68cf589589-rdphb\" (UID: \"ae2e8940-f602-4e4d-9901-fdd19e4c2f3e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-rdphb"
Jul 31 02:03:09.271543 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:03:09.271495    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-rdphb"
Jul 31 02:03:09.416223 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:03:09.416198    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-rdphb"]
Jul 31 02:03:09.419053 ip-10-0-133-91 kubenswrapper[2571]: W0731 02:03:09.419021    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae2e8940_f602_4e4d_9901_fdd19e4c2f3e.slice/crio-8c7a9fdafcc1559342fa81306650b2c20a857637a27872566e25325a914d8316 WatchSource:0}: Error finding container 8c7a9fdafcc1559342fa81306650b2c20a857637a27872566e25325a914d8316: Status 404 returned error can't find the container with id 8c7a9fdafcc1559342fa81306650b2c20a857637a27872566e25325a914d8316
Jul 31 02:03:10.333531 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:03:10.333497    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-rdphb" event={"ID":"ae2e8940-f602-4e4d-9901-fdd19e4c2f3e","Type":"ContainerStarted","Data":"f19e1e512236d4ef9e32616375f37812147f3b634a8b5907c09d6ae075d76937"}
Jul 31 02:03:10.333963 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:03:10.333549    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-rdphb" event={"ID":"ae2e8940-f602-4e4d-9901-fdd19e4c2f3e","Type":"ContainerStarted","Data":"8c7a9fdafcc1559342fa81306650b2c20a857637a27872566e25325a914d8316"}
Jul 31 02:03:10.333963 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:03:10.333640    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-rdphb"
Jul 31 02:03:10.356315 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:03:10.356259    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-rdphb" podStartSLOduration=2.356242641 podStartE2EDuration="2.356242641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:03:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:03:10.352997495 +0000 UTC m=+1550.933238493" watchObservedRunningTime="2026-07-31 02:03:10.356242641 +0000 UTC m=+1550.936483637"
Jul 31 02:03:21.341357 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:03:21.341328    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-rdphb"
Jul 31 02:11:07.924525 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:07.924493    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"]
Jul 31 02:11:07.928509 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:07.928492    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:07.931042 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:07.931021    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-5d8e59b6-openshift-default-dockercfg-k8jpf\""
Jul 31 02:11:07.947107 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:07.947072    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"]
Jul 31 02:11:08.061682 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.061627    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-workload-certs\") pod \"e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") " pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:08.061927 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.061776    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-workload-socket\") pod \"e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") " pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:08.061927 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.061831    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/905d6f8f-8c61-4945-8801-cc918f6295c5-istio-token\") pod \"e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") " pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:08.061927 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.061924    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-istio-data\") pod \"e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") " pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:08.062143 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.062006    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-istio-envoy\") pod \"e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") " pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:08.062143 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.062031    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk86b\" (UniqueName: \"kubernetes.io/projected/905d6f8f-8c61-4945-8801-cc918f6295c5-kube-api-access-rk86b\") pod \"e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") " pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:08.062143 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.062066    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/905d6f8f-8c61-4945-8801-cc918f6295c5-istiod-ca-cert\") pod \"e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") " pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:08.062143 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.062098    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/905d6f8f-8c61-4945-8801-cc918f6295c5-istio-podinfo\") pod \"e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") " pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:08.062362 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.062195    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-credential-socket\") pod \"e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") " pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:08.163162 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.163120    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-istio-envoy\") pod \"e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") " pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:08.163162 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.163163    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk86b\" (UniqueName: \"kubernetes.io/projected/905d6f8f-8c61-4945-8801-cc918f6295c5-kube-api-access-rk86b\") pod \"e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") " pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:08.163422 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.163187    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/905d6f8f-8c61-4945-8801-cc918f6295c5-istiod-ca-cert\") pod \"e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") " pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:08.163422 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.163213    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/905d6f8f-8c61-4945-8801-cc918f6295c5-istio-podinfo\") pod \"e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") " pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:08.163422 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.163259    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-credential-socket\") pod \"e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") " pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:08.163422 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.163319    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-workload-certs\") pod \"e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") " pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:08.163422 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.163362    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-workload-socket\") pod \"e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") " pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:08.163422 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.163406    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/905d6f8f-8c61-4945-8801-cc918f6295c5-istio-token\") pod \"e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") " pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:08.163839 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.163444    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-istio-data\") pod \"e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") " pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:08.163839 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.163689    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-credential-socket\") pod \"e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") " pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:08.163839 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.163830    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-workload-certs\") pod \"e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") " pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:08.164056 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.163907    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-workload-socket\") pod \"e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") " pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:08.164056 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.164010    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-istio-data\") pod \"e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") " pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:08.164240 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.164223    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/905d6f8f-8c61-4945-8801-cc918f6295c5-istiod-ca-cert\") pod \"e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") " pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:08.166104 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.166078    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-istio-envoy\") pod \"e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") " pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:08.166236 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.166202    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/905d6f8f-8c61-4945-8801-cc918f6295c5-istio-podinfo\") pod \"e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") " pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:08.170766 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.170740    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/905d6f8f-8c61-4945-8801-cc918f6295c5-istio-token\") pod \"e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") " pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:08.171100 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.171077    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk86b\" (UniqueName: \"kubernetes.io/projected/905d6f8f-8c61-4945-8801-cc918f6295c5-kube-api-access-rk86b\") pod \"e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") " pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:08.240703 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.240617    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:08.389795 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.389767    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"]
Jul 31 02:11:08.391870 ip-10-0-133-91 kubenswrapper[2571]: W0731 02:11:08.391841    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod905d6f8f_8c61_4945_8801_cc918f6295c5.slice/crio-2b43cc25b4cd5b757b137306a7b5ce296e4668c1ea8c13d078254d6d99db0602 WatchSource:0}: Error finding container 2b43cc25b4cd5b757b137306a7b5ce296e4668c1ea8c13d078254d6d99db0602: Status 404 returned error can't find the container with id 2b43cc25b4cd5b757b137306a7b5ce296e4668c1ea8c13d078254d6d99db0602
Jul 31 02:11:08.394585 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.394542    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:11:08.394663 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.394645    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:11:08.394738 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.394722    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:11:08.949766 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.949726    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd" event={"ID":"905d6f8f-8c61-4945-8801-cc918f6295c5","Type":"ContainerStarted","Data":"3b5378e1f33b1fe535e45c36260615167301e078d522c313fac2c2a27ee2d1d7"}
Jul 31 02:11:08.950220 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.949783    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd" event={"ID":"905d6f8f-8c61-4945-8801-cc918f6295c5","Type":"ContainerStarted","Data":"2b43cc25b4cd5b757b137306a7b5ce296e4668c1ea8c13d078254d6d99db0602"}
Jul 31 02:11:08.973068 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:08.973016    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd" podStartSLOduration=1.9729990320000002 podStartE2EDuration="1.972999032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:11:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:11:08.970441709 +0000 UTC m=+2029.550682701" watchObservedRunningTime="2026-07-31 02:11:08.972999032 +0000 UTC m=+2029.553240027"
Jul 31 02:11:09.241214 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:09.241123    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:09.246450 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:09.246423    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:09.956449 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:09.956418    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:09.957382 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:09.957366    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:24.958450 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:24.958416    2571 patch_prober.go:28] interesting pod/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 31 02:11:24.958866 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:24.958473    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd" podUID="905d6f8f-8c61-4945-8801-cc918f6295c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 31 02:11:25.042689 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:25.042650    2571 generic.go:356] "Generic (PLEG): container finished" podID="905d6f8f-8c61-4945-8801-cc918f6295c5" containerID="3b5378e1f33b1fe535e45c36260615167301e078d522c313fac2c2a27ee2d1d7" exitCode=0
Jul 31 02:11:25.042862 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:25.042732    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd" event={"ID":"905d6f8f-8c61-4945-8801-cc918f6295c5","Type":"ContainerDied","Data":"3b5378e1f33b1fe535e45c36260615167301e078d522c313fac2c2a27ee2d1d7"}
Jul 31 02:11:25.043216 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:25.043200    2571 scope.go:117] "RemoveContainer" containerID="3b5378e1f33b1fe535e45c36260615167301e078d522c313fac2c2a27ee2d1d7"
Jul 31 02:11:25.044284 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:25.044258    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:11:25.044354 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:25.044342    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:11:25.044391 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:25.044383    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:11:26.054209 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:26.054158    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd" event={"ID":"905d6f8f-8c61-4945-8801-cc918f6295c5","Type":"ContainerStarted","Data":"c7c29c5371a7e8dabe4051ed2945df7d21369da8c48cbc803a36b89bf8a84ef6"}
Jul 31 02:11:26.241162 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:26.241060    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:26.241794 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:26.241765    2571 patch_prober.go:28] interesting pod/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 31 02:11:26.242042 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:26.242013    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd" podUID="905d6f8f-8c61-4945-8801-cc918f6295c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 31 02:11:27.242132 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:27.241587    2571 patch_prober.go:28] interesting pod/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 31 02:11:27.242132 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:27.241681    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd" podUID="905d6f8f-8c61-4945-8801-cc918f6295c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 31 02:11:28.241726 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:28.241687    2571 patch_prober.go:28] interesting pod/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 31 02:11:28.242077 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:28.242043    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd" podUID="905d6f8f-8c61-4945-8801-cc918f6295c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 31 02:11:29.242087 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:29.242041    2571 patch_prober.go:28] interesting pod/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 31 02:11:29.242712 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:29.242113    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd" podUID="905d6f8f-8c61-4945-8801-cc918f6295c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 31 02:11:30.241592 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:30.241552    2571 patch_prober.go:28] interesting pod/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 31 02:11:30.241938 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:30.241881    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd" podUID="905d6f8f-8c61-4945-8801-cc918f6295c5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 31 02:11:31.246450 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:31.246414    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:31.246968 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:31.246782    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:31.247536 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:31.247520    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:42.413928 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:42.413820    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"]
Jul 31 02:11:42.414908 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:42.414854    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd" podUID="905d6f8f-8c61-4945-8801-cc918f6295c5" containerName="istio-proxy" containerID="cri-o://c7c29c5371a7e8dabe4051ed2945df7d21369da8c48cbc803a36b89bf8a84ef6" gracePeriod=30
Jul 31 02:11:43.411935 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.411886    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"]
Jul 31 02:11:43.414806 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.414781    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.417502 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.417482    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-241ce02f-gw-openshift-default-dockercfg-j92kr\""
Jul 31 02:11:43.432573 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.432543    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"]
Jul 31 02:11:43.522649 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.522618    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/311e8816-1252-479d-918d-8214a71c4568-istiod-ca-cert\") pod \"e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") " pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.522841 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.522692    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-workload-socket\") pod \"e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") " pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.522841 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.522802    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh4hb\" (UniqueName: \"kubernetes.io/projected/311e8816-1252-479d-918d-8214a71c4568-kube-api-access-gh4hb\") pod \"e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") " pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.522998 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.522856    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-credential-socket\") pod \"e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") " pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.522998 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.522928    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/311e8816-1252-479d-918d-8214a71c4568-istio-podinfo\") pod \"e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") " pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.522998 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.522955    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/311e8816-1252-479d-918d-8214a71c4568-istio-token\") pod \"e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") " pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.522998 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.522980    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-istio-data\") pod \"e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") " pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.523159 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.523038    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-workload-certs\") pod \"e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") " pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.523159 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.523063    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-istio-envoy\") pod \"e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") " pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.623869 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.623832    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/311e8816-1252-479d-918d-8214a71c4568-istiod-ca-cert\") pod \"e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") " pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.624064 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.623938    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-workload-socket\") pod \"e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") " pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.624064 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.623978    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh4hb\" (UniqueName: \"kubernetes.io/projected/311e8816-1252-479d-918d-8214a71c4568-kube-api-access-gh4hb\") pod \"e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") " pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.624064 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.624008    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-credential-socket\") pod \"e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") " pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.624064 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.624032    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/311e8816-1252-479d-918d-8214a71c4568-istio-podinfo\") pod \"e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") " pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.624064 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.624047    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/311e8816-1252-479d-918d-8214a71c4568-istio-token\") pod \"e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") " pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.624347 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.624180    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-istio-data\") pod \"e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") " pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.624347 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.624233    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-workload-certs\") pod \"e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") " pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.624347 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.624256    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-istio-envoy\") pod \"e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") " pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.624505 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.624371    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-credential-socket\") pod \"e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") " pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.624505 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.624435    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-workload-socket\") pod \"e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") " pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.624610 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.624587    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-istio-data\") pod \"e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") " pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.624647 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.624615    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-workload-certs\") pod \"e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") " pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.624647 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.624640    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/311e8816-1252-479d-918d-8214a71c4568-istiod-ca-cert\") pod \"e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") " pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.626457 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.626429    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-istio-envoy\") pod \"e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") " pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.626697 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.626673    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/311e8816-1252-479d-918d-8214a71c4568-istio-podinfo\") pod \"e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") " pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.631960 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.631927    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh4hb\" (UniqueName: \"kubernetes.io/projected/311e8816-1252-479d-918d-8214a71c4568-kube-api-access-gh4hb\") pod \"e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") " pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.632057 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.631984    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/311e8816-1252-479d-918d-8214a71c4568-istio-token\") pod \"e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") " pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.725480 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.725397    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:43.872165 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.872137    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"]
Jul 31 02:11:43.874078 ip-10-0-133-91 kubenswrapper[2571]: W0731 02:11:43.874047    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod311e8816_1252_479d_918d_8214a71c4568.slice/crio-f43a7639b634fe30452c71c47c35ba2a148acff6d1efc5d14ba94b916f9eae15 WatchSource:0}: Error finding container f43a7639b634fe30452c71c47c35ba2a148acff6d1efc5d14ba94b916f9eae15: Status 404 returned error can't find the container with id f43a7639b634fe30452c71c47c35ba2a148acff6d1efc5d14ba94b916f9eae15
Jul 31 02:11:43.877057 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.877029    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:11:43.877123 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.877091    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:11:43.877165 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:43.877121    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:11:44.160611 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:44.160569    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq" event={"ID":"311e8816-1252-479d-918d-8214a71c4568","Type":"ContainerStarted","Data":"6f80bf51bf08eabda9dbe386a8660e2c12ae7aa6960613058e34b0cad5e88152"}
Jul 31 02:11:44.160826 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:44.160636    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq" event={"ID":"311e8816-1252-479d-918d-8214a71c4568","Type":"ContainerStarted","Data":"f43a7639b634fe30452c71c47c35ba2a148acff6d1efc5d14ba94b916f9eae15"}
Jul 31 02:11:44.182169 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:44.182108    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq" podStartSLOduration=1.182089152 podStartE2EDuration="1.182089152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:11:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:11:44.180810708 +0000 UTC m=+2064.761051706" watchObservedRunningTime="2026-07-31 02:11:44.182089152 +0000 UTC m=+2064.762330146"
Jul 31 02:11:44.725867 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:44.725828    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:44.730291 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:44.730263    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:45.166193 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:45.166164    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:45.167252 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:45.167236    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:11:46.249582 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:46.249549    2571 patch_prober.go:28] interesting pod/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 31 02:11:46.249992 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:46.249607    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd" podUID="905d6f8f-8c61-4945-8801-cc918f6295c5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 02:11:47.675772 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:47.675746    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:47.767505 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:47.767406    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-istio-data\") pod \"905d6f8f-8c61-4945-8801-cc918f6295c5\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") "
Jul 31 02:11:47.767505 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:47.767457    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-istio-envoy\") pod \"905d6f8f-8c61-4945-8801-cc918f6295c5\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") "
Jul 31 02:11:47.767505 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:47.767489    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rk86b\" (UniqueName: \"kubernetes.io/projected/905d6f8f-8c61-4945-8801-cc918f6295c5-kube-api-access-rk86b\") pod \"905d6f8f-8c61-4945-8801-cc918f6295c5\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") "
Jul 31 02:11:47.767798 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:47.767527    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/905d6f8f-8c61-4945-8801-cc918f6295c5-istio-token\") pod \"905d6f8f-8c61-4945-8801-cc918f6295c5\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") "
Jul 31 02:11:47.767798 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:47.767544    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-workload-socket\") pod \"905d6f8f-8c61-4945-8801-cc918f6295c5\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") "
Jul 31 02:11:47.767798 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:47.767573    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-workload-certs\") pod \"905d6f8f-8c61-4945-8801-cc918f6295c5\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") "
Jul 31 02:11:47.767798 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:47.767610    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-credential-socket\") pod \"905d6f8f-8c61-4945-8801-cc918f6295c5\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") "
Jul 31 02:11:47.767798 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:47.767729    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-istio-data" (OuterVolumeSpecName: "istio-data") pod "905d6f8f-8c61-4945-8801-cc918f6295c5" (UID: "905d6f8f-8c61-4945-8801-cc918f6295c5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:11:47.768121 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:47.767876    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "905d6f8f-8c61-4945-8801-cc918f6295c5" (UID: "905d6f8f-8c61-4945-8801-cc918f6295c5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:11:47.768121 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:47.767943    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "905d6f8f-8c61-4945-8801-cc918f6295c5" (UID: "905d6f8f-8c61-4945-8801-cc918f6295c5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:11:47.768121 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:47.767981    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "905d6f8f-8c61-4945-8801-cc918f6295c5" (UID: "905d6f8f-8c61-4945-8801-cc918f6295c5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:11:47.768121 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:47.767679    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/905d6f8f-8c61-4945-8801-cc918f6295c5-istio-podinfo\") pod \"905d6f8f-8c61-4945-8801-cc918f6295c5\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") "
Jul 31 02:11:47.768121 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:47.768088    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/905d6f8f-8c61-4945-8801-cc918f6295c5-istiod-ca-cert\") pod \"905d6f8f-8c61-4945-8801-cc918f6295c5\" (UID: \"905d6f8f-8c61-4945-8801-cc918f6295c5\") "
Jul 31 02:11:47.768468 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:47.768445    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/905d6f8f-8c61-4945-8801-cc918f6295c5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "905d6f8f-8c61-4945-8801-cc918f6295c5" (UID: "905d6f8f-8c61-4945-8801-cc918f6295c5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 02:11:47.768579 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:47.768563    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/905d6f8f-8c61-4945-8801-cc918f6295c5-istiod-ca-cert\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:11:47.768619 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:47.768586    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-istio-data\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:11:47.768619 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:47.768598    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-workload-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:11:47.768619 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:47.768611    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-workload-certs\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:11:47.768747 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:47.768625    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-credential-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:11:47.770008 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:47.769976    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/905d6f8f-8c61-4945-8801-cc918f6295c5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "905d6f8f-8c61-4945-8801-cc918f6295c5" (UID: "905d6f8f-8c61-4945-8801-cc918f6295c5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 02:11:47.770117 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:47.769986    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/905d6f8f-8c61-4945-8801-cc918f6295c5-kube-api-access-rk86b" (OuterVolumeSpecName: "kube-api-access-rk86b") pod "905d6f8f-8c61-4945-8801-cc918f6295c5" (UID: "905d6f8f-8c61-4945-8801-cc918f6295c5"). InnerVolumeSpecName "kube-api-access-rk86b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:11:47.770192 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:47.770175    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "905d6f8f-8c61-4945-8801-cc918f6295c5" (UID: "905d6f8f-8c61-4945-8801-cc918f6295c5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:11:47.770306 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:47.770287    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/905d6f8f-8c61-4945-8801-cc918f6295c5-istio-token" (OuterVolumeSpecName: "istio-token") pod "905d6f8f-8c61-4945-8801-cc918f6295c5" (UID: "905d6f8f-8c61-4945-8801-cc918f6295c5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:11:47.870251 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:47.870211    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/905d6f8f-8c61-4945-8801-cc918f6295c5-istio-envoy\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:11:47.870251 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:47.870247    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rk86b\" (UniqueName: \"kubernetes.io/projected/905d6f8f-8c61-4945-8801-cc918f6295c5-kube-api-access-rk86b\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:11:47.870465 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:47.870261    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/905d6f8f-8c61-4945-8801-cc918f6295c5-istio-token\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:11:47.870465 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:47.870272    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/905d6f8f-8c61-4945-8801-cc918f6295c5-istio-podinfo\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:11:48.183566 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:48.183530    2571 generic.go:356] "Generic (PLEG): container finished" podID="905d6f8f-8c61-4945-8801-cc918f6295c5" containerID="c7c29c5371a7e8dabe4051ed2945df7d21369da8c48cbc803a36b89bf8a84ef6" exitCode=0
Jul 31 02:11:48.183773 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:48.183579    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"
Jul 31 02:11:48.183773 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:48.183614    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd" event={"ID":"905d6f8f-8c61-4945-8801-cc918f6295c5","Type":"ContainerDied","Data":"c7c29c5371a7e8dabe4051ed2945df7d21369da8c48cbc803a36b89bf8a84ef6"}
Jul 31 02:11:48.183773 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:48.183670    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd" event={"ID":"905d6f8f-8c61-4945-8801-cc918f6295c5","Type":"ContainerDied","Data":"2b43cc25b4cd5b757b137306a7b5ce296e4668c1ea8c13d078254d6d99db0602"}
Jul 31 02:11:48.183773 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:48.183697    2571 scope.go:117] "RemoveContainer" containerID="c7c29c5371a7e8dabe4051ed2945df7d21369da8c48cbc803a36b89bf8a84ef6"
Jul 31 02:11:48.193143 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:48.193127    2571 scope.go:117] "RemoveContainer" containerID="3b5378e1f33b1fe535e45c36260615167301e078d522c313fac2c2a27ee2d1d7"
Jul 31 02:11:48.202415 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:48.202385    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"]
Jul 31 02:11:48.202609 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:48.202590    2571 scope.go:117] "RemoveContainer" containerID="c7c29c5371a7e8dabe4051ed2945df7d21369da8c48cbc803a36b89bf8a84ef6"
Jul 31 02:11:48.202862 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:11:48.202845    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7c29c5371a7e8dabe4051ed2945df7d21369da8c48cbc803a36b89bf8a84ef6\": container with ID starting with c7c29c5371a7e8dabe4051ed2945df7d21369da8c48cbc803a36b89bf8a84ef6 not found: ID does not exist" containerID="c7c29c5371a7e8dabe4051ed2945df7d21369da8c48cbc803a36b89bf8a84ef6"
Jul 31 02:11:48.202923 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:48.202871    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7c29c5371a7e8dabe4051ed2945df7d21369da8c48cbc803a36b89bf8a84ef6"} err="failed to get container status \"c7c29c5371a7e8dabe4051ed2945df7d21369da8c48cbc803a36b89bf8a84ef6\": rpc error: code = NotFound desc = could not find container \"c7c29c5371a7e8dabe4051ed2945df7d21369da8c48cbc803a36b89bf8a84ef6\": container with ID starting with c7c29c5371a7e8dabe4051ed2945df7d21369da8c48cbc803a36b89bf8a84ef6 not found: ID does not exist"
Jul 31 02:11:48.202923 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:48.202889    2571 scope.go:117] "RemoveContainer" containerID="3b5378e1f33b1fe535e45c36260615167301e078d522c313fac2c2a27ee2d1d7"
Jul 31 02:11:48.203202 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:11:48.203166    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b5378e1f33b1fe535e45c36260615167301e078d522c313fac2c2a27ee2d1d7\": container with ID starting with 3b5378e1f33b1fe535e45c36260615167301e078d522c313fac2c2a27ee2d1d7 not found: ID does not exist" containerID="3b5378e1f33b1fe535e45c36260615167301e078d522c313fac2c2a27ee2d1d7"
Jul 31 02:11:48.203280 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:48.203198    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b5378e1f33b1fe535e45c36260615167301e078d522c313fac2c2a27ee2d1d7"} err="failed to get container status \"3b5378e1f33b1fe535e45c36260615167301e078d522c313fac2c2a27ee2d1d7\": rpc error: code = NotFound desc = could not find container \"3b5378e1f33b1fe535e45c36260615167301e078d522c313fac2c2a27ee2d1d7\": container with ID starting with 3b5378e1f33b1fe535e45c36260615167301e078d522c313fac2c2a27ee2d1d7 not found: ID does not exist"
Jul 31 02:11:48.205941 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:48.205923    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-5d8e59b6-openshift-default-66df6b7668-45jqd"]
Jul 31 02:11:49.993374 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:11:49.993343    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="905d6f8f-8c61-4945-8801-cc918f6295c5" path="/var/lib/kubelet/pods/905d6f8f-8c61-4945-8801-cc918f6295c5/volumes"
Jul 31 02:12:16.647255 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:16.647223    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"]
Jul 31 02:12:16.648215 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:16.648179    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq" podUID="311e8816-1252-479d-918d-8214a71c4568" containerName="istio-proxy" containerID="cri-o://6f80bf51bf08eabda9dbe386a8660e2c12ae7aa6960613058e34b0cad5e88152" gracePeriod=30
Jul 31 02:12:17.423335 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.423303    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"]
Jul 31 02:12:17.423747 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.423735    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="905d6f8f-8c61-4945-8801-cc918f6295c5" containerName="istio-proxy"
Jul 31 02:12:17.423804 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.423748    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="905d6f8f-8c61-4945-8801-cc918f6295c5" containerName="istio-proxy"
Jul 31 02:12:17.423804 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.423765    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="905d6f8f-8c61-4945-8801-cc918f6295c5" containerName="istio-proxy"
Jul 31 02:12:17.423804 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.423770    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="905d6f8f-8c61-4945-8801-cc918f6295c5" containerName="istio-proxy"
Jul 31 02:12:17.423932 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.423827    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="905d6f8f-8c61-4945-8801-cc918f6295c5" containerName="istio-proxy"
Jul 31 02:12:17.423932 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.423837    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="905d6f8f-8c61-4945-8801-cc918f6295c5" containerName="istio-proxy"
Jul 31 02:12:17.426475 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.426460    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.429215 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.429187    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ebac695f-openshift-default-dockercfg-sgn2v\""
Jul 31 02:12:17.438222 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.438192    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"]
Jul 31 02:12:17.466257 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.466226    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istio-envoy\") pod \"e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") " pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.466471 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.466273    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istio-token\") pod \"e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") " pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.466471 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.466301    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istio-podinfo\") pod \"e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") " pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.466471 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.466324    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istio-data\") pod \"e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") " pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.466471 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.466344    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istiod-ca-cert\") pod \"e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") " pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.466471 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.466362    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-workload-socket\") pod \"e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") " pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.466471 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.466466    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4ljl\" (UniqueName: \"kubernetes.io/projected/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-kube-api-access-w4ljl\") pod \"e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") " pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.466823 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.466519    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-workload-certs\") pod \"e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") " pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.466823 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.466554    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-credential-socket\") pod \"e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") " pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.567802 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.567762    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-credential-socket\") pod \"e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") " pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.567993 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.567836    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istio-envoy\") pod \"e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") " pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.567993 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.567884    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istio-token\") pod \"e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") " pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.567993 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.567933    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istio-podinfo\") pod \"e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") " pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.567993 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.567957    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istio-data\") pod \"e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") " pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.567993 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.567981    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istiod-ca-cert\") pod \"e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") " pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.568256 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.568006    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-workload-socket\") pod \"e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") " pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.568256 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.568101    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4ljl\" (UniqueName: \"kubernetes.io/projected/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-kube-api-access-w4ljl\") pod \"e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") " pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.568256 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.568146    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-workload-certs\") pod \"e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") " pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.568256 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.568241    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-credential-socket\") pod \"e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") " pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.568489 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.568367    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istio-data\") pod \"e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") " pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.568489 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.568472    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-workload-certs\") pod \"e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") " pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.568603 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.568523    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-workload-socket\") pod \"e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") " pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.568797 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.568773    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istiod-ca-cert\") pod \"e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") " pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.570194 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.570176    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istio-envoy\") pod \"e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") " pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.570538 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.570517    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istio-podinfo\") pod \"e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") " pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.576233 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.576210    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4ljl\" (UniqueName: \"kubernetes.io/projected/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-kube-api-access-w4ljl\") pod \"e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") " pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.576368 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.576348    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istio-token\") pod \"e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") " pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.739073 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.738974    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:17.885218 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.885182    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"]
Jul 31 02:12:17.888543 ip-10-0-133-91 kubenswrapper[2571]: W0731 02:12:17.888516    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab3075f7_f214_4ee8_9283_2bf7dd3c4247.slice/crio-d540a389ec198112d5d1adad11efe9695ba9397cbb7086e2c820d80a3370a19c WatchSource:0}: Error finding container d540a389ec198112d5d1adad11efe9695ba9397cbb7086e2c820d80a3370a19c: Status 404 returned error can't find the container with id d540a389ec198112d5d1adad11efe9695ba9397cbb7086e2c820d80a3370a19c
Jul 31 02:12:17.891116 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.891081    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:12:17.891193 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.891165    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:12:17.891234 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:17.891197    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:12:18.351212 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:18.351179    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg" event={"ID":"ab3075f7-f214-4ee8-9283-2bf7dd3c4247","Type":"ContainerStarted","Data":"d380bb3781c3722eee3ffb3842d4eb39bcda3bcefa8f8dd33ffbfbc4c890cddf"}
Jul 31 02:12:18.351416 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:18.351237    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg" event={"ID":"ab3075f7-f214-4ee8-9283-2bf7dd3c4247","Type":"ContainerStarted","Data":"d540a389ec198112d5d1adad11efe9695ba9397cbb7086e2c820d80a3370a19c"}
Jul 31 02:12:18.370533 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:18.370481    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg" podStartSLOduration=1.370463683 podStartE2EDuration="1.370463683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:12:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:12:18.369428234 +0000 UTC m=+2098.949669251" watchObservedRunningTime="2026-07-31 02:12:18.370463683 +0000 UTC m=+2098.950704679"
Jul 31 02:12:18.740127 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:18.740039    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:18.745722 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:18.745695    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:19.356723 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:19.356699    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:19.357624 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:19.357601    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:21.904467 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:21.904440    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:12:22.015503 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.015416    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gh4hb\" (UniqueName: \"kubernetes.io/projected/311e8816-1252-479d-918d-8214a71c4568-kube-api-access-gh4hb\") pod \"311e8816-1252-479d-918d-8214a71c4568\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") "
Jul 31 02:12:22.015503 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.015455    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/311e8816-1252-479d-918d-8214a71c4568-istio-podinfo\") pod \"311e8816-1252-479d-918d-8214a71c4568\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") "
Jul 31 02:12:22.015503 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.015476    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-workload-certs\") pod \"311e8816-1252-479d-918d-8214a71c4568\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") "
Jul 31 02:12:22.015503 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.015497    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-credential-socket\") pod \"311e8816-1252-479d-918d-8214a71c4568\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") "
Jul 31 02:12:22.015843 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.015553    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-workload-socket\") pod \"311e8816-1252-479d-918d-8214a71c4568\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") "
Jul 31 02:12:22.015843 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.015618    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-istio-data\") pod \"311e8816-1252-479d-918d-8214a71c4568\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") "
Jul 31 02:12:22.015843 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.015651    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-istio-envoy\") pod \"311e8816-1252-479d-918d-8214a71c4568\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") "
Jul 31 02:12:22.015843 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.015685    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/311e8816-1252-479d-918d-8214a71c4568-istio-token\") pod \"311e8816-1252-479d-918d-8214a71c4568\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") "
Jul 31 02:12:22.015843 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.015719    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/311e8816-1252-479d-918d-8214a71c4568-istiod-ca-cert\") pod \"311e8816-1252-479d-918d-8214a71c4568\" (UID: \"311e8816-1252-479d-918d-8214a71c4568\") "
Jul 31 02:12:22.015843 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.015778    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "311e8816-1252-479d-918d-8214a71c4568" (UID: "311e8816-1252-479d-918d-8214a71c4568"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:12:22.015843 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.015795    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "311e8816-1252-479d-918d-8214a71c4568" (UID: "311e8816-1252-479d-918d-8214a71c4568"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:12:22.015843 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.015811    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "311e8816-1252-479d-918d-8214a71c4568" (UID: "311e8816-1252-479d-918d-8214a71c4568"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:12:22.016287 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.015941    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-istio-data" (OuterVolumeSpecName: "istio-data") pod "311e8816-1252-479d-918d-8214a71c4568" (UID: "311e8816-1252-479d-918d-8214a71c4568"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:12:22.016287 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.016182    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/311e8816-1252-479d-918d-8214a71c4568-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "311e8816-1252-479d-918d-8214a71c4568" (UID: "311e8816-1252-479d-918d-8214a71c4568"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 02:12:22.016287 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.016187    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-workload-certs\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:12:22.016287 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.016214    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-credential-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:12:22.016287 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.016226    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-workload-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:12:22.016287 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.016236    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-istio-data\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:12:22.018160 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.018117    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/311e8816-1252-479d-918d-8214a71c4568-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "311e8816-1252-479d-918d-8214a71c4568" (UID: "311e8816-1252-479d-918d-8214a71c4568"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 02:12:22.018160 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.018123    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "311e8816-1252-479d-918d-8214a71c4568" (UID: "311e8816-1252-479d-918d-8214a71c4568"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:12:22.018328 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.018193    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/311e8816-1252-479d-918d-8214a71c4568-istio-token" (OuterVolumeSpecName: "istio-token") pod "311e8816-1252-479d-918d-8214a71c4568" (UID: "311e8816-1252-479d-918d-8214a71c4568"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:12:22.018328 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.018200    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/311e8816-1252-479d-918d-8214a71c4568-kube-api-access-gh4hb" (OuterVolumeSpecName: "kube-api-access-gh4hb") pod "311e8816-1252-479d-918d-8214a71c4568" (UID: "311e8816-1252-479d-918d-8214a71c4568"). InnerVolumeSpecName "kube-api-access-gh4hb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:12:22.117236 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.117202    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/311e8816-1252-479d-918d-8214a71c4568-istio-envoy\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:12:22.117236 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.117234    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/311e8816-1252-479d-918d-8214a71c4568-istio-token\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:12:22.117236 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.117245    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/311e8816-1252-479d-918d-8214a71c4568-istiod-ca-cert\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:12:22.117480 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.117260    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gh4hb\" (UniqueName: \"kubernetes.io/projected/311e8816-1252-479d-918d-8214a71c4568-kube-api-access-gh4hb\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:12:22.117480 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.117273    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/311e8816-1252-479d-918d-8214a71c4568-istio-podinfo\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:12:22.373591 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.373558    2571 generic.go:356] "Generic (PLEG): container finished" podID="311e8816-1252-479d-918d-8214a71c4568" containerID="6f80bf51bf08eabda9dbe386a8660e2c12ae7aa6960613058e34b0cad5e88152" exitCode=0
Jul 31 02:12:22.373781 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.373599    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"
Jul 31 02:12:22.373781 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.373649    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq" event={"ID":"311e8816-1252-479d-918d-8214a71c4568","Type":"ContainerDied","Data":"6f80bf51bf08eabda9dbe386a8660e2c12ae7aa6960613058e34b0cad5e88152"}
Jul 31 02:12:22.373781 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.373706    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq" event={"ID":"311e8816-1252-479d-918d-8214a71c4568","Type":"ContainerDied","Data":"f43a7639b634fe30452c71c47c35ba2a148acff6d1efc5d14ba94b916f9eae15"}
Jul 31 02:12:22.373781 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.373728    2571 scope.go:117] "RemoveContainer" containerID="6f80bf51bf08eabda9dbe386a8660e2c12ae7aa6960613058e34b0cad5e88152"
Jul 31 02:12:22.384152 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.384125    2571 scope.go:117] "RemoveContainer" containerID="6f80bf51bf08eabda9dbe386a8660e2c12ae7aa6960613058e34b0cad5e88152"
Jul 31 02:12:22.384477 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:12:22.384459    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f80bf51bf08eabda9dbe386a8660e2c12ae7aa6960613058e34b0cad5e88152\": container with ID starting with 6f80bf51bf08eabda9dbe386a8660e2c12ae7aa6960613058e34b0cad5e88152 not found: ID does not exist" containerID="6f80bf51bf08eabda9dbe386a8660e2c12ae7aa6960613058e34b0cad5e88152"
Jul 31 02:12:22.384552 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.384493    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f80bf51bf08eabda9dbe386a8660e2c12ae7aa6960613058e34b0cad5e88152"} err="failed to get container status \"6f80bf51bf08eabda9dbe386a8660e2c12ae7aa6960613058e34b0cad5e88152\": rpc error: code = NotFound desc = could not find container \"6f80bf51bf08eabda9dbe386a8660e2c12ae7aa6960613058e34b0cad5e88152\": container with ID starting with 6f80bf51bf08eabda9dbe386a8660e2c12ae7aa6960613058e34b0cad5e88152 not found: ID does not exist"
Jul 31 02:12:22.396278 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.396248    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"]
Jul 31 02:12:22.401580 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:22.401553    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-241ce02f-gw-openshift-default-7c874775d8-7qjfq"]
Jul 31 02:12:23.992913 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:23.992870    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="311e8816-1252-479d-918d-8214a71c4568" path="/var/lib/kubelet/pods/311e8816-1252-479d-918d-8214a71c4568/volumes"
Jul 31 02:12:33.434973 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:33.434938    2571 generic.go:356] "Generic (PLEG): container finished" podID="ab3075f7-f214-4ee8-9283-2bf7dd3c4247" containerID="d380bb3781c3722eee3ffb3842d4eb39bcda3bcefa8f8dd33ffbfbc4c890cddf" exitCode=0
Jul 31 02:12:33.435515 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:33.435012    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg" event={"ID":"ab3075f7-f214-4ee8-9283-2bf7dd3c4247","Type":"ContainerDied","Data":"d380bb3781c3722eee3ffb3842d4eb39bcda3bcefa8f8dd33ffbfbc4c890cddf"}
Jul 31 02:12:33.435515 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:33.435459    2571 scope.go:117] "RemoveContainer" containerID="d380bb3781c3722eee3ffb3842d4eb39bcda3bcefa8f8dd33ffbfbc4c890cddf"
Jul 31 02:12:33.436579 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:33.436550    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:12:33.436657 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:33.436617    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:12:33.436712 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:33.436658    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:12:34.357504 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:34.357449    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:34.447031 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:34.446974    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg" event={"ID":"ab3075f7-f214-4ee8-9283-2bf7dd3c4247","Type":"ContainerStarted","Data":"bd8cf3a337de5b7d8c37aa965964a45a9dda48bef679f6adfb01c070b1055ca4"}
Jul 31 02:12:34.742496 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:34.742391    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:34.745349 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:34.745314    2571 patch_prober.go:28] interesting pod/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 31 02:12:34.745648 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:34.745604    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg" podUID="ab3075f7-f214-4ee8-9283-2bf7dd3c4247" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 31 02:12:35.740076 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:35.740036    2571 patch_prober.go:28] interesting pod/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 31 02:12:35.740725 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:35.740694    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg" podUID="ab3075f7-f214-4ee8-9283-2bf7dd3c4247" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 31 02:12:36.758335 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:36.758295    2571 patch_prober.go:28] interesting pod/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 31 02:12:36.758848 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:36.758372    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg" podUID="ab3075f7-f214-4ee8-9283-2bf7dd3c4247" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 31 02:12:37.739487 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:37.739446    2571 patch_prober.go:28] interesting pod/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 31 02:12:37.739792 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:37.739758    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg" podUID="ab3075f7-f214-4ee8-9283-2bf7dd3c4247" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 31 02:12:38.739880 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:38.739836    2571 patch_prober.go:28] interesting pod/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 31 02:12:38.740423 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:38.739927    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg" podUID="ab3075f7-f214-4ee8-9283-2bf7dd3c4247" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 31 02:12:39.743611 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:39.743580    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:39.744064 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:39.743998    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:39.744665 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:39.744647    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:52.583996 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:52.583960    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"]
Jul 31 02:12:52.584635 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:52.584173    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg" podUID="ab3075f7-f214-4ee8-9283-2bf7dd3c4247" containerName="istio-proxy" containerID="cri-o://bd8cf3a337de5b7d8c37aa965964a45a9dda48bef679f6adfb01c070b1055ca4" gracePeriod=30
Jul 31 02:12:53.354149 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.354105    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"]
Jul 31 02:12:53.354953 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.354913    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="311e8816-1252-479d-918d-8214a71c4568" containerName="istio-proxy"
Jul 31 02:12:53.354953 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.354952    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="311e8816-1252-479d-918d-8214a71c4568" containerName="istio-proxy"
Jul 31 02:12:53.355146 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.355078    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="311e8816-1252-479d-918d-8214a71c4568" containerName="istio-proxy"
Jul 31 02:12:53.357663 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.357644    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.360395 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.360375    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-cb65761c-openshift-default-dockercfg-mkslt\""
Jul 31 02:12:53.368477 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.368447    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"]
Jul 31 02:12:53.442784 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.442746    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-workload-socket\") pod \"e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") " pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.443028 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.442800    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-workload-certs\") pod \"e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") " pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.443028 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.442880    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27eacf7d-ff93-409d-8cea-10a0e3842d66-istio-podinfo\") pod \"e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") " pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.443028 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.442956    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-credential-socket\") pod \"e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") " pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.443028 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.442973    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-istio-data\") pod \"e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") " pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.443028 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.442989    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-istio-envoy\") pod \"e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") " pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.443028 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.443008    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27eacf7d-ff93-409d-8cea-10a0e3842d66-istio-token\") pod \"e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") " pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.443792 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.443078    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27eacf7d-ff93-409d-8cea-10a0e3842d66-istiod-ca-cert\") pod \"e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") " pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.443792 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.443103    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtjjk\" (UniqueName: \"kubernetes.io/projected/27eacf7d-ff93-409d-8cea-10a0e3842d66-kube-api-access-mtjjk\") pod \"e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") " pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.543977 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.543943    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-workload-socket\") pod \"e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") " pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.543977 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.543993    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-workload-certs\") pod \"e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") " pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.544235 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.544047    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27eacf7d-ff93-409d-8cea-10a0e3842d66-istio-podinfo\") pod \"e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") " pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.544235 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.544077    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-credential-socket\") pod \"e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") " pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.544235 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.544093    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-istio-data\") pod \"e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") " pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.544235 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.544109    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-istio-envoy\") pod \"e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") " pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.544235 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.544137    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27eacf7d-ff93-409d-8cea-10a0e3842d66-istio-token\") pod \"e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") " pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.544235 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.544184    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27eacf7d-ff93-409d-8cea-10a0e3842d66-istiod-ca-cert\") pod \"e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") " pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.544235 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.544213    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtjjk\" (UniqueName: \"kubernetes.io/projected/27eacf7d-ff93-409d-8cea-10a0e3842d66-kube-api-access-mtjjk\") pod \"e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") " pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.544573 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.544423    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-workload-socket\") pod \"e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") " pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.544573 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.544435    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-workload-certs\") pod \"e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") " pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.544694 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.544668    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-credential-socket\") pod \"e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") " pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.544694 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.544681    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-istio-data\") pod \"e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") " pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.545007 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.544985    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27eacf7d-ff93-409d-8cea-10a0e3842d66-istiod-ca-cert\") pod \"e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") " pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.546685 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.546659    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-istio-envoy\") pod \"e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") " pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.547015 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.546998    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27eacf7d-ff93-409d-8cea-10a0e3842d66-istio-podinfo\") pod \"e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") " pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.553722 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.553697    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27eacf7d-ff93-409d-8cea-10a0e3842d66-istio-token\") pod \"e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") " pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.553926 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.553887    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtjjk\" (UniqueName: \"kubernetes.io/projected/27eacf7d-ff93-409d-8cea-10a0e3842d66-kube-api-access-mtjjk\") pod \"e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") " pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.670724 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.670614    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:53.818752 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.818724    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"]
Jul 31 02:12:53.820334 ip-10-0-133-91 kubenswrapper[2571]: W0731 02:12:53.820303    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27eacf7d_ff93_409d_8cea_10a0e3842d66.slice/crio-ceef14a755f400711e78e40a34106526de741ab6783008a1442bea76e1989dea WatchSource:0}: Error finding container ceef14a755f400711e78e40a34106526de741ab6783008a1442bea76e1989dea: Status 404 returned error can't find the container with id ceef14a755f400711e78e40a34106526de741ab6783008a1442bea76e1989dea
Jul 31 02:12:53.822513 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.822481    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:12:53.822637 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.822546    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:12:53.822637 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:53.822572    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:12:54.571466 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:54.571425    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7" event={"ID":"27eacf7d-ff93-409d-8cea-10a0e3842d66","Type":"ContainerStarted","Data":"22b5d08502a7bc91b6beb5950b884c82c598b1a923681aa6f84c3e42af7fea30"}
Jul 31 02:12:54.571649 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:54.571524    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7" event={"ID":"27eacf7d-ff93-409d-8cea-10a0e3842d66","Type":"ContainerStarted","Data":"ceef14a755f400711e78e40a34106526de741ab6783008a1442bea76e1989dea"}
Jul 31 02:12:54.590841 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:54.590793    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7" podStartSLOduration=1.59077731 podStartE2EDuration="1.59077731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:12:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:12:54.589644789 +0000 UTC m=+2135.169885766" watchObservedRunningTime="2026-07-31 02:12:54.59077731 +0000 UTC m=+2135.171018304"
Jul 31 02:12:54.671771 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:54.671731    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:54.677026 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:54.676993    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:54.746441 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:54.746397    2571 patch_prober.go:28] interesting pod/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 31 02:12:54.746616 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:54.746504    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg" podUID="ab3075f7-f214-4ee8-9283-2bf7dd3c4247" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 02:12:55.577474 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:55.577431    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:55.578534 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:55.578515    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:12:57.862798 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:57.862771    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:57.999222 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:57.999196    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-workload-socket\") pod \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") "
Jul 31 02:12:57.999443 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:57.999250    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-credential-socket\") pod \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") "
Jul 31 02:12:57.999443 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:57.999282    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istio-envoy\") pod \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") "
Jul 31 02:12:57.999443 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:57.999300    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-workload-certs\") pod \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") "
Jul 31 02:12:57.999443 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:57.999352    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istio-data\") pod \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") "
Jul 31 02:12:57.999443 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:57.999407    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4ljl\" (UniqueName: \"kubernetes.io/projected/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-kube-api-access-w4ljl\") pod \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") "
Jul 31 02:12:57.999443 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:57.999443    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istio-token\") pod \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") "
Jul 31 02:12:57.999764 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:57.999460    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ab3075f7-f214-4ee8-9283-2bf7dd3c4247" (UID: "ab3075f7-f214-4ee8-9283-2bf7dd3c4247"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:12:57.999764 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:57.999468    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istiod-ca-cert\") pod \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") "
Jul 31 02:12:57.999764 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:57.999620    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ab3075f7-f214-4ee8-9283-2bf7dd3c4247" (UID: "ab3075f7-f214-4ee8-9283-2bf7dd3c4247"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:12:57.999764 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:57.999641    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ab3075f7-f214-4ee8-9283-2bf7dd3c4247" (UID: "ab3075f7-f214-4ee8-9283-2bf7dd3c4247"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:12:57.999764 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:57.999682    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istio-data" (OuterVolumeSpecName: "istio-data") pod "ab3075f7-f214-4ee8-9283-2bf7dd3c4247" (UID: "ab3075f7-f214-4ee8-9283-2bf7dd3c4247"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:12:57.999764 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:57.999739    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istio-podinfo\") pod \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\" (UID: \"ab3075f7-f214-4ee8-9283-2bf7dd3c4247\") "
Jul 31 02:12:58.000070 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:57.999777    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ab3075f7-f214-4ee8-9283-2bf7dd3c4247" (UID: "ab3075f7-f214-4ee8-9283-2bf7dd3c4247"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 02:12:58.000173 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:58.000153    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-workload-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:12:58.000242 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:58.000179    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-credential-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:12:58.000242 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:58.000192    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-workload-certs\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:12:58.000242 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:58.000205    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istio-data\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:12:58.000242 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:58.000218    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istiod-ca-cert\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:12:58.001659 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:58.001636    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istio-token" (OuterVolumeSpecName: "istio-token") pod "ab3075f7-f214-4ee8-9283-2bf7dd3c4247" (UID: "ab3075f7-f214-4ee8-9283-2bf7dd3c4247"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:12:58.001765 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:58.001652    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-kube-api-access-w4ljl" (OuterVolumeSpecName: "kube-api-access-w4ljl") pod "ab3075f7-f214-4ee8-9283-2bf7dd3c4247" (UID: "ab3075f7-f214-4ee8-9283-2bf7dd3c4247"). InnerVolumeSpecName "kube-api-access-w4ljl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:12:58.001837 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:58.001826    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ab3075f7-f214-4ee8-9283-2bf7dd3c4247" (UID: "ab3075f7-f214-4ee8-9283-2bf7dd3c4247"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:12:58.001912 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:58.001881    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ab3075f7-f214-4ee8-9283-2bf7dd3c4247" (UID: "ab3075f7-f214-4ee8-9283-2bf7dd3c4247"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 02:12:58.101093 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:58.100994    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istio-token\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:12:58.101093 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:58.101027    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istio-podinfo\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:12:58.101093 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:58.101035    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-istio-envoy\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:12:58.101093 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:58.101043    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4ljl\" (UniqueName: \"kubernetes.io/projected/ab3075f7-f214-4ee8-9283-2bf7dd3c4247-kube-api-access-w4ljl\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:12:58.594833 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:58.594803    2571 generic.go:356] "Generic (PLEG): container finished" podID="ab3075f7-f214-4ee8-9283-2bf7dd3c4247" containerID="bd8cf3a337de5b7d8c37aa965964a45a9dda48bef679f6adfb01c070b1055ca4" exitCode=0
Jul 31 02:12:58.595030 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:58.594848    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"
Jul 31 02:12:58.595030 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:58.594853    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg" event={"ID":"ab3075f7-f214-4ee8-9283-2bf7dd3c4247","Type":"ContainerDied","Data":"bd8cf3a337de5b7d8c37aa965964a45a9dda48bef679f6adfb01c070b1055ca4"}
Jul 31 02:12:58.595030 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:58.594921    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg" event={"ID":"ab3075f7-f214-4ee8-9283-2bf7dd3c4247","Type":"ContainerDied","Data":"d540a389ec198112d5d1adad11efe9695ba9397cbb7086e2c820d80a3370a19c"}
Jul 31 02:12:58.595030 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:58.594944    2571 scope.go:117] "RemoveContainer" containerID="bd8cf3a337de5b7d8c37aa965964a45a9dda48bef679f6adfb01c070b1055ca4"
Jul 31 02:12:58.605570 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:58.605523    2571 scope.go:117] "RemoveContainer" containerID="d380bb3781c3722eee3ffb3842d4eb39bcda3bcefa8f8dd33ffbfbc4c890cddf"
Jul 31 02:12:58.614071 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:58.614052    2571 scope.go:117] "RemoveContainer" containerID="bd8cf3a337de5b7d8c37aa965964a45a9dda48bef679f6adfb01c070b1055ca4"
Jul 31 02:12:58.614337 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:12:58.614308    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd8cf3a337de5b7d8c37aa965964a45a9dda48bef679f6adfb01c070b1055ca4\": container with ID starting with bd8cf3a337de5b7d8c37aa965964a45a9dda48bef679f6adfb01c070b1055ca4 not found: ID does not exist" containerID="bd8cf3a337de5b7d8c37aa965964a45a9dda48bef679f6adfb01c070b1055ca4"
Jul 31 02:12:58.614444 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:58.614347    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd8cf3a337de5b7d8c37aa965964a45a9dda48bef679f6adfb01c070b1055ca4"} err="failed to get container status \"bd8cf3a337de5b7d8c37aa965964a45a9dda48bef679f6adfb01c070b1055ca4\": rpc error: code = NotFound desc = could not find container \"bd8cf3a337de5b7d8c37aa965964a45a9dda48bef679f6adfb01c070b1055ca4\": container with ID starting with bd8cf3a337de5b7d8c37aa965964a45a9dda48bef679f6adfb01c070b1055ca4 not found: ID does not exist"
Jul 31 02:12:58.614444 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:58.614367    2571 scope.go:117] "RemoveContainer" containerID="d380bb3781c3722eee3ffb3842d4eb39bcda3bcefa8f8dd33ffbfbc4c890cddf"
Jul 31 02:12:58.614587 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:12:58.614570    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d380bb3781c3722eee3ffb3842d4eb39bcda3bcefa8f8dd33ffbfbc4c890cddf\": container with ID starting with d380bb3781c3722eee3ffb3842d4eb39bcda3bcefa8f8dd33ffbfbc4c890cddf not found: ID does not exist" containerID="d380bb3781c3722eee3ffb3842d4eb39bcda3bcefa8f8dd33ffbfbc4c890cddf"
Jul 31 02:12:58.614628 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:58.614592    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d380bb3781c3722eee3ffb3842d4eb39bcda3bcefa8f8dd33ffbfbc4c890cddf"} err="failed to get container status \"d380bb3781c3722eee3ffb3842d4eb39bcda3bcefa8f8dd33ffbfbc4c890cddf\": rpc error: code = NotFound desc = could not find container \"d380bb3781c3722eee3ffb3842d4eb39bcda3bcefa8f8dd33ffbfbc4c890cddf\": container with ID starting with d380bb3781c3722eee3ffb3842d4eb39bcda3bcefa8f8dd33ffbfbc4c890cddf not found: ID does not exist"
Jul 31 02:12:58.620076 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:58.620051    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"]
Jul 31 02:12:58.625918 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:58.625880    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ebac695f-openshift-default-6fd6cbc966-88bpg"]
Jul 31 02:12:59.992549 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:12:59.992516    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab3075f7-f214-4ee8-9283-2bf7dd3c4247" path="/var/lib/kubelet/pods/ab3075f7-f214-4ee8-9283-2bf7dd3c4247/volumes"
Jul 31 02:13:10.579648 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:10.579622    2571 patch_prober.go:28] interesting pod/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 31 02:13:10.580005 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:10.579672    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7" podUID="27eacf7d-ff93-409d-8cea-10a0e3842d66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 31 02:13:10.662880 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:10.662846    2571 generic.go:356] "Generic (PLEG): container finished" podID="27eacf7d-ff93-409d-8cea-10a0e3842d66" containerID="22b5d08502a7bc91b6beb5950b884c82c598b1a923681aa6f84c3e42af7fea30" exitCode=0
Jul 31 02:13:10.663064 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:10.662926    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7" event={"ID":"27eacf7d-ff93-409d-8cea-10a0e3842d66","Type":"ContainerDied","Data":"22b5d08502a7bc91b6beb5950b884c82c598b1a923681aa6f84c3e42af7fea30"}
Jul 31 02:13:10.663344 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:10.663330    2571 scope.go:117] "RemoveContainer" containerID="22b5d08502a7bc91b6beb5950b884c82c598b1a923681aa6f84c3e42af7fea30"
Jul 31 02:13:10.664491 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:10.664462    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:13:10.664592 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:10.664548    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:13:10.664664 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:10.664599    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:13:11.670562 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:11.670483    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7" event={"ID":"27eacf7d-ff93-409d-8cea-10a0e3842d66","Type":"ContainerStarted","Data":"2fcbf43aa96234ab11cf3210e7fe50fde23b53f496ac7237bc61959803b507b3"}
Jul 31 02:13:11.670999 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:11.670837    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:13:11.671127 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:11.671106    2571 patch_prober.go:28] interesting pod/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 31 02:13:11.671205 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:11.671158    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7" podUID="27eacf7d-ff93-409d-8cea-10a0e3842d66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 31 02:13:12.671676 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:12.671640    2571 patch_prober.go:28] interesting pod/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 31 02:13:12.672151 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:12.671697    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7" podUID="27eacf7d-ff93-409d-8cea-10a0e3842d66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 31 02:13:13.671802 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:13.671766    2571 patch_prober.go:28] interesting pod/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 31 02:13:13.672248 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:13.671821    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7" podUID="27eacf7d-ff93-409d-8cea-10a0e3842d66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 31 02:13:14.671062 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:14.671021    2571 patch_prober.go:28] interesting pod/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 31 02:13:14.671268 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:14.671081    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7" podUID="27eacf7d-ff93-409d-8cea-10a0e3842d66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 31 02:13:15.672002 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:15.671962    2571 patch_prober.go:28] interesting pod/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 31 02:13:15.672405 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:15.672025    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7" podUID="27eacf7d-ff93-409d-8cea-10a0e3842d66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 31 02:13:16.675330 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:16.675300    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:13:16.675710 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:16.675585    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:13:16.676296 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:16.676278    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:13:37.805403 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:37.805352    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"]
Jul 31 02:13:37.806387 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:37.806333    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7" podUID="27eacf7d-ff93-409d-8cea-10a0e3842d66" containerName="istio-proxy" containerID="cri-o://2fcbf43aa96234ab11cf3210e7fe50fde23b53f496ac7237bc61959803b507b3" gracePeriod=30
Jul 31 02:13:43.064508 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.064481    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:13:43.160590 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.160508    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27eacf7d-ff93-409d-8cea-10a0e3842d66-istio-token\") pod \"27eacf7d-ff93-409d-8cea-10a0e3842d66\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") "
Jul 31 02:13:43.160590 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.160577    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-workload-socket\") pod \"27eacf7d-ff93-409d-8cea-10a0e3842d66\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") "
Jul 31 02:13:43.160818 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.160612    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-workload-certs\") pod \"27eacf7d-ff93-409d-8cea-10a0e3842d66\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") "
Jul 31 02:13:43.160818 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.160638    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-credential-socket\") pod \"27eacf7d-ff93-409d-8cea-10a0e3842d66\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") "
Jul 31 02:13:43.160818 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.160664    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-istio-data\") pod \"27eacf7d-ff93-409d-8cea-10a0e3842d66\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") "
Jul 31 02:13:43.160818 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.160694    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-istio-envoy\") pod \"27eacf7d-ff93-409d-8cea-10a0e3842d66\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") "
Jul 31 02:13:43.160818 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.160716    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtjjk\" (UniqueName: \"kubernetes.io/projected/27eacf7d-ff93-409d-8cea-10a0e3842d66-kube-api-access-mtjjk\") pod \"27eacf7d-ff93-409d-8cea-10a0e3842d66\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") "
Jul 31 02:13:43.160818 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.160750    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27eacf7d-ff93-409d-8cea-10a0e3842d66-istiod-ca-cert\") pod \"27eacf7d-ff93-409d-8cea-10a0e3842d66\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") "
Jul 31 02:13:43.160818 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.160779    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27eacf7d-ff93-409d-8cea-10a0e3842d66-istio-podinfo\") pod \"27eacf7d-ff93-409d-8cea-10a0e3842d66\" (UID: \"27eacf7d-ff93-409d-8cea-10a0e3842d66\") "
Jul 31 02:13:43.161206 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.161012    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "27eacf7d-ff93-409d-8cea-10a0e3842d66" (UID: "27eacf7d-ff93-409d-8cea-10a0e3842d66"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:13:43.161206 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.161001    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "27eacf7d-ff93-409d-8cea-10a0e3842d66" (UID: "27eacf7d-ff93-409d-8cea-10a0e3842d66"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:13:43.161206 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.161051    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-istio-data" (OuterVolumeSpecName: "istio-data") pod "27eacf7d-ff93-409d-8cea-10a0e3842d66" (UID: "27eacf7d-ff93-409d-8cea-10a0e3842d66"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:13:43.161379 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.161284    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-workload-certs\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:13:43.161379 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.161303    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-credential-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:13:43.161379 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.161316    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-istio-data\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:13:43.161379 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.161311    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27eacf7d-ff93-409d-8cea-10a0e3842d66-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "27eacf7d-ff93-409d-8cea-10a0e3842d66" (UID: "27eacf7d-ff93-409d-8cea-10a0e3842d66"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 02:13:43.161770 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.161747    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "27eacf7d-ff93-409d-8cea-10a0e3842d66" (UID: "27eacf7d-ff93-409d-8cea-10a0e3842d66"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:13:43.163088 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.163066    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/27eacf7d-ff93-409d-8cea-10a0e3842d66-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "27eacf7d-ff93-409d-8cea-10a0e3842d66" (UID: "27eacf7d-ff93-409d-8cea-10a0e3842d66"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 02:13:43.163164 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.163138    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27eacf7d-ff93-409d-8cea-10a0e3842d66-kube-api-access-mtjjk" (OuterVolumeSpecName: "kube-api-access-mtjjk") pod "27eacf7d-ff93-409d-8cea-10a0e3842d66" (UID: "27eacf7d-ff93-409d-8cea-10a0e3842d66"). InnerVolumeSpecName "kube-api-access-mtjjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:13:43.163297 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.163282    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27eacf7d-ff93-409d-8cea-10a0e3842d66-istio-token" (OuterVolumeSpecName: "istio-token") pod "27eacf7d-ff93-409d-8cea-10a0e3842d66" (UID: "27eacf7d-ff93-409d-8cea-10a0e3842d66"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:13:43.163339 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.163323    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "27eacf7d-ff93-409d-8cea-10a0e3842d66" (UID: "27eacf7d-ff93-409d-8cea-10a0e3842d66"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:13:43.262388 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.262353    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27eacf7d-ff93-409d-8cea-10a0e3842d66-istio-token\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:13:43.262388 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.262383    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-workload-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:13:43.262388 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.262394    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27eacf7d-ff93-409d-8cea-10a0e3842d66-istio-envoy\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:13:43.262618 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.262406    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtjjk\" (UniqueName: \"kubernetes.io/projected/27eacf7d-ff93-409d-8cea-10a0e3842d66-kube-api-access-mtjjk\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:13:43.262618 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.262419    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27eacf7d-ff93-409d-8cea-10a0e3842d66-istiod-ca-cert\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:13:43.262618 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.262430    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27eacf7d-ff93-409d-8cea-10a0e3842d66-istio-podinfo\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:13:43.852360 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.852322    2571 generic.go:356] "Generic (PLEG): container finished" podID="27eacf7d-ff93-409d-8cea-10a0e3842d66" containerID="2fcbf43aa96234ab11cf3210e7fe50fde23b53f496ac7237bc61959803b507b3" exitCode=0
Jul 31 02:13:43.852537 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.852371    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"
Jul 31 02:13:43.852537 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.852373    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7" event={"ID":"27eacf7d-ff93-409d-8cea-10a0e3842d66","Type":"ContainerDied","Data":"2fcbf43aa96234ab11cf3210e7fe50fde23b53f496ac7237bc61959803b507b3"}
Jul 31 02:13:43.852537 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.852486    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7" event={"ID":"27eacf7d-ff93-409d-8cea-10a0e3842d66","Type":"ContainerDied","Data":"ceef14a755f400711e78e40a34106526de741ab6783008a1442bea76e1989dea"}
Jul 31 02:13:43.852537 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.852523    2571 scope.go:117] "RemoveContainer" containerID="2fcbf43aa96234ab11cf3210e7fe50fde23b53f496ac7237bc61959803b507b3"
Jul 31 02:13:43.862712 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.862691    2571 scope.go:117] "RemoveContainer" containerID="22b5d08502a7bc91b6beb5950b884c82c598b1a923681aa6f84c3e42af7fea30"
Jul 31 02:13:43.871204 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.871183    2571 scope.go:117] "RemoveContainer" containerID="2fcbf43aa96234ab11cf3210e7fe50fde23b53f496ac7237bc61959803b507b3"
Jul 31 02:13:43.871754 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:13:43.871580    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fcbf43aa96234ab11cf3210e7fe50fde23b53f496ac7237bc61959803b507b3\": container with ID starting with 2fcbf43aa96234ab11cf3210e7fe50fde23b53f496ac7237bc61959803b507b3 not found: ID does not exist" containerID="2fcbf43aa96234ab11cf3210e7fe50fde23b53f496ac7237bc61959803b507b3"
Jul 31 02:13:43.871754 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.871620    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fcbf43aa96234ab11cf3210e7fe50fde23b53f496ac7237bc61959803b507b3"} err="failed to get container status \"2fcbf43aa96234ab11cf3210e7fe50fde23b53f496ac7237bc61959803b507b3\": rpc error: code = NotFound desc = could not find container \"2fcbf43aa96234ab11cf3210e7fe50fde23b53f496ac7237bc61959803b507b3\": container with ID starting with 2fcbf43aa96234ab11cf3210e7fe50fde23b53f496ac7237bc61959803b507b3 not found: ID does not exist"
Jul 31 02:13:43.871754 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.871650    2571 scope.go:117] "RemoveContainer" containerID="22b5d08502a7bc91b6beb5950b884c82c598b1a923681aa6f84c3e42af7fea30"
Jul 31 02:13:43.872337 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:13:43.872314    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22b5d08502a7bc91b6beb5950b884c82c598b1a923681aa6f84c3e42af7fea30\": container with ID starting with 22b5d08502a7bc91b6beb5950b884c82c598b1a923681aa6f84c3e42af7fea30 not found: ID does not exist" containerID="22b5d08502a7bc91b6beb5950b884c82c598b1a923681aa6f84c3e42af7fea30"
Jul 31 02:13:43.872441 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.872347    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22b5d08502a7bc91b6beb5950b884c82c598b1a923681aa6f84c3e42af7fea30"} err="failed to get container status \"22b5d08502a7bc91b6beb5950b884c82c598b1a923681aa6f84c3e42af7fea30\": rpc error: code = NotFound desc = could not find container \"22b5d08502a7bc91b6beb5950b884c82c598b1a923681aa6f84c3e42af7fea30\": container with ID starting with 22b5d08502a7bc91b6beb5950b884c82c598b1a923681aa6f84c3e42af7fea30 not found: ID does not exist"
Jul 31 02:13:43.874449 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.874430    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"]
Jul 31 02:13:43.878727 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.878701    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-cb65761c-openshift-default-868bffcb96-ktwm7"]
Jul 31 02:13:43.992141 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:13:43.992102    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27eacf7d-ff93-409d-8cea-10a0e3842d66" path="/var/lib/kubelet/pods/27eacf7d-ff93-409d-8cea-10a0e3842d66/volumes"
Jul 31 02:15:35.951646 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:35.951611    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"]
Jul 31 02:15:35.952131 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:35.952038    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab3075f7-f214-4ee8-9283-2bf7dd3c4247" containerName="istio-proxy"
Jul 31 02:15:35.952131 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:35.952050    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab3075f7-f214-4ee8-9283-2bf7dd3c4247" containerName="istio-proxy"
Jul 31 02:15:35.952131 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:35.952065    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27eacf7d-ff93-409d-8cea-10a0e3842d66" containerName="istio-proxy"
Jul 31 02:15:35.952131 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:35.952070    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="27eacf7d-ff93-409d-8cea-10a0e3842d66" containerName="istio-proxy"
Jul 31 02:15:35.952131 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:35.952079    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27eacf7d-ff93-409d-8cea-10a0e3842d66" containerName="istio-proxy"
Jul 31 02:15:35.952131 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:35.952086    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="27eacf7d-ff93-409d-8cea-10a0e3842d66" containerName="istio-proxy"
Jul 31 02:15:35.952321 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:35.952156    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="27eacf7d-ff93-409d-8cea-10a0e3842d66" containerName="istio-proxy"
Jul 31 02:15:35.952321 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:35.952163    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="27eacf7d-ff93-409d-8cea-10a0e3842d66" containerName="istio-proxy"
Jul 31 02:15:35.952321 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:35.952169    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab3075f7-f214-4ee8-9283-2bf7dd3c4247" containerName="istio-proxy"
Jul 31 02:15:35.952321 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:35.952175    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab3075f7-f214-4ee8-9283-2bf7dd3c4247" containerName="istio-proxy"
Jul 31 02:15:35.955142 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:35.955126    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:35.957779 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:35.957762    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f714090a-openshift-default-dockercfg-2959l\""
Jul 31 02:15:35.965935 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:35.965888    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"]
Jul 31 02:15:35.987753 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:35.987727    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wvtj\" (UniqueName: \"kubernetes.io/projected/1fb577f7-c44e-4abf-948f-ea0de876c527-kube-api-access-4wvtj\") pod \"e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") " pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:35.987954 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:35.987829    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fb577f7-c44e-4abf-948f-ea0de876c527-istiod-ca-cert\") pod \"e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") " pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:35.987954 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:35.987860    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-credential-socket\") pod \"e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") " pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:35.987954 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:35.987884    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-workload-socket\") pod \"e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") " pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:35.987954 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:35.987924    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-workload-certs\") pod \"e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") " pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:35.987954 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:35.987948    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-istio-data\") pod \"e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") " pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:35.988260 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:35.988001    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fb577f7-c44e-4abf-948f-ea0de876c527-istio-token\") pod \"e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") " pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:35.988260 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:35.988022    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-istio-envoy\") pod \"e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") " pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:35.988260 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:35.988053    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fb577f7-c44e-4abf-948f-ea0de876c527-istio-podinfo\") pod \"e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") " pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:36.089239 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:36.089201    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fb577f7-c44e-4abf-948f-ea0de876c527-istiod-ca-cert\") pod \"e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") " pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:36.089239 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:36.089243    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-credential-socket\") pod \"e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") " pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:36.089494 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:36.089263    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-workload-socket\") pod \"e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") " pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:36.089494 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:36.089281    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-workload-certs\") pod \"e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") " pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:36.089494 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:36.089393    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-istio-data\") pod \"e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") " pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:36.089494 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:36.089466    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fb577f7-c44e-4abf-948f-ea0de876c527-istio-token\") pod \"e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") " pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:36.089730 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:36.089498    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-istio-envoy\") pod \"e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") " pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:36.089730 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:36.089542    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fb577f7-c44e-4abf-948f-ea0de876c527-istio-podinfo\") pod \"e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") " pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:36.089730 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:36.089587    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wvtj\" (UniqueName: \"kubernetes.io/projected/1fb577f7-c44e-4abf-948f-ea0de876c527-kube-api-access-4wvtj\") pod \"e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") " pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:36.089730 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:36.089623    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-workload-certs\") pod \"e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") " pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:36.089937 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:36.089727    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-workload-socket\") pod \"e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") " pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:36.089937 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:36.089793    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-istio-data\") pod \"e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") " pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:36.090061 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:36.089981    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-credential-socket\") pod \"e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") " pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:36.090061 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:36.090027    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fb577f7-c44e-4abf-948f-ea0de876c527-istiod-ca-cert\") pod \"e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") " pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:36.091826 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:36.091808    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-istio-envoy\") pod \"e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") " pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:36.092041 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:36.092021    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fb577f7-c44e-4abf-948f-ea0de876c527-istio-podinfo\") pod \"e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") " pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:36.098340 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:36.098317    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wvtj\" (UniqueName: \"kubernetes.io/projected/1fb577f7-c44e-4abf-948f-ea0de876c527-kube-api-access-4wvtj\") pod \"e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") " pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:36.098458 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:36.098438    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fb577f7-c44e-4abf-948f-ea0de876c527-istio-token\") pod \"e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") " pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:36.266849 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:36.266759    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:36.410854 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:36.410823    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"]
Jul 31 02:15:36.412306 ip-10-0-133-91 kubenswrapper[2571]: W0731 02:15:36.412278    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fb577f7_c44e_4abf_948f_ea0de876c527.slice/crio-a564ce0e573b975c5f27731018db9ee06fbde7cca92f69d1a16483d16981e340 WatchSource:0}: Error finding container a564ce0e573b975c5f27731018db9ee06fbde7cca92f69d1a16483d16981e340: Status 404 returned error can't find the container with id a564ce0e573b975c5f27731018db9ee06fbde7cca92f69d1a16483d16981e340
Jul 31 02:15:36.414450 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:36.414417    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:15:36.414540 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:36.414487    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:15:36.414540 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:36.414512    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:15:36.466443 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:36.466405    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5" event={"ID":"1fb577f7-c44e-4abf-948f-ea0de876c527","Type":"ContainerStarted","Data":"a564ce0e573b975c5f27731018db9ee06fbde7cca92f69d1a16483d16981e340"}
Jul 31 02:15:37.475005 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:37.474964    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5" event={"ID":"1fb577f7-c44e-4abf-948f-ea0de876c527","Type":"ContainerStarted","Data":"6aec4df64766d5142e0c2a3ed231592c7808e4e212075b63b2a6c7a89ca0c09e"}
Jul 31 02:15:37.496369 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:37.496319    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5" podStartSLOduration=2.496304865 podStartE2EDuration="2.496304865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:15:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:15:37.494051346 +0000 UTC m=+2298.074292341" watchObservedRunningTime="2026-07-31 02:15:37.496304865 +0000 UTC m=+2298.076545924"
Jul 31 02:15:38.267517 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:38.267485    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:38.272952 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:38.272928    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:38.480305 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:38.480267    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:38.481298 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:38.481280    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:53.482268 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:53.482227    2571 patch_prober.go:28] interesting pod/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 31 02:15:53.482715 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:53.482296    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5" podUID="1fb577f7-c44e-4abf-948f-ea0de876c527" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 31 02:15:53.566956 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:53.566922    2571 generic.go:356] "Generic (PLEG): container finished" podID="1fb577f7-c44e-4abf-948f-ea0de876c527" containerID="6aec4df64766d5142e0c2a3ed231592c7808e4e212075b63b2a6c7a89ca0c09e" exitCode=0
Jul 31 02:15:53.567153 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:53.566996    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5" event={"ID":"1fb577f7-c44e-4abf-948f-ea0de876c527","Type":"ContainerDied","Data":"6aec4df64766d5142e0c2a3ed231592c7808e4e212075b63b2a6c7a89ca0c09e"}
Jul 31 02:15:53.567448 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:53.567431    2571 scope.go:117] "RemoveContainer" containerID="6aec4df64766d5142e0c2a3ed231592c7808e4e212075b63b2a6c7a89ca0c09e"
Jul 31 02:15:53.568426 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:53.568402    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:15:53.568488 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:53.568471    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:15:53.568524 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:53.568507    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:15:54.573675 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:54.573638    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5" event={"ID":"1fb577f7-c44e-4abf-948f-ea0de876c527","Type":"ContainerStarted","Data":"421c25dc9712d6afda861b2c883cf990cacf34590b3daca1ce0ffd4045e12651"}
Jul 31 02:15:55.267910 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:55.267873    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:15:55.268153 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:55.268131    2571 patch_prober.go:28] interesting pod/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 31 02:15:55.268212 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:55.268193    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5" podUID="1fb577f7-c44e-4abf-948f-ea0de876c527" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 31 02:15:56.267561 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:56.267520    2571 patch_prober.go:28] interesting pod/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 31 02:15:56.268004 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:56.267577    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5" podUID="1fb577f7-c44e-4abf-948f-ea0de876c527" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 31 02:15:57.267336 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:57.267298    2571 patch_prober.go:28] interesting pod/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 31 02:15:57.267530 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:57.267361    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5" podUID="1fb577f7-c44e-4abf-948f-ea0de876c527" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 31 02:15:58.267262 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:58.267223    2571 patch_prober.go:28] interesting pod/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 31 02:15:58.267767 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:58.267287    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5" podUID="1fb577f7-c44e-4abf-948f-ea0de876c527" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 31 02:15:59.267431 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:59.267394    2571 patch_prober.go:28] interesting pod/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 31 02:15:59.267857 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:15:59.267452    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5" podUID="1fb577f7-c44e-4abf-948f-ea0de876c527" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 31 02:16:00.271553 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:00.271524    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:16:00.271966 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:00.271795    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:16:00.272421 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:00.272402    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:16:28.792757 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:28.792716    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"]
Jul 31 02:16:28.793296 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:28.793014    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5" podUID="1fb577f7-c44e-4abf-948f-ea0de876c527" containerName="istio-proxy" containerID="cri-o://421c25dc9712d6afda861b2c883cf990cacf34590b3daca1ce0ffd4045e12651" gracePeriod=30
Jul 31 02:16:30.274729 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:30.274688    2571 patch_prober.go:28] interesting pod/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 31 02:16:30.275153 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:30.274738    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5" podUID="1fb577f7-c44e-4abf-948f-ea0de876c527" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 02:16:34.053585 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.053561    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:16:34.172140 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.172111    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fb577f7-c44e-4abf-948f-ea0de876c527-istio-podinfo\") pod \"1fb577f7-c44e-4abf-948f-ea0de876c527\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") "
Jul 31 02:16:34.172140 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.172146    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fb577f7-c44e-4abf-948f-ea0de876c527-istiod-ca-cert\") pod \"1fb577f7-c44e-4abf-948f-ea0de876c527\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") "
Jul 31 02:16:34.172402 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.172180    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wvtj\" (UniqueName: \"kubernetes.io/projected/1fb577f7-c44e-4abf-948f-ea0de876c527-kube-api-access-4wvtj\") pod \"1fb577f7-c44e-4abf-948f-ea0de876c527\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") "
Jul 31 02:16:34.172402 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.172204    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-istio-data\") pod \"1fb577f7-c44e-4abf-948f-ea0de876c527\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") "
Jul 31 02:16:34.172402 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.172243    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-workload-socket\") pod \"1fb577f7-c44e-4abf-948f-ea0de876c527\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") "
Jul 31 02:16:34.172402 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.172274    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-credential-socket\") pod \"1fb577f7-c44e-4abf-948f-ea0de876c527\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") "
Jul 31 02:16:34.172402 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.172315    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fb577f7-c44e-4abf-948f-ea0de876c527-istio-token\") pod \"1fb577f7-c44e-4abf-948f-ea0de876c527\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") "
Jul 31 02:16:34.172402 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.172360    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-workload-certs\") pod \"1fb577f7-c44e-4abf-948f-ea0de876c527\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") "
Jul 31 02:16:34.172402 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.172393    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-istio-envoy\") pod \"1fb577f7-c44e-4abf-948f-ea0de876c527\" (UID: \"1fb577f7-c44e-4abf-948f-ea0de876c527\") "
Jul 31 02:16:34.172753 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.172527    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-istio-data" (OuterVolumeSpecName: "istio-data") pod "1fb577f7-c44e-4abf-948f-ea0de876c527" (UID: "1fb577f7-c44e-4abf-948f-ea0de876c527"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:16:34.172753 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.172609    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1fb577f7-c44e-4abf-948f-ea0de876c527" (UID: "1fb577f7-c44e-4abf-948f-ea0de876c527"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:16:34.172753 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.172641    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fb577f7-c44e-4abf-948f-ea0de876c527-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1fb577f7-c44e-4abf-948f-ea0de876c527" (UID: "1fb577f7-c44e-4abf-948f-ea0de876c527"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 02:16:34.172910 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.172793    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1fb577f7-c44e-4abf-948f-ea0de876c527" (UID: "1fb577f7-c44e-4abf-948f-ea0de876c527"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:16:34.172910 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.172831    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fb577f7-c44e-4abf-948f-ea0de876c527-istiod-ca-cert\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:16:34.172910 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.172837    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1fb577f7-c44e-4abf-948f-ea0de876c527" (UID: "1fb577f7-c44e-4abf-948f-ea0de876c527"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:16:34.172910 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.172850    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-istio-data\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:16:34.172910 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.172881    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-workload-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:16:34.174426 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.174406    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fb577f7-c44e-4abf-948f-ea0de876c527-kube-api-access-4wvtj" (OuterVolumeSpecName: "kube-api-access-4wvtj") pod "1fb577f7-c44e-4abf-948f-ea0de876c527" (UID: "1fb577f7-c44e-4abf-948f-ea0de876c527"). InnerVolumeSpecName "kube-api-access-4wvtj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:16:34.174426 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.174412    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1fb577f7-c44e-4abf-948f-ea0de876c527-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1fb577f7-c44e-4abf-948f-ea0de876c527" (UID: "1fb577f7-c44e-4abf-948f-ea0de876c527"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 02:16:34.174835 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.174819    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1fb577f7-c44e-4abf-948f-ea0de876c527" (UID: "1fb577f7-c44e-4abf-948f-ea0de876c527"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:16:34.174914 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.174852    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fb577f7-c44e-4abf-948f-ea0de876c527-istio-token" (OuterVolumeSpecName: "istio-token") pod "1fb577f7-c44e-4abf-948f-ea0de876c527" (UID: "1fb577f7-c44e-4abf-948f-ea0de876c527"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:16:34.273581 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.273545    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-credential-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:16:34.273581 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.273574    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fb577f7-c44e-4abf-948f-ea0de876c527-istio-token\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:16:34.273581 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.273584    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-workload-certs\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:16:34.273581 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.273591    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fb577f7-c44e-4abf-948f-ea0de876c527-istio-envoy\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:16:34.273878 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.273598    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fb577f7-c44e-4abf-948f-ea0de876c527-istio-podinfo\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:16:34.273878 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.273606    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wvtj\" (UniqueName: \"kubernetes.io/projected/1fb577f7-c44e-4abf-948f-ea0de876c527-kube-api-access-4wvtj\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:16:34.788905 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.788870    2571 generic.go:356] "Generic (PLEG): container finished" podID="1fb577f7-c44e-4abf-948f-ea0de876c527" containerID="421c25dc9712d6afda861b2c883cf990cacf34590b3daca1ce0ffd4045e12651" exitCode=0
Jul 31 02:16:34.789104 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.788944    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"
Jul 31 02:16:34.789104 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.788950    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5" event={"ID":"1fb577f7-c44e-4abf-948f-ea0de876c527","Type":"ContainerDied","Data":"421c25dc9712d6afda861b2c883cf990cacf34590b3daca1ce0ffd4045e12651"}
Jul 31 02:16:34.789104 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.789033    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5" event={"ID":"1fb577f7-c44e-4abf-948f-ea0de876c527","Type":"ContainerDied","Data":"a564ce0e573b975c5f27731018db9ee06fbde7cca92f69d1a16483d16981e340"}
Jul 31 02:16:34.789104 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.789063    2571 scope.go:117] "RemoveContainer" containerID="421c25dc9712d6afda861b2c883cf990cacf34590b3daca1ce0ffd4045e12651"
Jul 31 02:16:34.798333 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.798317    2571 scope.go:117] "RemoveContainer" containerID="6aec4df64766d5142e0c2a3ed231592c7808e4e212075b63b2a6c7a89ca0c09e"
Jul 31 02:16:34.806066 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.806052    2571 scope.go:117] "RemoveContainer" containerID="421c25dc9712d6afda861b2c883cf990cacf34590b3daca1ce0ffd4045e12651"
Jul 31 02:16:34.806310 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:16:34.806292    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"421c25dc9712d6afda861b2c883cf990cacf34590b3daca1ce0ffd4045e12651\": container with ID starting with 421c25dc9712d6afda861b2c883cf990cacf34590b3daca1ce0ffd4045e12651 not found: ID does not exist" containerID="421c25dc9712d6afda861b2c883cf990cacf34590b3daca1ce0ffd4045e12651"
Jul 31 02:16:34.806356 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.806318    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"421c25dc9712d6afda861b2c883cf990cacf34590b3daca1ce0ffd4045e12651"} err="failed to get container status \"421c25dc9712d6afda861b2c883cf990cacf34590b3daca1ce0ffd4045e12651\": rpc error: code = NotFound desc = could not find container \"421c25dc9712d6afda861b2c883cf990cacf34590b3daca1ce0ffd4045e12651\": container with ID starting with 421c25dc9712d6afda861b2c883cf990cacf34590b3daca1ce0ffd4045e12651 not found: ID does not exist"
Jul 31 02:16:34.806356 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.806334    2571 scope.go:117] "RemoveContainer" containerID="6aec4df64766d5142e0c2a3ed231592c7808e4e212075b63b2a6c7a89ca0c09e"
Jul 31 02:16:34.806579 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:16:34.806558    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6aec4df64766d5142e0c2a3ed231592c7808e4e212075b63b2a6c7a89ca0c09e\": container with ID starting with 6aec4df64766d5142e0c2a3ed231592c7808e4e212075b63b2a6c7a89ca0c09e not found: ID does not exist" containerID="6aec4df64766d5142e0c2a3ed231592c7808e4e212075b63b2a6c7a89ca0c09e"
Jul 31 02:16:34.806618 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.806587    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aec4df64766d5142e0c2a3ed231592c7808e4e212075b63b2a6c7a89ca0c09e"} err="failed to get container status \"6aec4df64766d5142e0c2a3ed231592c7808e4e212075b63b2a6c7a89ca0c09e\": rpc error: code = NotFound desc = could not find container \"6aec4df64766d5142e0c2a3ed231592c7808e4e212075b63b2a6c7a89ca0c09e\": container with ID starting with 6aec4df64766d5142e0c2a3ed231592c7808e4e212075b63b2a6c7a89ca0c09e not found: ID does not exist"
Jul 31 02:16:34.810476 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.810456    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"]
Jul 31 02:16:34.814567 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:34.814547    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f714090a-openshift-default-54b4f58684-ssrr5"]
Jul 31 02:16:35.992767 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:16:35.992738    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fb577f7-c44e-4abf-948f-ea0de876c527" path="/var/lib/kubelet/pods/1fb577f7-c44e-4abf-948f-ea0de876c527/volumes"
Jul 31 02:17:09.403101 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:17:09.403066    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-rdphb"]
Jul 31 02:17:09.403723 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:17:09.403333    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-rdphb" podUID="ae2e8940-f602-4e4d-9901-fdd19e4c2f3e" containerName="manager" containerID="cri-o://f19e1e512236d4ef9e32616375f37812147f3b634a8b5907c09d6ae075d76937" gracePeriod=10
Jul 31 02:17:09.659456 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:17:09.659393    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-rdphb"
Jul 31 02:17:09.818792 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:17:09.818751    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae2e8940-f602-4e4d-9901-fdd19e4c2f3e-extensions-socket-volume\") pod \"ae2e8940-f602-4e4d-9901-fdd19e4c2f3e\" (UID: \"ae2e8940-f602-4e4d-9901-fdd19e4c2f3e\") "
Jul 31 02:17:09.818999 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:17:09.818802    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tg6lb\" (UniqueName: \"kubernetes.io/projected/ae2e8940-f602-4e4d-9901-fdd19e4c2f3e-kube-api-access-tg6lb\") pod \"ae2e8940-f602-4e4d-9901-fdd19e4c2f3e\" (UID: \"ae2e8940-f602-4e4d-9901-fdd19e4c2f3e\") "
Jul 31 02:17:09.819157 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:17:09.819134    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae2e8940-f602-4e4d-9901-fdd19e4c2f3e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ae2e8940-f602-4e4d-9901-fdd19e4c2f3e" (UID: "ae2e8940-f602-4e4d-9901-fdd19e4c2f3e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:17:09.820886 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:17:09.820857    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae2e8940-f602-4e4d-9901-fdd19e4c2f3e-kube-api-access-tg6lb" (OuterVolumeSpecName: "kube-api-access-tg6lb") pod "ae2e8940-f602-4e4d-9901-fdd19e4c2f3e" (UID: "ae2e8940-f602-4e4d-9901-fdd19e4c2f3e"). InnerVolumeSpecName "kube-api-access-tg6lb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:17:09.919783 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:17:09.919702    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae2e8940-f602-4e4d-9901-fdd19e4c2f3e-extensions-socket-volume\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:17:09.919783 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:17:09.919728    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tg6lb\" (UniqueName: \"kubernetes.io/projected/ae2e8940-f602-4e4d-9901-fdd19e4c2f3e-kube-api-access-tg6lb\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:17:09.972825 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:17:09.972794    2571 generic.go:356] "Generic (PLEG): container finished" podID="ae2e8940-f602-4e4d-9901-fdd19e4c2f3e" containerID="f19e1e512236d4ef9e32616375f37812147f3b634a8b5907c09d6ae075d76937" exitCode=0
Jul 31 02:17:09.972992 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:17:09.972837    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-rdphb"
Jul 31 02:17:09.972992 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:17:09.972878    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-rdphb" event={"ID":"ae2e8940-f602-4e4d-9901-fdd19e4c2f3e","Type":"ContainerDied","Data":"f19e1e512236d4ef9e32616375f37812147f3b634a8b5907c09d6ae075d76937"}
Jul 31 02:17:09.972992 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:17:09.972952    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-rdphb" event={"ID":"ae2e8940-f602-4e4d-9901-fdd19e4c2f3e","Type":"ContainerDied","Data":"8c7a9fdafcc1559342fa81306650b2c20a857637a27872566e25325a914d8316"}
Jul 31 02:17:09.972992 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:17:09.972979    2571 scope.go:117] "RemoveContainer" containerID="f19e1e512236d4ef9e32616375f37812147f3b634a8b5907c09d6ae075d76937"
Jul 31 02:17:09.984004 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:17:09.983986    2571 scope.go:117] "RemoveContainer" containerID="f19e1e512236d4ef9e32616375f37812147f3b634a8b5907c09d6ae075d76937"
Jul 31 02:17:09.984345 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:17:09.984296    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f19e1e512236d4ef9e32616375f37812147f3b634a8b5907c09d6ae075d76937\": container with ID starting with f19e1e512236d4ef9e32616375f37812147f3b634a8b5907c09d6ae075d76937 not found: ID does not exist" containerID="f19e1e512236d4ef9e32616375f37812147f3b634a8b5907c09d6ae075d76937"
Jul 31 02:17:09.984426 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:17:09.984356    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f19e1e512236d4ef9e32616375f37812147f3b634a8b5907c09d6ae075d76937"} err="failed to get container status \"f19e1e512236d4ef9e32616375f37812147f3b634a8b5907c09d6ae075d76937\": rpc error: code = NotFound desc = could not find container \"f19e1e512236d4ef9e32616375f37812147f3b634a8b5907c09d6ae075d76937\": container with ID starting with f19e1e512236d4ef9e32616375f37812147f3b634a8b5907c09d6ae075d76937 not found: ID does not exist"
Jul 31 02:17:09.995520 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:17:09.995496    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-rdphb"]
Jul 31 02:17:09.998677 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:17:09.998656    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-rdphb"]
Jul 31 02:17:11.993000 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:17:11.992954    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae2e8940-f602-4e4d-9901-fdd19e4c2f3e" path="/var/lib/kubelet/pods/ae2e8940-f602-4e4d-9901-fdd19e4c2f3e/volumes"
Jul 31 02:18:25.030687 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:25.030652    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vqdzw"]
Jul 31 02:18:25.031206 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:25.031072    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab3075f7-f214-4ee8-9283-2bf7dd3c4247" containerName="istio-proxy"
Jul 31 02:18:25.031206 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:25.031083    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab3075f7-f214-4ee8-9283-2bf7dd3c4247" containerName="istio-proxy"
Jul 31 02:18:25.031206 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:25.031098    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fb577f7-c44e-4abf-948f-ea0de876c527" containerName="istio-proxy"
Jul 31 02:18:25.031206 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:25.031103    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fb577f7-c44e-4abf-948f-ea0de876c527" containerName="istio-proxy"
Jul 31 02:18:25.031206 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:25.031115    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fb577f7-c44e-4abf-948f-ea0de876c527" containerName="istio-proxy"
Jul 31 02:18:25.031206 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:25.031122    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fb577f7-c44e-4abf-948f-ea0de876c527" containerName="istio-proxy"
Jul 31 02:18:25.031206 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:25.031132    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae2e8940-f602-4e4d-9901-fdd19e4c2f3e" containerName="manager"
Jul 31 02:18:25.031206 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:25.031137    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae2e8940-f602-4e4d-9901-fdd19e4c2f3e" containerName="manager"
Jul 31 02:18:25.031206 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:25.031192    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae2e8940-f602-4e4d-9901-fdd19e4c2f3e" containerName="manager"
Jul 31 02:18:25.031206 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:25.031200    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fb577f7-c44e-4abf-948f-ea0de876c527" containerName="istio-proxy"
Jul 31 02:18:25.031206 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:25.031210    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fb577f7-c44e-4abf-948f-ea0de876c527" containerName="istio-proxy"
Jul 31 02:18:25.034269 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:25.034254    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vqdzw"
Jul 31 02:18:25.037169 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:25.037150    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-n5crf\""
Jul 31 02:18:25.044582 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:25.044562    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vqdzw"]
Jul 31 02:18:25.149685 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:25.149648    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0efdc495-8e17-4fe0-9d3c-75a8713c55fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-vqdzw\" (UID: \"0efdc495-8e17-4fe0-9d3c-75a8713c55fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vqdzw"
Jul 31 02:18:25.149881 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:25.149699    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbzmg\" (UniqueName: \"kubernetes.io/projected/0efdc495-8e17-4fe0-9d3c-75a8713c55fe-kube-api-access-xbzmg\") pod \"kuadrant-operator-controller-manager-68cf589589-vqdzw\" (UID: \"0efdc495-8e17-4fe0-9d3c-75a8713c55fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vqdzw"
Jul 31 02:18:25.251250 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:25.251210    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0efdc495-8e17-4fe0-9d3c-75a8713c55fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-vqdzw\" (UID: \"0efdc495-8e17-4fe0-9d3c-75a8713c55fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vqdzw"
Jul 31 02:18:25.251453 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:25.251267    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbzmg\" (UniqueName: \"kubernetes.io/projected/0efdc495-8e17-4fe0-9d3c-75a8713c55fe-kube-api-access-xbzmg\") pod \"kuadrant-operator-controller-manager-68cf589589-vqdzw\" (UID: \"0efdc495-8e17-4fe0-9d3c-75a8713c55fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vqdzw"
Jul 31 02:18:25.251615 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:25.251589    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0efdc495-8e17-4fe0-9d3c-75a8713c55fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-vqdzw\" (UID: \"0efdc495-8e17-4fe0-9d3c-75a8713c55fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vqdzw"
Jul 31 02:18:25.266340 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:25.266314    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbzmg\" (UniqueName: \"kubernetes.io/projected/0efdc495-8e17-4fe0-9d3c-75a8713c55fe-kube-api-access-xbzmg\") pod \"kuadrant-operator-controller-manager-68cf589589-vqdzw\" (UID: \"0efdc495-8e17-4fe0-9d3c-75a8713c55fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vqdzw"
Jul 31 02:18:25.345328 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:25.345303    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vqdzw"
Jul 31 02:18:25.491487 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:25.491464    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vqdzw"]
Jul 31 02:18:25.493987 ip-10-0-133-91 kubenswrapper[2571]: W0731 02:18:25.493956    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0efdc495_8e17_4fe0_9d3c_75a8713c55fe.slice/crio-be67fbbe2a46707fdb7638570c1b2ff0ffa24087a34222300e74912ec8d0d7c7 WatchSource:0}: Error finding container be67fbbe2a46707fdb7638570c1b2ff0ffa24087a34222300e74912ec8d0d7c7: Status 404 returned error can't find the container with id be67fbbe2a46707fdb7638570c1b2ff0ffa24087a34222300e74912ec8d0d7c7
Jul 31 02:18:26.373708 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:26.373667    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vqdzw" event={"ID":"0efdc495-8e17-4fe0-9d3c-75a8713c55fe","Type":"ContainerStarted","Data":"d0b390b940e0e803647df318a0037b3dac3f3f4c1a96dd8b24a23eb850c2b15d"}
Jul 31 02:18:26.374119 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:26.373761    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vqdzw" event={"ID":"0efdc495-8e17-4fe0-9d3c-75a8713c55fe","Type":"ContainerStarted","Data":"be67fbbe2a46707fdb7638570c1b2ff0ffa24087a34222300e74912ec8d0d7c7"}
Jul 31 02:18:26.374119 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:26.373814    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vqdzw"
Jul 31 02:18:26.394739 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:26.394693    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vqdzw" podStartSLOduration=1.3946808370000001 podStartE2EDuration="1.394680837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:18:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:18:26.39309179 +0000 UTC m=+2466.973332801" watchObservedRunningTime="2026-07-31 02:18:26.394680837 +0000 UTC m=+2466.974921832"
Jul 31 02:18:37.381932 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:37.381877    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-vqdzw"
Jul 31 02:18:44.221244 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.221214    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"]
Jul 31 02:18:44.224852 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.224832    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.228726 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.228707    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a1d99bab-openshift-default-dockercfg-l474s\""
Jul 31 02:18:44.243926 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.243880    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istio-data\") pod \"e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") " pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.244062 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.243977    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74mhp\" (UniqueName: \"kubernetes.io/projected/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-kube-api-access-74mhp\") pod \"e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") " pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.244062 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.244010    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istiod-ca-cert\") pod \"e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") " pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.244062 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.244056    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-credential-socket\") pod \"e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") " pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.244241 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.244086    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-workload-certs\") pod \"e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") " pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.244400 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.244373    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-workload-socket\") pod \"e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") " pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.244625 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.244448    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istio-token\") pod \"e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") " pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.244625 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.244501    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istio-envoy\") pod \"e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") " pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.244625 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.244524    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istio-podinfo\") pod \"e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") " pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.248554 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.248531    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"]
Jul 31 02:18:44.345665 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.345628    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istio-token\") pod \"e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") " pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.345857 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.345684    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istio-envoy\") pod \"e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") " pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.345857 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.345715    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istio-podinfo\") pod \"e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") " pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.345857 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.345748    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istio-data\") pod \"e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") " pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.346122 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.346093    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74mhp\" (UniqueName: \"kubernetes.io/projected/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-kube-api-access-74mhp\") pod \"e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") " pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.346205 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.346147    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istio-data\") pod \"e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") " pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.346270 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.346210    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istiod-ca-cert\") pod \"e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") " pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.346342 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.346288    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-credential-socket\") pod \"e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") " pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.346342 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.346324    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-workload-certs\") pod \"e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") " pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.346457 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.346408    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-workload-socket\") pod \"e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") " pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.346651 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.346619    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-credential-socket\") pod \"e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") " pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.346746 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.346728    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-workload-socket\") pod \"e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") " pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.346912 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.346873    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-workload-certs\") pod \"e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") " pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.347003 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.346980    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istiod-ca-cert\") pod \"e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") " pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.348246 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.348225    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istio-envoy\") pod \"e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") " pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.348954 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.348936    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istio-podinfo\") pod \"e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") " pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.353882 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.353849    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74mhp\" (UniqueName: \"kubernetes.io/projected/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-kube-api-access-74mhp\") pod \"e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") " pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.354266 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.354250    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istio-token\") pod \"e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") " pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.535015 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.534924    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:44.685105 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.685079    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"]
Jul 31 02:18:44.686546 ip-10-0-133-91 kubenswrapper[2571]: W0731 02:18:44.686504    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7a00642_0d88_4230_913b_5fe9ee4bbbb1.slice/crio-bac05e0910a5789575c87752dec867a4e20e2278b5656d8ce2370471c82ecbe6 WatchSource:0}: Error finding container bac05e0910a5789575c87752dec867a4e20e2278b5656d8ce2370471c82ecbe6: Status 404 returned error can't find the container with id bac05e0910a5789575c87752dec867a4e20e2278b5656d8ce2370471c82ecbe6
Jul 31 02:18:44.688823 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.688783    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:18:44.688950 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.688875    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:18:44.688950 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:44.688936    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:18:45.474943 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:45.474879    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w" event={"ID":"c7a00642-0d88-4230-913b-5fe9ee4bbbb1","Type":"ContainerStarted","Data":"14247b71d8af5ad0240d5186cd69b5c1ecb716f67a84dd0ad9de4be3f49e6e35"}
Jul 31 02:18:45.475401 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:45.474990    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w" event={"ID":"c7a00642-0d88-4230-913b-5fe9ee4bbbb1","Type":"ContainerStarted","Data":"bac05e0910a5789575c87752dec867a4e20e2278b5656d8ce2370471c82ecbe6"}
Jul 31 02:18:45.495254 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:45.495197    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w" podStartSLOduration=1.495180681 podStartE2EDuration="1.495180681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:18:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:18:45.493479026 +0000 UTC m=+2486.073720023" watchObservedRunningTime="2026-07-31 02:18:45.495180681 +0000 UTC m=+2486.075421676"
Jul 31 02:18:45.535477 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:45.535439    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:45.537176 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:45.537147    2571 patch_prober.go:28] interesting pod/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 31 02:18:45.537331 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:45.537203    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w" podUID="c7a00642-0d88-4230-913b-5fe9ee4bbbb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 31 02:18:46.540396 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:46.540361    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:47.485236 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:47.485197    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:18:47.486276 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:18:47.486251    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:19:01.564997 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:19:01.564962    2571 generic.go:356] "Generic (PLEG): container finished" podID="c7a00642-0d88-4230-913b-5fe9ee4bbbb1" containerID="14247b71d8af5ad0240d5186cd69b5c1ecb716f67a84dd0ad9de4be3f49e6e35" exitCode=0
Jul 31 02:19:01.565434 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:19:01.565035    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w" event={"ID":"c7a00642-0d88-4230-913b-5fe9ee4bbbb1","Type":"ContainerDied","Data":"14247b71d8af5ad0240d5186cd69b5c1ecb716f67a84dd0ad9de4be3f49e6e35"}
Jul 31 02:19:01.565483 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:19:01.565434    2571 scope.go:117] "RemoveContainer" containerID="14247b71d8af5ad0240d5186cd69b5c1ecb716f67a84dd0ad9de4be3f49e6e35"
Jul 31 02:19:01.566509 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:19:01.566486    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:19:01.566571 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:19:01.566550    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:19:01.566607 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:19:01.566582    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:19:02.486107 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:19:02.486072    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:19:02.571796 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:19:02.571758    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w" event={"ID":"c7a00642-0d88-4230-913b-5fe9ee4bbbb1","Type":"ContainerStarted","Data":"3c0effc6c7a292ed90a836f5e5a34401268ea0f727011574568e1898353edb7d"}
Jul 31 02:19:03.535478 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:19:03.535438    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:19:03.536683 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:19:03.536641    2571 patch_prober.go:28] interesting pod/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 31 02:19:03.536850 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:19:03.536705    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w" podUID="c7a00642-0d88-4230-913b-5fe9ee4bbbb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 31 02:19:04.536024 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:19:04.535977    2571 patch_prober.go:28] interesting pod/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 31 02:19:04.536546 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:19:04.536072    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w" podUID="c7a00642-0d88-4230-913b-5fe9ee4bbbb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 31 02:19:05.535989 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:19:05.535948    2571 patch_prober.go:28] interesting pod/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 31 02:19:05.536303 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:19:05.536274    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w" podUID="c7a00642-0d88-4230-913b-5fe9ee4bbbb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 31 02:19:06.535976 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:19:06.535937    2571 patch_prober.go:28] interesting pod/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 31 02:19:06.536198 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:19:06.536022    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w" podUID="c7a00642-0d88-4230-913b-5fe9ee4bbbb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 31 02:19:07.536257 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:19:07.536222    2571 patch_prober.go:28] interesting pod/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 31 02:19:07.536857 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:19:07.536823    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w" podUID="c7a00642-0d88-4230-913b-5fe9ee4bbbb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 31 02:19:08.539503 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:19:08.539469    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:19:08.539937 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:19:08.539850    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:19:08.540494 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:19:08.540475    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:20:48.435511 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:48.435412    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"]
Jul 31 02:20:48.436115 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:48.435684    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w" podUID="c7a00642-0d88-4230-913b-5fe9ee4bbbb1" containerName="istio-proxy" containerID="cri-o://3c0effc6c7a292ed90a836f5e5a34401268ea0f727011574568e1898353edb7d" gracePeriod=30
Jul 31 02:20:53.541747 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.541708    2571 patch_prober.go:28] interesting pod/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 31 02:20:53.542259 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.541766    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w" podUID="c7a00642-0d88-4230-913b-5fe9ee4bbbb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 31 02:20:53.699284 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.699223    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:20:53.873979 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.873945    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-credential-socket\") pod \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") "
Jul 31 02:20:53.874176 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.873991    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istio-envoy\") pod \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") "
Jul 31 02:20:53.874176 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.874061    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istio-data\") pod \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") "
Jul 31 02:20:53.874176 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.874123    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-workload-socket\") pod \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") "
Jul 31 02:20:53.874176 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.874169    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istiod-ca-cert\") pod \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") "
Jul 31 02:20:53.874400 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.874206    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istio-token\") pod \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") "
Jul 31 02:20:53.874400 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.874249    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-workload-certs\") pod \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") "
Jul 31 02:20:53.874400 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.874285    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74mhp\" (UniqueName: \"kubernetes.io/projected/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-kube-api-access-74mhp\") pod \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") "
Jul 31 02:20:53.874400 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.874282    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c7a00642-0d88-4230-913b-5fe9ee4bbbb1" (UID: "c7a00642-0d88-4230-913b-5fe9ee4bbbb1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:20:53.874400 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.874309    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istio-podinfo\") pod \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\" (UID: \"c7a00642-0d88-4230-913b-5fe9ee4bbbb1\") "
Jul 31 02:20:53.874400 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.874353    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c7a00642-0d88-4230-913b-5fe9ee4bbbb1" (UID: "c7a00642-0d88-4230-913b-5fe9ee4bbbb1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:20:53.874400 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.874385    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istio-data" (OuterVolumeSpecName: "istio-data") pod "c7a00642-0d88-4230-913b-5fe9ee4bbbb1" (UID: "c7a00642-0d88-4230-913b-5fe9ee4bbbb1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:20:53.874744 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.874544    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c7a00642-0d88-4230-913b-5fe9ee4bbbb1" (UID: "c7a00642-0d88-4230-913b-5fe9ee4bbbb1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:20:53.874744 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.874622    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c7a00642-0d88-4230-913b-5fe9ee4bbbb1" (UID: "c7a00642-0d88-4230-913b-5fe9ee4bbbb1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 02:20:53.874744 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.874731    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-workload-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:20:53.874867 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.874748    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istiod-ca-cert\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:20:53.874867 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.874761    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-workload-certs\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:20:53.874867 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.874774    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-credential-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:20:53.874867 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.874786    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istio-data\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:20:53.876244 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.876222    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c7a00642-0d88-4230-913b-5fe9ee4bbbb1" (UID: "c7a00642-0d88-4230-913b-5fe9ee4bbbb1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:20:53.876458 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.876435    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istio-token" (OuterVolumeSpecName: "istio-token") pod "c7a00642-0d88-4230-913b-5fe9ee4bbbb1" (UID: "c7a00642-0d88-4230-913b-5fe9ee4bbbb1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:20:53.876733 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.876715    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c7a00642-0d88-4230-913b-5fe9ee4bbbb1" (UID: "c7a00642-0d88-4230-913b-5fe9ee4bbbb1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 02:20:53.876786 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.876735    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-kube-api-access-74mhp" (OuterVolumeSpecName: "kube-api-access-74mhp") pod "c7a00642-0d88-4230-913b-5fe9ee4bbbb1" (UID: "c7a00642-0d88-4230-913b-5fe9ee4bbbb1"). InnerVolumeSpecName "kube-api-access-74mhp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:20:53.976151 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.976069    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istio-token\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:20:53.976151 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.976093    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74mhp\" (UniqueName: \"kubernetes.io/projected/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-kube-api-access-74mhp\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:20:53.976151 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.976103    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istio-podinfo\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:20:53.976151 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:53.976112    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7a00642-0d88-4230-913b-5fe9ee4bbbb1-istio-envoy\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:20:54.163735 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:54.163701    2571 generic.go:356] "Generic (PLEG): container finished" podID="c7a00642-0d88-4230-913b-5fe9ee4bbbb1" containerID="3c0effc6c7a292ed90a836f5e5a34401268ea0f727011574568e1898353edb7d" exitCode=0
Jul 31 02:20:54.163883 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:54.163751    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"
Jul 31 02:20:54.163883 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:54.163788    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w" event={"ID":"c7a00642-0d88-4230-913b-5fe9ee4bbbb1","Type":"ContainerDied","Data":"3c0effc6c7a292ed90a836f5e5a34401268ea0f727011574568e1898353edb7d"}
Jul 31 02:20:54.163883 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:54.163848    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w" event={"ID":"c7a00642-0d88-4230-913b-5fe9ee4bbbb1","Type":"ContainerDied","Data":"bac05e0910a5789575c87752dec867a4e20e2278b5656d8ce2370471c82ecbe6"}
Jul 31 02:20:54.163883 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:54.163879    2571 scope.go:117] "RemoveContainer" containerID="3c0effc6c7a292ed90a836f5e5a34401268ea0f727011574568e1898353edb7d"
Jul 31 02:20:54.173696 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:54.173676    2571 scope.go:117] "RemoveContainer" containerID="14247b71d8af5ad0240d5186cd69b5c1ecb716f67a84dd0ad9de4be3f49e6e35"
Jul 31 02:20:54.183504 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:54.183470    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"]
Jul 31 02:20:54.184140 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:54.184122    2571 scope.go:117] "RemoveContainer" containerID="3c0effc6c7a292ed90a836f5e5a34401268ea0f727011574568e1898353edb7d"
Jul 31 02:20:54.184461 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:20:54.184440    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c0effc6c7a292ed90a836f5e5a34401268ea0f727011574568e1898353edb7d\": container with ID starting with 3c0effc6c7a292ed90a836f5e5a34401268ea0f727011574568e1898353edb7d not found: ID does not exist" containerID="3c0effc6c7a292ed90a836f5e5a34401268ea0f727011574568e1898353edb7d"
Jul 31 02:20:54.184564 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:54.184468    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c0effc6c7a292ed90a836f5e5a34401268ea0f727011574568e1898353edb7d"} err="failed to get container status \"3c0effc6c7a292ed90a836f5e5a34401268ea0f727011574568e1898353edb7d\": rpc error: code = NotFound desc = could not find container \"3c0effc6c7a292ed90a836f5e5a34401268ea0f727011574568e1898353edb7d\": container with ID starting with 3c0effc6c7a292ed90a836f5e5a34401268ea0f727011574568e1898353edb7d not found: ID does not exist"
Jul 31 02:20:54.184564 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:54.184487    2571 scope.go:117] "RemoveContainer" containerID="14247b71d8af5ad0240d5186cd69b5c1ecb716f67a84dd0ad9de4be3f49e6e35"
Jul 31 02:20:54.184754 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:20:54.184736    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14247b71d8af5ad0240d5186cd69b5c1ecb716f67a84dd0ad9de4be3f49e6e35\": container with ID starting with 14247b71d8af5ad0240d5186cd69b5c1ecb716f67a84dd0ad9de4be3f49e6e35 not found: ID does not exist" containerID="14247b71d8af5ad0240d5186cd69b5c1ecb716f67a84dd0ad9de4be3f49e6e35"
Jul 31 02:20:54.184809 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:54.184761    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14247b71d8af5ad0240d5186cd69b5c1ecb716f67a84dd0ad9de4be3f49e6e35"} err="failed to get container status \"14247b71d8af5ad0240d5186cd69b5c1ecb716f67a84dd0ad9de4be3f49e6e35\": rpc error: code = NotFound desc = could not find container \"14247b71d8af5ad0240d5186cd69b5c1ecb716f67a84dd0ad9de4be3f49e6e35\": container with ID starting with 14247b71d8af5ad0240d5186cd69b5c1ecb716f67a84dd0ad9de4be3f49e6e35 not found: ID does not exist"
Jul 31 02:20:54.185789 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:54.185770    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a1d99bab-openshift-default-85c7d84c44-lmw6w"]
Jul 31 02:20:55.992557 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:20:55.992526    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7a00642-0d88-4230-913b-5fe9ee4bbbb1" path="/var/lib/kubelet/pods/c7a00642-0d88-4230-913b-5fe9ee4bbbb1/volumes"
Jul 31 02:21:54.635202 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.635165    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"]
Jul 31 02:21:54.635680 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.635659    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7a00642-0d88-4230-913b-5fe9ee4bbbb1" containerName="istio-proxy"
Jul 31 02:21:54.635680 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.635674    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7a00642-0d88-4230-913b-5fe9ee4bbbb1" containerName="istio-proxy"
Jul 31 02:21:54.635753 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.635689    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7a00642-0d88-4230-913b-5fe9ee4bbbb1" containerName="istio-proxy"
Jul 31 02:21:54.635753 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.635694    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7a00642-0d88-4230-913b-5fe9ee4bbbb1" containerName="istio-proxy"
Jul 31 02:21:54.635817 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.635758    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7a00642-0d88-4230-913b-5fe9ee4bbbb1" containerName="istio-proxy"
Jul 31 02:21:54.635817 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.635766    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7a00642-0d88-4230-913b-5fe9ee4bbbb1" containerName="istio-proxy"
Jul 31 02:21:54.639378 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.639355    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:54.641963 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.641940    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-8af864-openshift-default-dockercfg-r4d2x\""
Jul 31 02:21:54.650104 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.650079    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"]
Jul 31 02:21:54.667067 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.667031    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-workload-certs\") pod \"e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") " pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:54.667067 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.667070    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bvnz\" (UniqueName: \"kubernetes.io/projected/e6f236f7-1b84-4bd5-bb38-77e76926f72b-kube-api-access-2bvnz\") pod \"e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") " pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:54.667318 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.667099    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-workload-socket\") pod \"e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") " pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:54.667318 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.667188    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istio-podinfo\") pod \"e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") " pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:54.667318 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.667219    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istio-token\") pod \"e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") " pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:54.667318 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.667309    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-credential-socket\") pod \"e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") " pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:54.667482 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.667336    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istio-data\") pod \"e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") " pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:54.667482 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.667355    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istiod-ca-cert\") pod \"e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") " pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:54.667482 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.667408    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istio-envoy\") pod \"e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") " pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:54.768852 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.768815    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-workload-certs\") pod \"e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") " pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:54.768852 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.768859    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bvnz\" (UniqueName: \"kubernetes.io/projected/e6f236f7-1b84-4bd5-bb38-77e76926f72b-kube-api-access-2bvnz\") pod \"e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") " pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:54.769150 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.768886    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-workload-socket\") pod \"e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") " pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:54.769150 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.768954    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istio-podinfo\") pod \"e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") " pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:54.769150 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.768978    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istio-token\") pod \"e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") " pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:54.769150 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.769044    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-credential-socket\") pod \"e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") " pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:54.769150 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.769068    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istio-data\") pod \"e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") " pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:54.769150 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.769092    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istiod-ca-cert\") pod \"e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") " pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:54.769150 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.769143    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istio-envoy\") pod \"e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") " pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:54.769471 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.769317    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-workload-certs\") pod \"e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") " pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:54.769471 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.769353    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-workload-socket\") pod \"e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") " pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:54.769471 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.769428    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istio-data\") pod \"e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") " pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:54.769609 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.769484    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-credential-socket\") pod \"e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") " pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:54.769879 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.769861    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istiod-ca-cert\") pod \"e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") " pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:54.771376 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.771356    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istio-envoy\") pod \"e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") " pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:54.771702 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.771681    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istio-podinfo\") pod \"e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") " pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:54.776687 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.776663    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istio-token\") pod \"e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") " pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:54.776876 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.776857    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bvnz\" (UniqueName: \"kubernetes.io/projected/e6f236f7-1b84-4bd5-bb38-77e76926f72b-kube-api-access-2bvnz\") pod \"e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") " pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:54.951919 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:54.951828    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:55.095454 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:55.095433    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"]
Jul 31 02:21:55.096848 ip-10-0-133-91 kubenswrapper[2571]: W0731 02:21:55.096827    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6f236f7_1b84_4bd5_bb38_77e76926f72b.slice/crio-f5c641538d0c777f1815a1d2f42e4e6df9870e276992460480f30a4bd73b1873 WatchSource:0}: Error finding container f5c641538d0c777f1815a1d2f42e4e6df9870e276992460480f30a4bd73b1873: Status 404 returned error can't find the container with id f5c641538d0c777f1815a1d2f42e4e6df9870e276992460480f30a4bd73b1873
Jul 31 02:21:55.099075 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:55.099046    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:21:55.099140 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:55.099108    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:21:55.099140 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:55.099137    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:21:55.496194 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:55.496162    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl" event={"ID":"e6f236f7-1b84-4bd5-bb38-77e76926f72b","Type":"ContainerStarted","Data":"1abdb48d045d888e12b49b1ef3323f734d2f323fb5bef05d2655a9c699c41478"}
Jul 31 02:21:55.496374 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:55.496209    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl" event={"ID":"e6f236f7-1b84-4bd5-bb38-77e76926f72b","Type":"ContainerStarted","Data":"f5c641538d0c777f1815a1d2f42e4e6df9870e276992460480f30a4bd73b1873"}
Jul 31 02:21:55.517137 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:55.517081    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl" podStartSLOduration=1.517061966 podStartE2EDuration="1.517061966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:21:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:21:55.516144267 +0000 UTC m=+2676.096385262" watchObservedRunningTime="2026-07-31 02:21:55.517061966 +0000 UTC m=+2676.097302962"
Jul 31 02:21:55.952320 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:55.952292    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:56.957854 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:56.957821    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:57.507415 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:57.507387    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:21:57.508223 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:21:57.508198    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:22:12.508434 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:12.508395    2571 patch_prober.go:28] interesting pod/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 31 02:22:12.508871 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:12.508460    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl" podUID="e6f236f7-1b84-4bd5-bb38-77e76926f72b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 31 02:22:12.611369 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:12.611336    2571 generic.go:356] "Generic (PLEG): container finished" podID="e6f236f7-1b84-4bd5-bb38-77e76926f72b" containerID="1abdb48d045d888e12b49b1ef3323f734d2f323fb5bef05d2655a9c699c41478" exitCode=0
Jul 31 02:22:12.611549 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:12.611408    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl" event={"ID":"e6f236f7-1b84-4bd5-bb38-77e76926f72b","Type":"ContainerDied","Data":"1abdb48d045d888e12b49b1ef3323f734d2f323fb5bef05d2655a9c699c41478"}
Jul 31 02:22:12.611856 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:12.611841    2571 scope.go:117] "RemoveContainer" containerID="1abdb48d045d888e12b49b1ef3323f734d2f323fb5bef05d2655a9c699c41478"
Jul 31 02:22:12.612857 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:12.612833    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:22:12.612930 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:12.612920    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:22:12.612979 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:12.612953    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:22:13.618815 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:13.618783    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl" event={"ID":"e6f236f7-1b84-4bd5-bb38-77e76926f72b","Type":"ContainerStarted","Data":"1dda66c5b38adbf73e21e8479d8762826e9663aee98d22139836956b65150850"}
Jul 31 02:22:13.953082 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:13.952983    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:22:13.953082 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:13.953037    2571 patch_prober.go:28] interesting pod/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 31 02:22:13.953340 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:13.953116    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl" podUID="e6f236f7-1b84-4bd5-bb38-77e76926f72b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 31 02:22:14.960941 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:14.956315    2571 patch_prober.go:28] interesting pod/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 31 02:22:14.960941 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:14.956381    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl" podUID="e6f236f7-1b84-4bd5-bb38-77e76926f72b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 31 02:22:15.953126 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:15.953087    2571 patch_prober.go:28] interesting pod/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 31 02:22:15.953427 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:15.953397    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl" podUID="e6f236f7-1b84-4bd5-bb38-77e76926f72b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 31 02:22:16.953222 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:16.953173    2571 patch_prober.go:28] interesting pod/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 31 02:22:16.953765 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:16.953248    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl" podUID="e6f236f7-1b84-4bd5-bb38-77e76926f72b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 31 02:22:17.952569 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:17.952529    2571 patch_prober.go:28] interesting pod/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 31 02:22:17.953813 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:17.953776    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl" podUID="e6f236f7-1b84-4bd5-bb38-77e76926f72b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 31 02:22:18.952697 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:18.952653    2571 patch_prober.go:28] interesting pod/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 31 02:22:18.952883 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:18.952718    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl" podUID="e6f236f7-1b84-4bd5-bb38-77e76926f72b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 31 02:22:19.957150 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:19.957120    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:22:19.957556 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:19.957503    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:22:19.958156 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:19.958141    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:22:23.111161 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.111131    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"]
Jul 31 02:22:23.114251 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.114227    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.117387 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.117362    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-f88d9e-openshift-default-dockercfg-rhwd8\""
Jul 31 02:22:23.128159 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.128134    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"]
Jul 31 02:22:23.156300 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.156268    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-istio-envoy\") pod \"e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") " pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.156502 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.156313    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-workload-socket\") pod \"e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") " pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.156502 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.156340    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-credential-socket\") pod \"e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") " pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.156502 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.156433    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f09d868d-bae8-4643-af85-a32de6b7980a-istio-token\") pod \"e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") " pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.156502 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.156477    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f09d868d-bae8-4643-af85-a32de6b7980a-istiod-ca-cert\") pod \"e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") " pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.156978 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.156532    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-workload-certs\") pod \"e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") " pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.156978 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.156625    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f09d868d-bae8-4643-af85-a32de6b7980a-istio-podinfo\") pod \"e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") " pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.156978 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.156656    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-istio-data\") pod \"e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") " pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.156978 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.156705    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxwt7\" (UniqueName: \"kubernetes.io/projected/f09d868d-bae8-4643-af85-a32de6b7980a-kube-api-access-mxwt7\") pod \"e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") " pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.258156 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.258122    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f09d868d-bae8-4643-af85-a32de6b7980a-istio-token\") pod \"e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") " pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.258156 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.258164    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f09d868d-bae8-4643-af85-a32de6b7980a-istiod-ca-cert\") pod \"e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") " pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.258433 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.258207    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-workload-certs\") pod \"e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") " pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.258433 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.258270    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f09d868d-bae8-4643-af85-a32de6b7980a-istio-podinfo\") pod \"e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") " pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.258433 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.258298    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-istio-data\") pod \"e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") " pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.258433 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.258335    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxwt7\" (UniqueName: \"kubernetes.io/projected/f09d868d-bae8-4643-af85-a32de6b7980a-kube-api-access-mxwt7\") pod \"e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") " pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.258433 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.258374    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-istio-envoy\") pod \"e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") " pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.258715 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.258539    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-workload-socket\") pod \"e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") " pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.258715 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.258602    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-credential-socket\") pod \"e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") " pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.258715 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.258681    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-workload-certs\") pod \"e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") " pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.258883 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.258819    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-istio-data\") pod \"e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") " pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.258988 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.258931    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-workload-socket\") pod \"e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") " pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.259049 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.259003    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-credential-socket\") pod \"e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") " pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.259049 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.259029    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f09d868d-bae8-4643-af85-a32de6b7980a-istiod-ca-cert\") pod \"e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") " pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.260724 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.260701    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-istio-envoy\") pod \"e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") " pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.260951 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.260931    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f09d868d-bae8-4643-af85-a32de6b7980a-istio-podinfo\") pod \"e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") " pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.268562 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.268539    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f09d868d-bae8-4643-af85-a32de6b7980a-istio-token\") pod \"e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") " pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.268843 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.268821    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxwt7\" (UniqueName: \"kubernetes.io/projected/f09d868d-bae8-4643-af85-a32de6b7980a-kube-api-access-mxwt7\") pod \"e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") " pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.426110 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.426023    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:23.566910 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.566871    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"]
Jul 31 02:22:23.568648 ip-10-0-133-91 kubenswrapper[2571]: W0731 02:22:23.568621    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf09d868d_bae8_4643_af85_a32de6b7980a.slice/crio-811eedfab1cae364b86abb92a3977118c9f1e881929352333d411f86ee0a7bf2 WatchSource:0}: Error finding container 811eedfab1cae364b86abb92a3977118c9f1e881929352333d411f86ee0a7bf2: Status 404 returned error can't find the container with id 811eedfab1cae364b86abb92a3977118c9f1e881929352333d411f86ee0a7bf2
Jul 31 02:22:23.571076 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.571046    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:22:23.571149 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.571114    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:22:23.571149 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.571143    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:22:23.679518 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.679413    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9" event={"ID":"f09d868d-bae8-4643-af85-a32de6b7980a","Type":"ContainerStarted","Data":"85d8016678498e970ff288db5e746e4fc1d3707037e3933482a82488fd05af6f"}
Jul 31 02:22:23.679518 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.679476    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9" event={"ID":"f09d868d-bae8-4643-af85-a32de6b7980a","Type":"ContainerStarted","Data":"811eedfab1cae364b86abb92a3977118c9f1e881929352333d411f86ee0a7bf2"}
Jul 31 02:22:23.700855 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:23.700781    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9" podStartSLOduration=0.700759474 podStartE2EDuration="700.759474ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:22:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:22:23.697258323 +0000 UTC m=+2704.277499318" watchObservedRunningTime="2026-07-31 02:22:23.700759474 +0000 UTC m=+2704.281000471"
Jul 31 02:22:24.426993 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:24.426939    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:24.431702 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:24.431675    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:24.685011 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:24.684929    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:24.685829 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:24.685801    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:39.686780 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:39.686740    2571 patch_prober.go:28] interesting pod/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 31 02:22:39.687296 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:39.686804    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9" podUID="f09d868d-bae8-4643-af85-a32de6b7980a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 31 02:22:39.786814 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:39.786728    2571 generic.go:356] "Generic (PLEG): container finished" podID="f09d868d-bae8-4643-af85-a32de6b7980a" containerID="85d8016678498e970ff288db5e746e4fc1d3707037e3933482a82488fd05af6f" exitCode=0
Jul 31 02:22:39.786980 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:39.786802    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9" event={"ID":"f09d868d-bae8-4643-af85-a32de6b7980a","Type":"ContainerDied","Data":"85d8016678498e970ff288db5e746e4fc1d3707037e3933482a82488fd05af6f"}
Jul 31 02:22:39.787288 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:39.787274    2571 scope.go:117] "RemoveContainer" containerID="85d8016678498e970ff288db5e746e4fc1d3707037e3933482a82488fd05af6f"
Jul 31 02:22:39.788429 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:39.788401    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:22:39.788508 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:39.788495    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:22:39.788546 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:39.788529    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:22:40.794256 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:40.794222    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9" event={"ID":"f09d868d-bae8-4643-af85-a32de6b7980a","Type":"ContainerStarted","Data":"152f031dc62c9cf91eb97fef5ae17600ed9ca03b0caebf5f48da728130cf144b"}
Jul 31 02:22:41.426319 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:41.426287    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:41.426496 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:41.426422    2571 patch_prober.go:28] interesting pod/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 31 02:22:41.426496 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:41.426474    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9" podUID="f09d868d-bae8-4643-af85-a32de6b7980a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 31 02:22:42.427214 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:42.427176    2571 patch_prober.go:28] interesting pod/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 31 02:22:42.427616 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:42.427241    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9" podUID="f09d868d-bae8-4643-af85-a32de6b7980a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 31 02:22:43.427374 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:43.427341    2571 patch_prober.go:28] interesting pod/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 31 02:22:43.427804 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:43.427393    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9" podUID="f09d868d-bae8-4643-af85-a32de6b7980a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 31 02:22:44.426827 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:44.426785    2571 patch_prober.go:28] interesting pod/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 31 02:22:44.427051 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:44.426852    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9" podUID="f09d868d-bae8-4643-af85-a32de6b7980a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 31 02:22:45.426654 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:45.426612    2571 patch_prober.go:28] interesting pod/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 31 02:22:45.427184 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:45.426673    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9" podUID="f09d868d-bae8-4643-af85-a32de6b7980a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 31 02:22:46.430561 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:46.430532    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:46.430968 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:46.430778    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:22:46.431410 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:22:46.431396    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:24:23.374466 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:23.374434    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"]
Jul 31 02:24:23.375100 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:23.374634    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl" podUID="e6f236f7-1b84-4bd5-bb38-77e76926f72b" containerName="istio-proxy" containerID="cri-o://1dda66c5b38adbf73e21e8479d8762826e9663aee98d22139836956b65150850" gracePeriod=30
Jul 31 02:24:28.625993 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:28.625970    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:24:28.672304 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:28.672215    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bvnz\" (UniqueName: \"kubernetes.io/projected/e6f236f7-1b84-4bd5-bb38-77e76926f72b-kube-api-access-2bvnz\") pod \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") "
Jul 31 02:24:28.672304 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:28.672252    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-workload-certs\") pod \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") "
Jul 31 02:24:28.672304 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:28.672296    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istio-envoy\") pod \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") "
Jul 31 02:24:28.672587 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:28.672316    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-workload-socket\") pod \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") "
Jul 31 02:24:28.672587 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:28.672334    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istio-podinfo\") pod \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") "
Jul 31 02:24:28.672587 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:28.672362    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istiod-ca-cert\") pod \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") "
Jul 31 02:24:28.672587 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:28.672392    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-credential-socket\") pod \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") "
Jul 31 02:24:28.672587 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:28.672479    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istio-data\") pod \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") "
Jul 31 02:24:28.672587 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:28.672507    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istio-token\") pod \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\" (UID: \"e6f236f7-1b84-4bd5-bb38-77e76926f72b\") "
Jul 31 02:24:28.673002 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:28.672641    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e6f236f7-1b84-4bd5-bb38-77e76926f72b" (UID: "e6f236f7-1b84-4bd5-bb38-77e76926f72b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:24:28.673002 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:28.672652    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e6f236f7-1b84-4bd5-bb38-77e76926f72b" (UID: "e6f236f7-1b84-4bd5-bb38-77e76926f72b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:24:28.673002 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:28.672952    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e6f236f7-1b84-4bd5-bb38-77e76926f72b" (UID: "e6f236f7-1b84-4bd5-bb38-77e76926f72b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 02:24:28.673002 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:28.672960    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-workload-certs\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:24:28.673002 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:28.672971    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istio-data" (OuterVolumeSpecName: "istio-data") pod "e6f236f7-1b84-4bd5-bb38-77e76926f72b" (UID: "e6f236f7-1b84-4bd5-bb38-77e76926f72b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:24:28.673002 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:28.672981    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-workload-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:24:28.673333 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:28.673050    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e6f236f7-1b84-4bd5-bb38-77e76926f72b" (UID: "e6f236f7-1b84-4bd5-bb38-77e76926f72b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:24:28.674950 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:28.674885    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e6f236f7-1b84-4bd5-bb38-77e76926f72b" (UID: "e6f236f7-1b84-4bd5-bb38-77e76926f72b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 02:24:28.674950 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:28.674884    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6f236f7-1b84-4bd5-bb38-77e76926f72b-kube-api-access-2bvnz" (OuterVolumeSpecName: "kube-api-access-2bvnz") pod "e6f236f7-1b84-4bd5-bb38-77e76926f72b" (UID: "e6f236f7-1b84-4bd5-bb38-77e76926f72b"). InnerVolumeSpecName "kube-api-access-2bvnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:24:28.675268 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:28.675246    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istio-token" (OuterVolumeSpecName: "istio-token") pod "e6f236f7-1b84-4bd5-bb38-77e76926f72b" (UID: "e6f236f7-1b84-4bd5-bb38-77e76926f72b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:24:28.675310 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:28.675288    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e6f236f7-1b84-4bd5-bb38-77e76926f72b" (UID: "e6f236f7-1b84-4bd5-bb38-77e76926f72b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:24:28.773837 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:28.773801    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istio-data\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:24:28.773837 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:28.773829    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istio-token\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:24:28.773837 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:28.773839    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bvnz\" (UniqueName: \"kubernetes.io/projected/e6f236f7-1b84-4bd5-bb38-77e76926f72b-kube-api-access-2bvnz\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:24:28.773837 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:28.773849    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istio-envoy\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:24:28.774160 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:28.773857    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istio-podinfo\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:24:28.774160 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:28.773865    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6f236f7-1b84-4bd5-bb38-77e76926f72b-istiod-ca-cert\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:24:28.774160 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:28.773872    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6f236f7-1b84-4bd5-bb38-77e76926f72b-credential-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:24:29.392853 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:29.392820    2571 generic.go:356] "Generic (PLEG): container finished" podID="e6f236f7-1b84-4bd5-bb38-77e76926f72b" containerID="1dda66c5b38adbf73e21e8479d8762826e9663aee98d22139836956b65150850" exitCode=0
Jul 31 02:24:29.393046 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:29.392882    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"
Jul 31 02:24:29.393046 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:29.392917    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl" event={"ID":"e6f236f7-1b84-4bd5-bb38-77e76926f72b","Type":"ContainerDied","Data":"1dda66c5b38adbf73e21e8479d8762826e9663aee98d22139836956b65150850"}
Jul 31 02:24:29.393046 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:29.392996    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl" event={"ID":"e6f236f7-1b84-4bd5-bb38-77e76926f72b","Type":"ContainerDied","Data":"f5c641538d0c777f1815a1d2f42e4e6df9870e276992460480f30a4bd73b1873"}
Jul 31 02:24:29.393046 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:29.393018    2571 scope.go:117] "RemoveContainer" containerID="1dda66c5b38adbf73e21e8479d8762826e9663aee98d22139836956b65150850"
Jul 31 02:24:29.402646 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:29.402628    2571 scope.go:117] "RemoveContainer" containerID="1abdb48d045d888e12b49b1ef3323f734d2f323fb5bef05d2655a9c699c41478"
Jul 31 02:24:29.411517 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:29.411500    2571 scope.go:117] "RemoveContainer" containerID="1dda66c5b38adbf73e21e8479d8762826e9663aee98d22139836956b65150850"
Jul 31 02:24:29.411776 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:24:29.411758    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dda66c5b38adbf73e21e8479d8762826e9663aee98d22139836956b65150850\": container with ID starting with 1dda66c5b38adbf73e21e8479d8762826e9663aee98d22139836956b65150850 not found: ID does not exist" containerID="1dda66c5b38adbf73e21e8479d8762826e9663aee98d22139836956b65150850"
Jul 31 02:24:29.411846 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:29.411786    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dda66c5b38adbf73e21e8479d8762826e9663aee98d22139836956b65150850"} err="failed to get container status \"1dda66c5b38adbf73e21e8479d8762826e9663aee98d22139836956b65150850\": rpc error: code = NotFound desc = could not find container \"1dda66c5b38adbf73e21e8479d8762826e9663aee98d22139836956b65150850\": container with ID starting with 1dda66c5b38adbf73e21e8479d8762826e9663aee98d22139836956b65150850 not found: ID does not exist"
Jul 31 02:24:29.411846 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:29.411804    2571 scope.go:117] "RemoveContainer" containerID="1abdb48d045d888e12b49b1ef3323f734d2f323fb5bef05d2655a9c699c41478"
Jul 31 02:24:29.412327 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:24:29.412305    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1abdb48d045d888e12b49b1ef3323f734d2f323fb5bef05d2655a9c699c41478\": container with ID starting with 1abdb48d045d888e12b49b1ef3323f734d2f323fb5bef05d2655a9c699c41478 not found: ID does not exist" containerID="1abdb48d045d888e12b49b1ef3323f734d2f323fb5bef05d2655a9c699c41478"
Jul 31 02:24:29.412581 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:29.412523    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1abdb48d045d888e12b49b1ef3323f734d2f323fb5bef05d2655a9c699c41478"} err="failed to get container status \"1abdb48d045d888e12b49b1ef3323f734d2f323fb5bef05d2655a9c699c41478\": rpc error: code = NotFound desc = could not find container \"1abdb48d045d888e12b49b1ef3323f734d2f323fb5bef05d2655a9c699c41478\": container with ID starting with 1abdb48d045d888e12b49b1ef3323f734d2f323fb5bef05d2655a9c699c41478 not found: ID does not exist"
Jul 31 02:24:29.417251 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:29.417230    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"]
Jul 31 02:24:29.419272 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:29.419250    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-8af864-openshift-default-78cb8b5cdd-bh6sl"]
Jul 31 02:24:29.993262 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:29.993229    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6f236f7-1b84-4bd5-bb38-77e76926f72b" path="/var/lib/kubelet/pods/e6f236f7-1b84-4bd5-bb38-77e76926f72b/volumes"
Jul 31 02:24:40.925488 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:40.925451    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"]
Jul 31 02:24:40.925971 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:40.925710    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9" podUID="f09d868d-bae8-4643-af85-a32de6b7980a" containerName="istio-proxy" containerID="cri-o://152f031dc62c9cf91eb97fef5ae17600ed9ca03b0caebf5f48da728130cf144b" gracePeriod=30
Jul 31 02:24:41.816004 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.815967    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"]
Jul 31 02:24:41.816596 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.816580    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6f236f7-1b84-4bd5-bb38-77e76926f72b" containerName="istio-proxy"
Jul 31 02:24:41.816650 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.816597    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6f236f7-1b84-4bd5-bb38-77e76926f72b" containerName="istio-proxy"
Jul 31 02:24:41.816650 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.816609    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6f236f7-1b84-4bd5-bb38-77e76926f72b" containerName="istio-proxy"
Jul 31 02:24:41.816650 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.816616    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6f236f7-1b84-4bd5-bb38-77e76926f72b" containerName="istio-proxy"
Jul 31 02:24:41.816746 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.816677    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6f236f7-1b84-4bd5-bb38-77e76926f72b" containerName="istio-proxy"
Jul 31 02:24:41.816746 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.816686    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6f236f7-1b84-4bd5-bb38-77e76926f72b" containerName="istio-proxy"
Jul 31 02:24:41.821265 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.821251    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:41.824141 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.824121    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-bf4f62-openshift-default-dockercfg-s6nzh\""
Jul 31 02:24:41.829332 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.829307    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"]
Jul 31 02:24:41.892071 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.892033    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-workload-socket\") pod \"e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") " pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:41.892071 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.892074    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rb6h\" (UniqueName: \"kubernetes.io/projected/61046999-767d-4760-a862-bb46e19f888b-kube-api-access-2rb6h\") pod \"e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") " pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:41.892292 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.892096    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61046999-767d-4760-a862-bb46e19f888b-istiod-ca-cert\") pod \"e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") " pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:41.892292 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.892184    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-istio-data\") pod \"e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") " pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:41.892292 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.892252    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-istio-envoy\") pod \"e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") " pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:41.892292 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.892288    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-credential-socket\") pod \"e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") " pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:41.892419 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.892305    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-workload-certs\") pod \"e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") " pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:41.892419 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.892326    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61046999-767d-4760-a862-bb46e19f888b-istio-podinfo\") pod \"e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") " pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:41.892419 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.892396    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61046999-767d-4760-a862-bb46e19f888b-istio-token\") pod \"e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") " pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:41.993457 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.993429    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61046999-767d-4760-a862-bb46e19f888b-istio-token\") pod \"e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") " pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:41.993992 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.993471    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-workload-socket\") pod \"e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") " pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:41.993992 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.993493    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rb6h\" (UniqueName: \"kubernetes.io/projected/61046999-767d-4760-a862-bb46e19f888b-kube-api-access-2rb6h\") pod \"e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") " pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:41.993992 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.993536    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61046999-767d-4760-a862-bb46e19f888b-istiod-ca-cert\") pod \"e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") " pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:41.993992 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.993604    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-istio-data\") pod \"e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") " pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:41.993992 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.993653    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-istio-envoy\") pod \"e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") " pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:41.993992 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.993681    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-credential-socket\") pod \"e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") " pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:41.993992 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.993704    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-workload-certs\") pod \"e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") " pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:41.993992 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.993736    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61046999-767d-4760-a862-bb46e19f888b-istio-podinfo\") pod \"e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") " pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:41.993992 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.993961    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-workload-socket\") pod \"e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") " pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:41.994480 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.994072    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-istio-data\") pod \"e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") " pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:41.994480 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.994135    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-credential-socket\") pod \"e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") " pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:41.994480 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.994262    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-workload-certs\") pod \"e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") " pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:41.994480 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.994343    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61046999-767d-4760-a862-bb46e19f888b-istiod-ca-cert\") pod \"e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") " pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:41.996012 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.995991    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-istio-envoy\") pod \"e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") " pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:41.996237 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:41.996217    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61046999-767d-4760-a862-bb46e19f888b-istio-podinfo\") pod \"e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") " pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:42.000880 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:42.000851    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61046999-767d-4760-a862-bb46e19f888b-istio-token\") pod \"e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") " pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:42.001349 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:42.001332    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rb6h\" (UniqueName: \"kubernetes.io/projected/61046999-767d-4760-a862-bb46e19f888b-kube-api-access-2rb6h\") pod \"e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") " pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:42.132700 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:42.132669    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:42.274501 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:42.274472    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"]
Jul 31 02:24:42.276980 ip-10-0-133-91 kubenswrapper[2571]: W0731 02:24:42.276947    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61046999_767d_4760_a862_bb46e19f888b.slice/crio-bb555c251fe58372a3cafbecbd80983faa0befc9630ae9b036ea8b13f1e599e7 WatchSource:0}: Error finding container bb555c251fe58372a3cafbecbd80983faa0befc9630ae9b036ea8b13f1e599e7: Status 404 returned error can't find the container with id bb555c251fe58372a3cafbecbd80983faa0befc9630ae9b036ea8b13f1e599e7
Jul 31 02:24:42.279527 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:42.279497    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:24:42.279610 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:42.279562    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:24:42.279610 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:42.279589    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:24:42.467168 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:42.467074    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz" event={"ID":"61046999-767d-4760-a862-bb46e19f888b","Type":"ContainerStarted","Data":"7544c056d92a7eaaf83399253667c4a63cab4d68993af04c798860eefc561cc3"}
Jul 31 02:24:42.467168 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:42.467135    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz" event={"ID":"61046999-767d-4760-a862-bb46e19f888b","Type":"ContainerStarted","Data":"bb555c251fe58372a3cafbecbd80983faa0befc9630ae9b036ea8b13f1e599e7"}
Jul 31 02:24:42.490572 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:42.490518    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz" podStartSLOduration=1.490501543 podStartE2EDuration="1.490501543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:24:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:24:42.488963642 +0000 UTC m=+2843.069204656" watchObservedRunningTime="2026-07-31 02:24:42.490501543 +0000 UTC m=+2843.070742541"
Jul 31 02:24:43.132880 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:43.132846    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:43.137862 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:43.137837    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:43.472784 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:43.472698    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:43.473824 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:43.473802    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:46.189869 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.189706    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:24:46.238261 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.237143    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-istio-envoy\") pod \"f09d868d-bae8-4643-af85-a32de6b7980a\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") "
Jul 31 02:24:46.238261 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.237241    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-workload-socket\") pod \"f09d868d-bae8-4643-af85-a32de6b7980a\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") "
Jul 31 02:24:46.238261 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.237268    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-workload-certs\") pod \"f09d868d-bae8-4643-af85-a32de6b7980a\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") "
Jul 31 02:24:46.238261 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.237308    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxwt7\" (UniqueName: \"kubernetes.io/projected/f09d868d-bae8-4643-af85-a32de6b7980a-kube-api-access-mxwt7\") pod \"f09d868d-bae8-4643-af85-a32de6b7980a\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") "
Jul 31 02:24:46.238261 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.237348    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f09d868d-bae8-4643-af85-a32de6b7980a-istio-podinfo\") pod \"f09d868d-bae8-4643-af85-a32de6b7980a\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") "
Jul 31 02:24:46.238261 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.237380    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f09d868d-bae8-4643-af85-a32de6b7980a-istiod-ca-cert\") pod \"f09d868d-bae8-4643-af85-a32de6b7980a\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") "
Jul 31 02:24:46.238261 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.237427    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-credential-socket\") pod \"f09d868d-bae8-4643-af85-a32de6b7980a\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") "
Jul 31 02:24:46.238261 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.237453    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f09d868d-bae8-4643-af85-a32de6b7980a-istio-token\") pod \"f09d868d-bae8-4643-af85-a32de6b7980a\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") "
Jul 31 02:24:46.238261 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.237477    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-istio-data\") pod \"f09d868d-bae8-4643-af85-a32de6b7980a\" (UID: \"f09d868d-bae8-4643-af85-a32de6b7980a\") "
Jul 31 02:24:46.238885 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.238296    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f09d868d-bae8-4643-af85-a32de6b7980a" (UID: "f09d868d-bae8-4643-af85-a32de6b7980a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:24:46.238885 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.238546    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f09d868d-bae8-4643-af85-a32de6b7980a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f09d868d-bae8-4643-af85-a32de6b7980a" (UID: "f09d868d-bae8-4643-af85-a32de6b7980a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 02:24:46.238885 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.238813    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f09d868d-bae8-4643-af85-a32de6b7980a" (UID: "f09d868d-bae8-4643-af85-a32de6b7980a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:24:46.239194 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.239167    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-istio-data" (OuterVolumeSpecName: "istio-data") pod "f09d868d-bae8-4643-af85-a32de6b7980a" (UID: "f09d868d-bae8-4643-af85-a32de6b7980a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:24:46.239323 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.239194    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-workload-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:24:46.239323 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.239219    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-workload-certs\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:24:46.239323 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.239232    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f09d868d-bae8-4643-af85-a32de6b7980a-istiod-ca-cert\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:24:46.239510 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.239349    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f09d868d-bae8-4643-af85-a32de6b7980a" (UID: "f09d868d-bae8-4643-af85-a32de6b7980a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:24:46.240682 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.240418    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f09d868d-bae8-4643-af85-a32de6b7980a-istio-token" (OuterVolumeSpecName: "istio-token") pod "f09d868d-bae8-4643-af85-a32de6b7980a" (UID: "f09d868d-bae8-4643-af85-a32de6b7980a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:24:46.240884 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.240854    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f09d868d-bae8-4643-af85-a32de6b7980a-kube-api-access-mxwt7" (OuterVolumeSpecName: "kube-api-access-mxwt7") pod "f09d868d-bae8-4643-af85-a32de6b7980a" (UID: "f09d868d-bae8-4643-af85-a32de6b7980a"). InnerVolumeSpecName "kube-api-access-mxwt7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:24:46.241419 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.241396    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f09d868d-bae8-4643-af85-a32de6b7980a" (UID: "f09d868d-bae8-4643-af85-a32de6b7980a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:24:46.241504 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.241470    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f09d868d-bae8-4643-af85-a32de6b7980a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f09d868d-bae8-4643-af85-a32de6b7980a" (UID: "f09d868d-bae8-4643-af85-a32de6b7980a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 02:24:46.340626 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.340579    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxwt7\" (UniqueName: \"kubernetes.io/projected/f09d868d-bae8-4643-af85-a32de6b7980a-kube-api-access-mxwt7\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:24:46.340626 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.340622    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f09d868d-bae8-4643-af85-a32de6b7980a-istio-podinfo\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:24:46.340822 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.340637    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-credential-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:24:46.340822 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.340649    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f09d868d-bae8-4643-af85-a32de6b7980a-istio-token\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:24:46.340822 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.340662    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-istio-data\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:24:46.340822 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.340673    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f09d868d-bae8-4643-af85-a32de6b7980a-istio-envoy\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:24:46.490368 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.490282    2571 generic.go:356] "Generic (PLEG): container finished" podID="f09d868d-bae8-4643-af85-a32de6b7980a" containerID="152f031dc62c9cf91eb97fef5ae17600ed9ca03b0caebf5f48da728130cf144b" exitCode=0
Jul 31 02:24:46.490368 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.490330    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9" event={"ID":"f09d868d-bae8-4643-af85-a32de6b7980a","Type":"ContainerDied","Data":"152f031dc62c9cf91eb97fef5ae17600ed9ca03b0caebf5f48da728130cf144b"}
Jul 31 02:24:46.490368 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.490350    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"
Jul 31 02:24:46.490616 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.490372    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9" event={"ID":"f09d868d-bae8-4643-af85-a32de6b7980a","Type":"ContainerDied","Data":"811eedfab1cae364b86abb92a3977118c9f1e881929352333d411f86ee0a7bf2"}
Jul 31 02:24:46.490616 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.490394    2571 scope.go:117] "RemoveContainer" containerID="152f031dc62c9cf91eb97fef5ae17600ed9ca03b0caebf5f48da728130cf144b"
Jul 31 02:24:46.500296 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.500277    2571 scope.go:117] "RemoveContainer" containerID="85d8016678498e970ff288db5e746e4fc1d3707037e3933482a82488fd05af6f"
Jul 31 02:24:46.508585 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.508570    2571 scope.go:117] "RemoveContainer" containerID="152f031dc62c9cf91eb97fef5ae17600ed9ca03b0caebf5f48da728130cf144b"
Jul 31 02:24:46.508839 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:24:46.508818    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"152f031dc62c9cf91eb97fef5ae17600ed9ca03b0caebf5f48da728130cf144b\": container with ID starting with 152f031dc62c9cf91eb97fef5ae17600ed9ca03b0caebf5f48da728130cf144b not found: ID does not exist" containerID="152f031dc62c9cf91eb97fef5ae17600ed9ca03b0caebf5f48da728130cf144b"
Jul 31 02:24:46.508949 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.508847    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"152f031dc62c9cf91eb97fef5ae17600ed9ca03b0caebf5f48da728130cf144b"} err="failed to get container status \"152f031dc62c9cf91eb97fef5ae17600ed9ca03b0caebf5f48da728130cf144b\": rpc error: code = NotFound desc = could not find container \"152f031dc62c9cf91eb97fef5ae17600ed9ca03b0caebf5f48da728130cf144b\": container with ID starting with 152f031dc62c9cf91eb97fef5ae17600ed9ca03b0caebf5f48da728130cf144b not found: ID does not exist"
Jul 31 02:24:46.508949 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.508864    2571 scope.go:117] "RemoveContainer" containerID="85d8016678498e970ff288db5e746e4fc1d3707037e3933482a82488fd05af6f"
Jul 31 02:24:46.509113 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:24:46.509097    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85d8016678498e970ff288db5e746e4fc1d3707037e3933482a82488fd05af6f\": container with ID starting with 85d8016678498e970ff288db5e746e4fc1d3707037e3933482a82488fd05af6f not found: ID does not exist" containerID="85d8016678498e970ff288db5e746e4fc1d3707037e3933482a82488fd05af6f"
Jul 31 02:24:46.509153 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.509119    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85d8016678498e970ff288db5e746e4fc1d3707037e3933482a82488fd05af6f"} err="failed to get container status \"85d8016678498e970ff288db5e746e4fc1d3707037e3933482a82488fd05af6f\": rpc error: code = NotFound desc = could not find container \"85d8016678498e970ff288db5e746e4fc1d3707037e3933482a82488fd05af6f\": container with ID starting with 85d8016678498e970ff288db5e746e4fc1d3707037e3933482a82488fd05af6f not found: ID does not exist"
Jul 31 02:24:46.513026 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.513005    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"]
Jul 31 02:24:46.518653 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:46.518633    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-f88d9e-openshift-default-5c99cbf864-mg8x9"]
Jul 31 02:24:47.999210 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:47.999175    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f09d868d-bae8-4643-af85-a32de6b7980a" path="/var/lib/kubelet/pods/f09d868d-bae8-4643-af85-a32de6b7980a/volumes"
Jul 31 02:24:57.553149 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:57.553120    2571 generic.go:356] "Generic (PLEG): container finished" podID="61046999-767d-4760-a862-bb46e19f888b" containerID="7544c056d92a7eaaf83399253667c4a63cab4d68993af04c798860eefc561cc3" exitCode=0
Jul 31 02:24:57.553627 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:57.553204    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz" event={"ID":"61046999-767d-4760-a862-bb46e19f888b","Type":"ContainerDied","Data":"7544c056d92a7eaaf83399253667c4a63cab4d68993af04c798860eefc561cc3"}
Jul 31 02:24:57.553682 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:57.553626    2571 scope.go:117] "RemoveContainer" containerID="7544c056d92a7eaaf83399253667c4a63cab4d68993af04c798860eefc561cc3"
Jul 31 02:24:57.554620 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:57.554594    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:24:57.554724 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:57.554658    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:24:57.554724 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:57.554700    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:24:58.473343 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:58.473309    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:58.564796 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:58.564762    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz" event={"ID":"61046999-767d-4760-a862-bb46e19f888b","Type":"ContainerStarted","Data":"2359f7c5d408b4b8255754298fb54a41bb70c326bb98a0795e3970b90c4dc533"}
Jul 31 02:24:59.133093 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:59.133055    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:24:59.134265 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:59.134242    2571 patch_prober.go:28] interesting pod/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 31 02:24:59.134335 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:24:59.134302    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz" podUID="61046999-767d-4760-a862-bb46e19f888b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 31 02:25:00.134123 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:00.134083    2571 patch_prober.go:28] interesting pod/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 31 02:25:00.134545 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:00.134149    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz" podUID="61046999-767d-4760-a862-bb46e19f888b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 31 02:25:01.133807 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:01.133775    2571 patch_prober.go:28] interesting pod/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 31 02:25:01.134035 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:01.133831    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz" podUID="61046999-767d-4760-a862-bb46e19f888b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 31 02:25:02.133507 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:02.133470    2571 patch_prober.go:28] interesting pod/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 31 02:25:02.133958 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:02.133557    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz" podUID="61046999-767d-4760-a862-bb46e19f888b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 31 02:25:03.133492 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:03.133456    2571 patch_prober.go:28] interesting pod/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 31 02:25:03.133691 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:03.133511    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz" podUID="61046999-767d-4760-a862-bb46e19f888b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 31 02:25:04.136788 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:04.136757    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:25:04.137224 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:04.137133    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:25:04.137769 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:04.137750    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:25:15.364040 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.363959    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"]
Jul 31 02:25:15.364504 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.364488    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f09d868d-bae8-4643-af85-a32de6b7980a" containerName="istio-proxy"
Jul 31 02:25:15.364557 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.364506    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f09d868d-bae8-4643-af85-a32de6b7980a" containerName="istio-proxy"
Jul 31 02:25:15.364592 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.364584    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f09d868d-bae8-4643-af85-a32de6b7980a" containerName="istio-proxy"
Jul 31 02:25:15.367809 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.367794    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.370518 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.370498    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-ba3761-openshift-default-dockercfg-k477p\""
Jul 31 02:25:15.380683 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.380659    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"]
Jul 31 02:25:15.434816 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.434781    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-istio-envoy\") pod \"e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") " pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.434816 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.434815    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-credential-socket\") pod \"e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") " pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.435056 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.434837    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7abb446-58b6-463d-b2f4-34cd550fe739-istio-podinfo\") pod \"e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") " pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.435056 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.434914    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpcgq\" (UniqueName: \"kubernetes.io/projected/c7abb446-58b6-463d-b2f4-34cd550fe739-kube-api-access-zpcgq\") pod \"e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") " pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.435056 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.434958    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7abb446-58b6-463d-b2f4-34cd550fe739-istiod-ca-cert\") pod \"e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") " pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.435056 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.435005    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7abb446-58b6-463d-b2f4-34cd550fe739-istio-token\") pod \"e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") " pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.435186 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.435088    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-workload-socket\") pod \"e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") " pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.435186 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.435108    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-workload-certs\") pod \"e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") " pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.435186 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.435139    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-istio-data\") pod \"e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") " pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.536151 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.536112    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-workload-socket\") pod \"e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") " pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.536359 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.536161    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-workload-certs\") pod \"e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") " pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.536359 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.536199    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-istio-data\") pod \"e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") " pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.536359 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.536271    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-istio-envoy\") pod \"e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") " pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.536359 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.536295    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-credential-socket\") pod \"e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") " pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.536359 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.536323    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7abb446-58b6-463d-b2f4-34cd550fe739-istio-podinfo\") pod \"e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") " pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.536359 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.536351    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpcgq\" (UniqueName: \"kubernetes.io/projected/c7abb446-58b6-463d-b2f4-34cd550fe739-kube-api-access-zpcgq\") pod \"e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") " pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.536685 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.536404    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7abb446-58b6-463d-b2f4-34cd550fe739-istiod-ca-cert\") pod \"e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") " pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.536685 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.536445    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7abb446-58b6-463d-b2f4-34cd550fe739-istio-token\") pod \"e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") " pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.536685 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.536564    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-workload-socket\") pod \"e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") " pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.536685 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.536621    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-workload-certs\") pod \"e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") " pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.537156 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.537110    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-credential-socket\") pod \"e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") " pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.537333 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.537152    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-istio-data\") pod \"e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") " pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.537558 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.537538    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7abb446-58b6-463d-b2f4-34cd550fe739-istiod-ca-cert\") pod \"e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") " pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.539459 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.539433    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-istio-envoy\") pod \"e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") " pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.539611 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.539595    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7abb446-58b6-463d-b2f4-34cd550fe739-istio-podinfo\") pod \"e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") " pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.545394 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.545372    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpcgq\" (UniqueName: \"kubernetes.io/projected/c7abb446-58b6-463d-b2f4-34cd550fe739-kube-api-access-zpcgq\") pod \"e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") " pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.546442 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.546417    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7abb446-58b6-463d-b2f4-34cd550fe739-istio-token\") pod \"e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") " pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.679198 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.679105    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:15.825102 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.825062    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"]
Jul 31 02:25:15.832821 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.831757    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:25:15.832821 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.831840    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:25:15.832821 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:15.831880    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:25:16.673611 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:16.673566    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv" event={"ID":"c7abb446-58b6-463d-b2f4-34cd550fe739","Type":"ContainerStarted","Data":"450ba47c279a3ebb9197ab1e0dd86f5969c8559f355adf9469776baa59f34d66"}
Jul 31 02:25:16.674054 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:16.673635    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv" event={"ID":"c7abb446-58b6-463d-b2f4-34cd550fe739","Type":"ContainerStarted","Data":"a8e8f751921dd799af0465e81bdd479ed829049230e19adbbda4fe7741768180"}
Jul 31 02:25:16.680237 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:16.680206    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:16.685728 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:16.685706    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:16.695877 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:16.695830    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv" podStartSLOduration=1.695816585 podStartE2EDuration="1.695816585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:25:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:25:16.692502548 +0000 UTC m=+2877.272743542" watchObservedRunningTime="2026-07-31 02:25:16.695816585 +0000 UTC m=+2877.276057581"
Jul 31 02:25:17.680397 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:17.680363    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:17.681542 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:17.681521    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:32.682417 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:32.682380    2571 patch_prober.go:28] interesting pod/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 31 02:25:32.682852 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:32.682445    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv" podUID="c7abb446-58b6-463d-b2f4-34cd550fe739" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 31 02:25:32.763472 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:32.763441    2571 generic.go:356] "Generic (PLEG): container finished" podID="c7abb446-58b6-463d-b2f4-34cd550fe739" containerID="450ba47c279a3ebb9197ab1e0dd86f5969c8559f355adf9469776baa59f34d66" exitCode=0
Jul 31 02:25:32.763640 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:32.763513    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv" event={"ID":"c7abb446-58b6-463d-b2f4-34cd550fe739","Type":"ContainerDied","Data":"450ba47c279a3ebb9197ab1e0dd86f5969c8559f355adf9469776baa59f34d66"}
Jul 31 02:25:32.763967 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:32.763953    2571 scope.go:117] "RemoveContainer" containerID="450ba47c279a3ebb9197ab1e0dd86f5969c8559f355adf9469776baa59f34d66"
Jul 31 02:25:32.765151 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:32.765128    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:25:32.765227 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:32.765192    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:25:32.765227 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:32.765223    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:25:33.771043 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:33.771010    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv" event={"ID":"c7abb446-58b6-463d-b2f4-34cd550fe739","Type":"ContainerStarted","Data":"c948f8a1cf114016ddbc6cd8f0c7c922996e8ce987dd0d0e3d3cbfa3c8e2d547"}
Jul 31 02:25:34.679985 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:34.679940    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:34.680199 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:34.680176    2571 patch_prober.go:28] interesting pod/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 31 02:25:34.680263 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:34.680228    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv" podUID="c7abb446-58b6-463d-b2f4-34cd550fe739" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 31 02:25:35.679654 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:35.679617    2571 patch_prober.go:28] interesting pod/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 31 02:25:35.680104 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:35.679672    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv" podUID="c7abb446-58b6-463d-b2f4-34cd550fe739" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 31 02:25:36.679451 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:36.679414    2571 patch_prober.go:28] interesting pod/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 31 02:25:36.679641 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:36.679477    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv" podUID="c7abb446-58b6-463d-b2f4-34cd550fe739" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 31 02:25:37.679726 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:37.679688    2571 patch_prober.go:28] interesting pod/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 31 02:25:37.680185 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:37.679740    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv" podUID="c7abb446-58b6-463d-b2f4-34cd550fe739" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 31 02:25:38.680577 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:38.680538    2571 patch_prober.go:28] interesting pod/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 31 02:25:38.681005 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:38.680608    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv" podUID="c7abb446-58b6-463d-b2f4-34cd550fe739" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 31 02:25:39.683647 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:39.683618    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:39.684044 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:39.683918    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:39.684707 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:39.684684    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:25:46.954550 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:46.954512    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf4f62-fj8j8"]
Jul 31 02:25:46.955107 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:46.955034    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f09d868d-bae8-4643-af85-a32de6b7980a" containerName="istio-proxy"
Jul 31 02:25:46.955107 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:46.955048    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f09d868d-bae8-4643-af85-a32de6b7980a" containerName="istio-proxy"
Jul 31 02:25:46.958582 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:46.955553    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f09d868d-bae8-4643-af85-a32de6b7980a" containerName="istio-proxy"
Jul 31 02:25:46.962008 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:46.960441    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf4f62-fj8j8"
Jul 31 02:25:46.963748 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:46.963723    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 02:25:46.964268 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:46.963819    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4lh69\""
Jul 31 02:25:46.966374 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:46.966349    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf4f62-fj8j8"]
Jul 31 02:25:46.976159 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:46.976125    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfef6406-4bba-492b-96ea-9e589921efe3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-bf4f62-fj8j8\" (UID: \"cfef6406-4bba-492b-96ea-9e589921efe3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf4f62-fj8j8"
Jul 31 02:25:47.077690 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:47.077649    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfef6406-4bba-492b-96ea-9e589921efe3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-bf4f62-fj8j8\" (UID: \"cfef6406-4bba-492b-96ea-9e589921efe3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf4f62-fj8j8"
Jul 31 02:25:47.078409 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:47.078375    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfef6406-4bba-492b-96ea-9e589921efe3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-bf4f62-fj8j8\" (UID: \"cfef6406-4bba-492b-96ea-9e589921efe3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf4f62-fj8j8"
Jul 31 02:25:47.276711 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:47.276616    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf4f62-fj8j8"
Jul 31 02:25:47.426720 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:47.426688    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf4f62-fj8j8"]
Jul 31 02:25:47.428594 ip-10-0-133-91 kubenswrapper[2571]: W0731 02:25:47.428573    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfef6406_4bba_492b_96ea_9e589921efe3.slice/crio-e76269a74c776d4cd4e42d38f4bab127bd1f6da9432bc49ce68ae3ce026a5b42 WatchSource:0}: Error finding container e76269a74c776d4cd4e42d38f4bab127bd1f6da9432bc49ce68ae3ce026a5b42: Status 404 returned error can't find the container with id e76269a74c776d4cd4e42d38f4bab127bd1f6da9432bc49ce68ae3ce026a5b42
Jul 31 02:25:47.431007 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:47.430992    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 02:25:47.849575 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:47.849537    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf4f62-fj8j8" event={"ID":"cfef6406-4bba-492b-96ea-9e589921efe3","Type":"ContainerStarted","Data":"e76269a74c776d4cd4e42d38f4bab127bd1f6da9432bc49ce68ae3ce026a5b42"}
Jul 31 02:25:54.888347 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:54.888309    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf4f62-fj8j8" event={"ID":"cfef6406-4bba-492b-96ea-9e589921efe3","Type":"ContainerStarted","Data":"dc4527586a64fa10dcfd392131295f2353b180dfe080ee38412f274ee15aea5f"}
Jul 31 02:25:54.904057 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:54.903942    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf4f62-fj8j8" podStartSLOduration=1.956994446 podStartE2EDuration="8.903926698s" totalImagesPullingTime="6.946932252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:25:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:25:54.902586705 +0000 UTC m=+2915.482827702" watchObservedRunningTime="2026-07-31 02:25:54.903926698 +0000 UTC m=+2915.484167693"
Jul 31 02:25:55.895261 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:55.895230    2571 generic.go:356] "Generic (PLEG): container finished" podID="cfef6406-4bba-492b-96ea-9e589921efe3" containerID="dc4527586a64fa10dcfd392131295f2353b180dfe080ee38412f274ee15aea5f" exitCode=0
Jul 31 02:25:55.895701 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:55.895318    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf4f62-fj8j8" event={"ID":"cfef6406-4bba-492b-96ea-9e589921efe3","Type":"ContainerDied","Data":"dc4527586a64fa10dcfd392131295f2353b180dfe080ee38412f274ee15aea5f"}
Jul 31 02:25:57.045634 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:57.045610    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf4f62-fj8j8"
Jul 31 02:25:57.182056 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:57.181963    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfef6406-4bba-492b-96ea-9e589921efe3-maas-api-service-ca\") pod \"cfef6406-4bba-492b-96ea-9e589921efe3\" (UID: \"cfef6406-4bba-492b-96ea-9e589921efe3\") "
Jul 31 02:25:57.182329 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:57.182306    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfef6406-4bba-492b-96ea-9e589921efe3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cfef6406-4bba-492b-96ea-9e589921efe3" (UID: "cfef6406-4bba-492b-96ea-9e589921efe3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 02:25:57.283428 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:57.283395    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfef6406-4bba-492b-96ea-9e589921efe3-maas-api-service-ca\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:25:57.909975 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:57.909945    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf4f62-fj8j8"
Jul 31 02:25:57.910163 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:57.909949    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf4f62-fj8j8" event={"ID":"cfef6406-4bba-492b-96ea-9e589921efe3","Type":"ContainerDied","Data":"e76269a74c776d4cd4e42d38f4bab127bd1f6da9432bc49ce68ae3ce026a5b42"}
Jul 31 02:25:57.910163 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:25:57.910068    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e76269a74c776d4cd4e42d38f4bab127bd1f6da9432bc49ce68ae3ce026a5b42"
Jul 31 02:26:12.892738 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:12.892688    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf4f62-fj8j8"]
Jul 31 02:26:12.895478 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:12.895447    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf4f62-fj8j8"]
Jul 31 02:26:13.992057 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:13.992019    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfef6406-4bba-492b-96ea-9e589921efe3" path="/var/lib/kubelet/pods/cfef6406-4bba-492b-96ea-9e589921efe3/volumes"
Jul 31 02:26:19.214613 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:19.214575    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"]
Jul 31 02:26:19.215213 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:19.214859    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz" podUID="61046999-767d-4760-a862-bb46e19f888b" containerName="istio-proxy" containerID="cri-o://2359f7c5d408b4b8255754298fb54a41bb70c326bb98a0795e3970b90c4dc533" gracePeriod=30
Jul 31 02:26:24.460270 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:24.460242    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:26:24.561613 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:24.561520    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61046999-767d-4760-a862-bb46e19f888b-istio-token\") pod \"61046999-767d-4760-a862-bb46e19f888b\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") "
Jul 31 02:26:24.561613 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:24.561584    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rb6h\" (UniqueName: \"kubernetes.io/projected/61046999-767d-4760-a862-bb46e19f888b-kube-api-access-2rb6h\") pod \"61046999-767d-4760-a862-bb46e19f888b\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") "
Jul 31 02:26:24.561613 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:24.561611    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-workload-certs\") pod \"61046999-767d-4760-a862-bb46e19f888b\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") "
Jul 31 02:26:24.561948 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:24.561682    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61046999-767d-4760-a862-bb46e19f888b-istio-podinfo\") pod \"61046999-767d-4760-a862-bb46e19f888b\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") "
Jul 31 02:26:24.561948 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:24.561703    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-workload-socket\") pod \"61046999-767d-4760-a862-bb46e19f888b\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") "
Jul 31 02:26:24.561948 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:24.561730    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-credential-socket\") pod \"61046999-767d-4760-a862-bb46e19f888b\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") "
Jul 31 02:26:24.561948 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:24.561748    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-istio-data\") pod \"61046999-767d-4760-a862-bb46e19f888b\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") "
Jul 31 02:26:24.561948 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:24.561771    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61046999-767d-4760-a862-bb46e19f888b-istiod-ca-cert\") pod \"61046999-767d-4760-a862-bb46e19f888b\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") "
Jul 31 02:26:24.561948 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:24.561793    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-istio-envoy\") pod \"61046999-767d-4760-a862-bb46e19f888b\" (UID: \"61046999-767d-4760-a862-bb46e19f888b\") "
Jul 31 02:26:24.562272 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:24.562001    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "61046999-767d-4760-a862-bb46e19f888b" (UID: "61046999-767d-4760-a862-bb46e19f888b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:26:24.562272 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:24.562018    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "61046999-767d-4760-a862-bb46e19f888b" (UID: "61046999-767d-4760-a862-bb46e19f888b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:26:24.562272 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:24.562122    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-istio-data" (OuterVolumeSpecName: "istio-data") pod "61046999-767d-4760-a862-bb46e19f888b" (UID: "61046999-767d-4760-a862-bb46e19f888b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:26:24.562272 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:24.562177    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-workload-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:26:24.562272 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:24.562194    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-workload-certs\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:26:24.562494 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:24.562287    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61046999-767d-4760-a862-bb46e19f888b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "61046999-767d-4760-a862-bb46e19f888b" (UID: "61046999-767d-4760-a862-bb46e19f888b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 02:26:24.562494 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:24.562292    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "61046999-767d-4760-a862-bb46e19f888b" (UID: "61046999-767d-4760-a862-bb46e19f888b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:26:24.563837 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:24.563816    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61046999-767d-4760-a862-bb46e19f888b-istio-token" (OuterVolumeSpecName: "istio-token") pod "61046999-767d-4760-a862-bb46e19f888b" (UID: "61046999-767d-4760-a862-bb46e19f888b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:26:24.563983 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:24.563836    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61046999-767d-4760-a862-bb46e19f888b-kube-api-access-2rb6h" (OuterVolumeSpecName: "kube-api-access-2rb6h") pod "61046999-767d-4760-a862-bb46e19f888b" (UID: "61046999-767d-4760-a862-bb46e19f888b"). InnerVolumeSpecName "kube-api-access-2rb6h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:26:24.564382 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:24.564361    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/61046999-767d-4760-a862-bb46e19f888b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "61046999-767d-4760-a862-bb46e19f888b" (UID: "61046999-767d-4760-a862-bb46e19f888b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 02:26:24.564382 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:24.564370    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "61046999-767d-4760-a862-bb46e19f888b" (UID: "61046999-767d-4760-a862-bb46e19f888b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:26:24.663036 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:24.663000    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61046999-767d-4760-a862-bb46e19f888b-istio-token\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:26:24.663036 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:24.663028    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rb6h\" (UniqueName: \"kubernetes.io/projected/61046999-767d-4760-a862-bb46e19f888b-kube-api-access-2rb6h\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:26:24.663036 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:24.663038    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61046999-767d-4760-a862-bb46e19f888b-istio-podinfo\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:26:24.663036 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:24.663046    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-credential-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:26:24.663307 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:24.663055    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-istio-data\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:26:24.663307 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:24.663063    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61046999-767d-4760-a862-bb46e19f888b-istiod-ca-cert\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:26:24.663307 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:24.663071    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61046999-767d-4760-a862-bb46e19f888b-istio-envoy\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:26:25.061773 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:25.061742    2571 generic.go:356] "Generic (PLEG): container finished" podID="61046999-767d-4760-a862-bb46e19f888b" containerID="2359f7c5d408b4b8255754298fb54a41bb70c326bb98a0795e3970b90c4dc533" exitCode=0
Jul 31 02:26:25.061973 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:25.061791    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"
Jul 31 02:26:25.061973 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:25.061807    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz" event={"ID":"61046999-767d-4760-a862-bb46e19f888b","Type":"ContainerDied","Data":"2359f7c5d408b4b8255754298fb54a41bb70c326bb98a0795e3970b90c4dc533"}
Jul 31 02:26:25.061973 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:25.061849    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz" event={"ID":"61046999-767d-4760-a862-bb46e19f888b","Type":"ContainerDied","Data":"bb555c251fe58372a3cafbecbd80983faa0befc9630ae9b036ea8b13f1e599e7"}
Jul 31 02:26:25.061973 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:25.061871    2571 scope.go:117] "RemoveContainer" containerID="2359f7c5d408b4b8255754298fb54a41bb70c326bb98a0795e3970b90c4dc533"
Jul 31 02:26:25.071768 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:25.071751    2571 scope.go:117] "RemoveContainer" containerID="7544c056d92a7eaaf83399253667c4a63cab4d68993af04c798860eefc561cc3"
Jul 31 02:26:25.079941 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:25.079924    2571 scope.go:117] "RemoveContainer" containerID="2359f7c5d408b4b8255754298fb54a41bb70c326bb98a0795e3970b90c4dc533"
Jul 31 02:26:25.080208 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:26:25.080184    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2359f7c5d408b4b8255754298fb54a41bb70c326bb98a0795e3970b90c4dc533\": container with ID starting with 2359f7c5d408b4b8255754298fb54a41bb70c326bb98a0795e3970b90c4dc533 not found: ID does not exist" containerID="2359f7c5d408b4b8255754298fb54a41bb70c326bb98a0795e3970b90c4dc533"
Jul 31 02:26:25.080308 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:25.080214    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2359f7c5d408b4b8255754298fb54a41bb70c326bb98a0795e3970b90c4dc533"} err="failed to get container status \"2359f7c5d408b4b8255754298fb54a41bb70c326bb98a0795e3970b90c4dc533\": rpc error: code = NotFound desc = could not find container \"2359f7c5d408b4b8255754298fb54a41bb70c326bb98a0795e3970b90c4dc533\": container with ID starting with 2359f7c5d408b4b8255754298fb54a41bb70c326bb98a0795e3970b90c4dc533 not found: ID does not exist"
Jul 31 02:26:25.080308 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:25.080231    2571 scope.go:117] "RemoveContainer" containerID="7544c056d92a7eaaf83399253667c4a63cab4d68993af04c798860eefc561cc3"
Jul 31 02:26:25.080473 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:26:25.080454    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7544c056d92a7eaaf83399253667c4a63cab4d68993af04c798860eefc561cc3\": container with ID starting with 7544c056d92a7eaaf83399253667c4a63cab4d68993af04c798860eefc561cc3 not found: ID does not exist" containerID="7544c056d92a7eaaf83399253667c4a63cab4d68993af04c798860eefc561cc3"
Jul 31 02:26:25.080528 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:25.080483    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7544c056d92a7eaaf83399253667c4a63cab4d68993af04c798860eefc561cc3"} err="failed to get container status \"7544c056d92a7eaaf83399253667c4a63cab4d68993af04c798860eefc561cc3\": rpc error: code = NotFound desc = could not find container \"7544c056d92a7eaaf83399253667c4a63cab4d68993af04c798860eefc561cc3\": container with ID starting with 7544c056d92a7eaaf83399253667c4a63cab4d68993af04c798860eefc561cc3 not found: ID does not exist"
Jul 31 02:26:25.083489 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:25.083466    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"]
Jul 31 02:26:25.089080 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:25.089059    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-bf4f62-openshift-default-5dbbf9d896-wjmrz"]
Jul 31 02:26:25.992633 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:25.992604    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61046999-767d-4760-a862-bb46e19f888b" path="/var/lib/kubelet/pods/61046999-767d-4760-a862-bb46e19f888b/volumes"
Jul 31 02:26:41.762272 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:41.762187    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"]
Jul 31 02:26:41.762710 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:41.762448    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv" podUID="c7abb446-58b6-463d-b2f4-34cd550fe739" containerName="istio-proxy" containerID="cri-o://c948f8a1cf114016ddbc6cd8f0c7c922996e8ce987dd0d0e3d3cbfa3c8e2d547" gracePeriod=30
Jul 31 02:26:42.652448 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.652408    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"]
Jul 31 02:26:42.653112 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.653093    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfef6406-4bba-492b-96ea-9e589921efe3" containerName="revoke-keys"
Jul 31 02:26:42.653112 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.653112    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfef6406-4bba-492b-96ea-9e589921efe3" containerName="revoke-keys"
Jul 31 02:26:42.653311 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.653124    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61046999-767d-4760-a862-bb46e19f888b" containerName="istio-proxy"
Jul 31 02:26:42.653311 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.653133    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="61046999-767d-4760-a862-bb46e19f888b" containerName="istio-proxy"
Jul 31 02:26:42.653311 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.653244    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="61046999-767d-4760-a862-bb46e19f888b" containerName="istio-proxy"
Jul 31 02:26:42.653311 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.653256    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="61046999-767d-4760-a862-bb46e19f888b" containerName="istio-proxy"
Jul 31 02:26:42.653311 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.653267    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfef6406-4bba-492b-96ea-9e589921efe3" containerName="revoke-keys"
Jul 31 02:26:42.656592 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.656571    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:42.659168 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.659144    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-2aed0b-openshift-default-dockercfg-sf9dm\""
Jul 31 02:26:42.664438 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.664414    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"]
Jul 31 02:26:42.743445 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.743409    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc26e864-72db-4d61-a0c3-f9345a28c014-istio-token\") pod \"e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") " pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:42.743445 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.743447    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-workload-certs\") pod \"e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") " pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:42.743671 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.743488    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-workload-socket\") pod \"e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") " pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:42.743671 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.743534    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc26e864-72db-4d61-a0c3-f9345a28c014-istio-podinfo\") pod \"e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") " pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:42.743671 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.743577    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-credential-socket\") pod \"e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") " pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:42.743671 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.743604    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-istio-data\") pod \"e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") " pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:42.743671 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.743629    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc26e864-72db-4d61-a0c3-f9345a28c014-istiod-ca-cert\") pod \"e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") " pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:42.743671 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.743653    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-istio-envoy\") pod \"e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") " pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:42.744040 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.743679    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-565qf\" (UniqueName: \"kubernetes.io/projected/fc26e864-72db-4d61-a0c3-f9345a28c014-kube-api-access-565qf\") pod \"e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") " pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:42.844852 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.844814    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-credential-socket\") pod \"e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") " pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:42.845360 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.844868    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-istio-data\") pod \"e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") " pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:42.845360 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.844922    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc26e864-72db-4d61-a0c3-f9345a28c014-istiod-ca-cert\") pod \"e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") " pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:42.845659 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.845417    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-credential-socket\") pod \"e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") " pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:42.845909 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.845875    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-istio-data\") pod \"e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") " pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:42.846018 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.845964    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-istio-envoy\") pod \"e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") " pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:42.846018 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.845969    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc26e864-72db-4d61-a0c3-f9345a28c014-istiod-ca-cert\") pod \"e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") " pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:42.846018 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.846013    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-565qf\" (UniqueName: \"kubernetes.io/projected/fc26e864-72db-4d61-a0c3-f9345a28c014-kube-api-access-565qf\") pod \"e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") " pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:42.846188 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.846140    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc26e864-72db-4d61-a0c3-f9345a28c014-istio-token\") pod \"e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") " pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:42.846188 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.846165    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-workload-certs\") pod \"e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") " pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:42.846298 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.846204    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-workload-socket\") pod \"e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") " pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:42.846298 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.846255    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc26e864-72db-4d61-a0c3-f9345a28c014-istio-podinfo\") pod \"e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") " pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:42.846669 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.846643    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-workload-certs\") pod \"e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") " pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:42.847057 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.847032    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-workload-socket\") pod \"e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") " pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:42.849852 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.849826    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-istio-envoy\") pod \"e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") " pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:42.849989 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.849922    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc26e864-72db-4d61-a0c3-f9345a28c014-istio-podinfo\") pod \"e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") " pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:42.854243 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.854162    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-565qf\" (UniqueName: \"kubernetes.io/projected/fc26e864-72db-4d61-a0c3-f9345a28c014-kube-api-access-565qf\") pod \"e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") " pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:42.854243 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.854237    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc26e864-72db-4d61-a0c3-f9345a28c014-istio-token\") pod \"e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") " pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:42.969486 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:42.969406    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:43.110664 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:43.110635    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"]
Jul 31 02:26:43.112148 ip-10-0-133-91 kubenswrapper[2571]: W0731 02:26:43.112122    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc26e864_72db_4d61_a0c3_f9345a28c014.slice/crio-4fbe3d4d4e9147a9121c4a24fc04800231a26aefe04454cb51edac0a023e9ab7 WatchSource:0}: Error finding container 4fbe3d4d4e9147a9121c4a24fc04800231a26aefe04454cb51edac0a023e9ab7: Status 404 returned error can't find the container with id 4fbe3d4d4e9147a9121c4a24fc04800231a26aefe04454cb51edac0a023e9ab7
Jul 31 02:26:43.114460 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:43.114418    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:26:43.114563 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:43.114486    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:26:43.114563 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:43.114515    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:26:43.160065 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:43.160035    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll" event={"ID":"fc26e864-72db-4d61-a0c3-f9345a28c014","Type":"ContainerStarted","Data":"4fbe3d4d4e9147a9121c4a24fc04800231a26aefe04454cb51edac0a023e9ab7"}
Jul 31 02:26:44.167567 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:44.167531    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll" event={"ID":"fc26e864-72db-4d61-a0c3-f9345a28c014","Type":"ContainerStarted","Data":"c341f31561a4644643a1b205ee1783130596484a12cc18c69c662ca2c545bedb"}
Jul 31 02:26:44.187208 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:44.187164    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll" podStartSLOduration=2.1871493 podStartE2EDuration="2.1871493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:26:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:26:44.185873508 +0000 UTC m=+2964.766114516" watchObservedRunningTime="2026-07-31 02:26:44.1871493 +0000 UTC m=+2964.767390305"
Jul 31 02:26:44.969935 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:44.969885    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:44.974831 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:44.974808    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:45.173571 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:45.173544    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:45.174536 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:45.174517    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:26:47.020836 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.020810    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:26:47.189464 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.189424    2571 generic.go:356] "Generic (PLEG): container finished" podID="c7abb446-58b6-463d-b2f4-34cd550fe739" containerID="c948f8a1cf114016ddbc6cd8f0c7c922996e8ce987dd0d0e3d3cbfa3c8e2d547" exitCode=0
Jul 31 02:26:47.189685 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.189481    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"
Jul 31 02:26:47.189685 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.189513    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv" event={"ID":"c7abb446-58b6-463d-b2f4-34cd550fe739","Type":"ContainerDied","Data":"c948f8a1cf114016ddbc6cd8f0c7c922996e8ce987dd0d0e3d3cbfa3c8e2d547"}
Jul 31 02:26:47.189685 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.189598    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv" event={"ID":"c7abb446-58b6-463d-b2f4-34cd550fe739","Type":"ContainerDied","Data":"a8e8f751921dd799af0465e81bdd479ed829049230e19adbbda4fe7741768180"}
Jul 31 02:26:47.189685 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.189641    2571 scope.go:117] "RemoveContainer" containerID="c948f8a1cf114016ddbc6cd8f0c7c922996e8ce987dd0d0e3d3cbfa3c8e2d547"
Jul 31 02:26:47.191883 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.191862    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-workload-socket\") pod \"c7abb446-58b6-463d-b2f4-34cd550fe739\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") "
Jul 31 02:26:47.191999 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.191911    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7abb446-58b6-463d-b2f4-34cd550fe739-istio-token\") pod \"c7abb446-58b6-463d-b2f4-34cd550fe739\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") "
Jul 31 02:26:47.191999 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.191972    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-credential-socket\") pod \"c7abb446-58b6-463d-b2f4-34cd550fe739\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") "
Jul 31 02:26:47.191999 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.191987    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpcgq\" (UniqueName: \"kubernetes.io/projected/c7abb446-58b6-463d-b2f4-34cd550fe739-kube-api-access-zpcgq\") pod \"c7abb446-58b6-463d-b2f4-34cd550fe739\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") "
Jul 31 02:26:47.192152 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.192016    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-istio-data\") pod \"c7abb446-58b6-463d-b2f4-34cd550fe739\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") "
Jul 31 02:26:47.192152 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.192051    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-istio-envoy\") pod \"c7abb446-58b6-463d-b2f4-34cd550fe739\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") "
Jul 31 02:26:47.192152 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.192073    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7abb446-58b6-463d-b2f4-34cd550fe739-istio-podinfo\") pod \"c7abb446-58b6-463d-b2f4-34cd550fe739\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") "
Jul 31 02:26:47.192152 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.192099    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7abb446-58b6-463d-b2f4-34cd550fe739-istiod-ca-cert\") pod \"c7abb446-58b6-463d-b2f4-34cd550fe739\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") "
Jul 31 02:26:47.192152 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.192100    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c7abb446-58b6-463d-b2f4-34cd550fe739" (UID: "c7abb446-58b6-463d-b2f4-34cd550fe739"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:26:47.192444 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.192168    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-workload-certs\") pod \"c7abb446-58b6-463d-b2f4-34cd550fe739\" (UID: \"c7abb446-58b6-463d-b2f4-34cd550fe739\") "
Jul 31 02:26:47.192444 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.192295    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c7abb446-58b6-463d-b2f4-34cd550fe739" (UID: "c7abb446-58b6-463d-b2f4-34cd550fe739"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:26:47.192621 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.192566    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-workload-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:26:47.192621 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.192585    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-credential-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:26:47.192734 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.192670    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c7abb446-58b6-463d-b2f4-34cd550fe739" (UID: "c7abb446-58b6-463d-b2f4-34cd550fe739"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:26:47.192796 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.192732    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-istio-data" (OuterVolumeSpecName: "istio-data") pod "c7abb446-58b6-463d-b2f4-34cd550fe739" (UID: "c7abb446-58b6-463d-b2f4-34cd550fe739"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:26:47.193062 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.193033    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7abb446-58b6-463d-b2f4-34cd550fe739-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c7abb446-58b6-463d-b2f4-34cd550fe739" (UID: "c7abb446-58b6-463d-b2f4-34cd550fe739"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 02:26:47.194373 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.194348    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c7abb446-58b6-463d-b2f4-34cd550fe739" (UID: "c7abb446-58b6-463d-b2f4-34cd550fe739"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:26:47.194508 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.194477    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7abb446-58b6-463d-b2f4-34cd550fe739-kube-api-access-zpcgq" (OuterVolumeSpecName: "kube-api-access-zpcgq") pod "c7abb446-58b6-463d-b2f4-34cd550fe739" (UID: "c7abb446-58b6-463d-b2f4-34cd550fe739"). InnerVolumeSpecName "kube-api-access-zpcgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:26:47.194588 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.194508    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7abb446-58b6-463d-b2f4-34cd550fe739-istio-token" (OuterVolumeSpecName: "istio-token") pod "c7abb446-58b6-463d-b2f4-34cd550fe739" (UID: "c7abb446-58b6-463d-b2f4-34cd550fe739"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:26:47.194867 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.194845    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c7abb446-58b6-463d-b2f4-34cd550fe739-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c7abb446-58b6-463d-b2f4-34cd550fe739" (UID: "c7abb446-58b6-463d-b2f4-34cd550fe739"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 02:26:47.216334 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.216308    2571 scope.go:117] "RemoveContainer" containerID="450ba47c279a3ebb9197ab1e0dd86f5969c8559f355adf9469776baa59f34d66"
Jul 31 02:26:47.224727 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.224709    2571 scope.go:117] "RemoveContainer" containerID="c948f8a1cf114016ddbc6cd8f0c7c922996e8ce987dd0d0e3d3cbfa3c8e2d547"
Jul 31 02:26:47.225015 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:26:47.224990    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c948f8a1cf114016ddbc6cd8f0c7c922996e8ce987dd0d0e3d3cbfa3c8e2d547\": container with ID starting with c948f8a1cf114016ddbc6cd8f0c7c922996e8ce987dd0d0e3d3cbfa3c8e2d547 not found: ID does not exist" containerID="c948f8a1cf114016ddbc6cd8f0c7c922996e8ce987dd0d0e3d3cbfa3c8e2d547"
Jul 31 02:26:47.225078 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.225026    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c948f8a1cf114016ddbc6cd8f0c7c922996e8ce987dd0d0e3d3cbfa3c8e2d547"} err="failed to get container status \"c948f8a1cf114016ddbc6cd8f0c7c922996e8ce987dd0d0e3d3cbfa3c8e2d547\": rpc error: code = NotFound desc = could not find container \"c948f8a1cf114016ddbc6cd8f0c7c922996e8ce987dd0d0e3d3cbfa3c8e2d547\": container with ID starting with c948f8a1cf114016ddbc6cd8f0c7c922996e8ce987dd0d0e3d3cbfa3c8e2d547 not found: ID does not exist"
Jul 31 02:26:47.225078 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.225045    2571 scope.go:117] "RemoveContainer" containerID="450ba47c279a3ebb9197ab1e0dd86f5969c8559f355adf9469776baa59f34d66"
Jul 31 02:26:47.225286 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:26:47.225268    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"450ba47c279a3ebb9197ab1e0dd86f5969c8559f355adf9469776baa59f34d66\": container with ID starting with 450ba47c279a3ebb9197ab1e0dd86f5969c8559f355adf9469776baa59f34d66 not found: ID does not exist" containerID="450ba47c279a3ebb9197ab1e0dd86f5969c8559f355adf9469776baa59f34d66"
Jul 31 02:26:47.225339 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.225291    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"450ba47c279a3ebb9197ab1e0dd86f5969c8559f355adf9469776baa59f34d66"} err="failed to get container status \"450ba47c279a3ebb9197ab1e0dd86f5969c8559f355adf9469776baa59f34d66\": rpc error: code = NotFound desc = could not find container \"450ba47c279a3ebb9197ab1e0dd86f5969c8559f355adf9469776baa59f34d66\": container with ID starting with 450ba47c279a3ebb9197ab1e0dd86f5969c8559f355adf9469776baa59f34d66 not found: ID does not exist"
Jul 31 02:26:47.294081 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.294046    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7abb446-58b6-463d-b2f4-34cd550fe739-istio-token\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:26:47.294081 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.294077    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpcgq\" (UniqueName: \"kubernetes.io/projected/c7abb446-58b6-463d-b2f4-34cd550fe739-kube-api-access-zpcgq\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:26:47.294081 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.294091    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-istio-data\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:26:47.294328 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.294104    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-istio-envoy\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:26:47.294328 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.294116    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7abb446-58b6-463d-b2f4-34cd550fe739-istio-podinfo\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:26:47.294328 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.294130    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7abb446-58b6-463d-b2f4-34cd550fe739-istiod-ca-cert\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:26:47.294328 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.294141    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7abb446-58b6-463d-b2f4-34cd550fe739-workload-certs\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:26:47.519259 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.519226    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"]
Jul 31 02:26:47.521386 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.521360    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-ba3761-openshift-default-6797d4f5bb-mqrcv"]
Jul 31 02:26:47.993779 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:26:47.993747    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7abb446-58b6-463d-b2f4-34cd550fe739" path="/var/lib/kubelet/pods/c7abb446-58b6-463d-b2f4-34cd550fe739/volumes"
Jul 31 02:27:00.175168 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:00.175131    2571 patch_prober.go:28] interesting pod/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 31 02:27:00.175592 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:00.175195    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll" podUID="fc26e864-72db-4d61-a0c3-f9345a28c014" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 31 02:27:00.268131 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:00.268097    2571 generic.go:356] "Generic (PLEG): container finished" podID="fc26e864-72db-4d61-a0c3-f9345a28c014" containerID="c341f31561a4644643a1b205ee1783130596484a12cc18c69c662ca2c545bedb" exitCode=0
Jul 31 02:27:00.268311 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:00.268169    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll" event={"ID":"fc26e864-72db-4d61-a0c3-f9345a28c014","Type":"ContainerDied","Data":"c341f31561a4644643a1b205ee1783130596484a12cc18c69c662ca2c545bedb"}
Jul 31 02:27:00.268576 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:00.268562    2571 scope.go:117] "RemoveContainer" containerID="c341f31561a4644643a1b205ee1783130596484a12cc18c69c662ca2c545bedb"
Jul 31 02:27:00.269694 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:00.269665    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:27:00.269772 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:00.269758    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:27:00.269808 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:00.269795    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:27:01.276577 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:01.276548    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll" event={"ID":"fc26e864-72db-4d61-a0c3-f9345a28c014","Type":"ContainerStarted","Data":"38c89bce6b911eed3e8d994328f08c72230049f498fb82c7f6d11d79b2349c98"}
Jul 31 02:27:01.969722 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:01.969683    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:27:01.969959 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:01.969937    2571 patch_prober.go:28] interesting pod/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 31 02:27:01.970015 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:01.969988    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll" podUID="fc26e864-72db-4d61-a0c3-f9345a28c014" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 31 02:27:02.970680 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:02.970640    2571 patch_prober.go:28] interesting pod/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 31 02:27:02.971127 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:02.970697    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll" podUID="fc26e864-72db-4d61-a0c3-f9345a28c014" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 31 02:27:03.970513 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:03.970477    2571 patch_prober.go:28] interesting pod/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 31 02:27:03.970696 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:03.970575    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll" podUID="fc26e864-72db-4d61-a0c3-f9345a28c014" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 31 02:27:04.970034 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:04.970002    2571 patch_prober.go:28] interesting pod/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 31 02:27:04.970516 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:04.970062    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll" podUID="fc26e864-72db-4d61-a0c3-f9345a28c014" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 31 02:27:05.970001 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:05.969963    2571 patch_prober.go:28] interesting pod/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 31 02:27:05.970190 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:05.970030    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll" podUID="fc26e864-72db-4d61-a0c3-f9345a28c014" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 31 02:27:06.974056 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:06.974020    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:27:06.974470 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:06.974404    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:27:06.975137 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:06.975121    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:27:11.951006 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:11.950973    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"]
Jul 31 02:27:11.951447 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:11.951434    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7abb446-58b6-463d-b2f4-34cd550fe739" containerName="istio-proxy"
Jul 31 02:27:11.951495 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:11.951449    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7abb446-58b6-463d-b2f4-34cd550fe739" containerName="istio-proxy"
Jul 31 02:27:11.951495 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:11.951466    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61046999-767d-4760-a862-bb46e19f888b" containerName="istio-proxy"
Jul 31 02:27:11.951495 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:11.951473    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="61046999-767d-4760-a862-bb46e19f888b" containerName="istio-proxy"
Jul 31 02:27:11.951594 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:11.951546    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7abb446-58b6-463d-b2f4-34cd550fe739" containerName="istio-proxy"
Jul 31 02:27:11.951594 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:11.951556    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7abb446-58b6-463d-b2f4-34cd550fe739" containerName="istio-proxy"
Jul 31 02:27:11.953943 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:11.953918    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:11.956544 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:11.956524    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-01a44c-openshift-default-dockercfg-jzd8r\""
Jul 31 02:27:11.965520 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:11.965494    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"]
Jul 31 02:27:12.050669 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.050630    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-credential-socket\") pod \"e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") " pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:12.050855 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.050715    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istiod-ca-cert\") pod \"e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") " pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:12.050855 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.050760    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istio-data\") pod \"e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") " pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:12.050855 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.050842    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istio-token\") pod \"e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") " pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:12.051009 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.050902    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-workload-socket\") pod \"e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") " pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:12.051009 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.050962    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istio-envoy\") pod \"e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") " pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:12.051009 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.050990    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istio-podinfo\") pod \"e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") " pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:12.051113 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.051028    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thr49\" (UniqueName: \"kubernetes.io/projected/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-kube-api-access-thr49\") pod \"e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") " pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:12.051113 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.051052    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-workload-certs\") pod \"e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") " pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:12.152221 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.152188    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thr49\" (UniqueName: \"kubernetes.io/projected/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-kube-api-access-thr49\") pod \"e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") " pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:12.152425 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.152230    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-workload-certs\") pod \"e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") " pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:12.152425 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.152390    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-credential-socket\") pod \"e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") " pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:12.152555 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.152467    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istiod-ca-cert\") pod \"e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") " pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:12.152555 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.152535    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istio-data\") pod \"e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") " pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:12.152698 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.152588    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istio-token\") pod \"e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") " pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:12.152698 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.152627    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-workload-certs\") pod \"e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") " pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:12.152698 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.152648    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-workload-socket\") pod \"e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") " pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:12.152698 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.152692    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istio-envoy\") pod \"e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") " pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:12.152831 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.152717    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istio-podinfo\") pod \"e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") " pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:12.152831 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.152775    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-credential-socket\") pod \"e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") " pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:12.152924 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.152835    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istio-data\") pod \"e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") " pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:12.153058 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.153038    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-workload-socket\") pod \"e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") " pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:12.153228 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.153209    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istiod-ca-cert\") pod \"e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") " pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:12.155038 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.155008    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istio-envoy\") pod \"e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") " pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:12.155142 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.155105    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istio-podinfo\") pod \"e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") " pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:12.162694 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.162665    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istio-token\") pod \"e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") " pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:12.162812 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.162793    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thr49\" (UniqueName: \"kubernetes.io/projected/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-kube-api-access-thr49\") pod \"e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") " pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:12.266489 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.266390    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:12.411949 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.411924    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"]
Jul 31 02:27:12.413255 ip-10-0-133-91 kubenswrapper[2571]: W0731 02:27:12.413232    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaef9f3f_e9e6_4c74_b13c_49fc743af9d9.slice/crio-173de716d185b26baec5a8db52008e76c90b576d99dfb3117e659f1bb5714782 WatchSource:0}: Error finding container 173de716d185b26baec5a8db52008e76c90b576d99dfb3117e659f1bb5714782: Status 404 returned error can't find the container with id 173de716d185b26baec5a8db52008e76c90b576d99dfb3117e659f1bb5714782
Jul 31 02:27:12.415763 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.415731    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:27:12.415842 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.415804    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:27:12.415842 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:12.415833    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:27:13.343156 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:13.343126    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z" event={"ID":"daef9f3f-e9e6-4c74-b13c-49fc743af9d9","Type":"ContainerStarted","Data":"258776a95241b1e3e2c612761a693dbec4d34ba80380d7d9b9739c082b1eccfe"}
Jul 31 02:27:13.343577 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:13.343181    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z" event={"ID":"daef9f3f-e9e6-4c74-b13c-49fc743af9d9","Type":"ContainerStarted","Data":"173de716d185b26baec5a8db52008e76c90b576d99dfb3117e659f1bb5714782"}
Jul 31 02:27:13.363730 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:13.363675    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z" podStartSLOduration=2.363657438 podStartE2EDuration="2.363657438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:27:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:27:13.362701095 +0000 UTC m=+2993.942942091" watchObservedRunningTime="2026-07-31 02:27:13.363657438 +0000 UTC m=+2993.943898432"
Jul 31 02:27:14.267288 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:14.267252    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:14.272294 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:14.272268    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:14.349248 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:14.349216    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:14.350707 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:14.350688    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:29.350794 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:29.350759    2571 patch_prober.go:28] interesting pod/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 31 02:27:29.351241 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:29.350827    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z" podUID="daef9f3f-e9e6-4c74-b13c-49fc743af9d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 31 02:27:29.443103 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:29.443073    2571 generic.go:356] "Generic (PLEG): container finished" podID="daef9f3f-e9e6-4c74-b13c-49fc743af9d9" containerID="258776a95241b1e3e2c612761a693dbec4d34ba80380d7d9b9739c082b1eccfe" exitCode=0
Jul 31 02:27:29.443290 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:29.443148    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z" event={"ID":"daef9f3f-e9e6-4c74-b13c-49fc743af9d9","Type":"ContainerDied","Data":"258776a95241b1e3e2c612761a693dbec4d34ba80380d7d9b9739c082b1eccfe"}
Jul 31 02:27:29.443630 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:29.443616    2571 scope.go:117] "RemoveContainer" containerID="258776a95241b1e3e2c612761a693dbec4d34ba80380d7d9b9739c082b1eccfe"
Jul 31 02:27:29.444791 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:29.444767    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:27:29.444862 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:29.444830    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:27:29.444949 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:29.444863    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:27:30.454728 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:30.454686    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z" event={"ID":"daef9f3f-e9e6-4c74-b13c-49fc743af9d9","Type":"ContainerStarted","Data":"49e026809179c6233c19d1a380d405c017436ceecc06ac1148e9e8c50863359f"}
Jul 31 02:27:31.267561 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:31.267524    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:31.267816 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:31.267793    2571 patch_prober.go:28] interesting pod/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 31 02:27:31.267861 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:31.267844    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z" podUID="daef9f3f-e9e6-4c74-b13c-49fc743af9d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 31 02:27:32.267712 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:32.267681    2571 patch_prober.go:28] interesting pod/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 31 02:27:32.268135 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:32.267737    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z" podUID="daef9f3f-e9e6-4c74-b13c-49fc743af9d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 31 02:27:33.267386 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:33.267350    2571 patch_prober.go:28] interesting pod/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 31 02:27:33.267578 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:33.267418    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z" podUID="daef9f3f-e9e6-4c74-b13c-49fc743af9d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 31 02:27:34.267290 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:34.267247    2571 patch_prober.go:28] interesting pod/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 31 02:27:34.267775 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:34.267315    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z" podUID="daef9f3f-e9e6-4c74-b13c-49fc743af9d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 31 02:27:35.267801 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:35.267765    2571 patch_prober.go:28] interesting pod/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 31 02:27:35.268241 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:35.267835    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z" podUID="daef9f3f-e9e6-4c74-b13c-49fc743af9d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 31 02:27:36.271126 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:36.271098    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:36.271610 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:36.271593    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:27:36.272310 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:27:36.272291    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:32:20.327497 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:32:20.327463    2571 scope.go:117] "RemoveContainer" containerID="dc4527586a64fa10dcfd392131295f2353b180dfe080ee38412f274ee15aea5f"
Jul 31 02:35:11.104881 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:11.104846    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7267-140354370391088"]
Jul 31 02:35:11.105396 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:11.105272    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7abb446-58b6-463d-b2f4-34cd550fe739" containerName="istio-proxy"
Jul 31 02:35:11.105396 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:11.105283    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7abb446-58b6-463d-b2f4-34cd550fe739" containerName="istio-proxy"
Jul 31 02:35:11.108456 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:11.108441    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7267-140354370391088"
Jul 31 02:35:11.110978 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:11.110886    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-kbd7c\""
Jul 31 02:35:11.112776 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:11.112748    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7267-140354370391088"]
Jul 31 02:35:11.258940 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:11.258874    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frztq\" (UniqueName: \"kubernetes.io/projected/9b30a520-ff8e-4605-8512-84634abe9fea-kube-api-access-frztq\") pod \"test-curl-7267-140354370391088\" (UID: \"9b30a520-ff8e-4605-8512-84634abe9fea\") " pod="opendatahub/test-curl-7267-140354370391088"
Jul 31 02:35:11.359875 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:11.359783    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frztq\" (UniqueName: \"kubernetes.io/projected/9b30a520-ff8e-4605-8512-84634abe9fea-kube-api-access-frztq\") pod \"test-curl-7267-140354370391088\" (UID: \"9b30a520-ff8e-4605-8512-84634abe9fea\") " pod="opendatahub/test-curl-7267-140354370391088"
Jul 31 02:35:11.367664 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:11.367639    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frztq\" (UniqueName: \"kubernetes.io/projected/9b30a520-ff8e-4605-8512-84634abe9fea-kube-api-access-frztq\") pod \"test-curl-7267-140354370391088\" (UID: \"9b30a520-ff8e-4605-8512-84634abe9fea\") " pod="opendatahub/test-curl-7267-140354370391088"
Jul 31 02:35:11.419278 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:11.419248    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7267-140354370391088"
Jul 31 02:35:11.553834 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:11.553810    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7267-140354370391088"]
Jul 31 02:35:11.555792 ip-10-0-133-91 kubenswrapper[2571]: W0731 02:35:11.555769    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b30a520_ff8e_4605_8512_84634abe9fea.slice/crio-f5d35fe2eb6ab21a3e6b1a93cc8d1d1a89a05545c4bd4581d16a966b89259662 WatchSource:0}: Error finding container f5d35fe2eb6ab21a3e6b1a93cc8d1d1a89a05545c4bd4581d16a966b89259662: Status 404 returned error can't find the container with id f5d35fe2eb6ab21a3e6b1a93cc8d1d1a89a05545c4bd4581d16a966b89259662
Jul 31 02:35:11.557164 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:11.557148    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 02:35:12.027676 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:12.027643    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7267-140354370391088" event={"ID":"9b30a520-ff8e-4605-8512-84634abe9fea","Type":"ContainerStarted","Data":"f5d35fe2eb6ab21a3e6b1a93cc8d1d1a89a05545c4bd4581d16a966b89259662"}
Jul 31 02:35:13.034616 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:13.034579    2571 generic.go:356] "Generic (PLEG): container finished" podID="9b30a520-ff8e-4605-8512-84634abe9fea" containerID="f17d41a0a9d13cdc3f0d72063e6a11bf1759b86b4bfbbb0aca4e911a55d47371" exitCode=0
Jul 31 02:35:13.035049 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:13.034648    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7267-140354370391088" event={"ID":"9b30a520-ff8e-4605-8512-84634abe9fea","Type":"ContainerDied","Data":"f17d41a0a9d13cdc3f0d72063e6a11bf1759b86b4bfbbb0aca4e911a55d47371"}
Jul 31 02:35:14.184733 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:14.184708    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7267-140354370391088"
Jul 31 02:35:14.218220 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:14.218191    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7267-140354370391088_9b30a520-ff8e-4605-8512-84634abe9fea/test-curl-7267-140354370391088/0.log"
Jul 31 02:35:14.241055 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:14.241023    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7267-140354370391088"]
Jul 31 02:35:14.244208 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:14.244181    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7267-140354370391088"]
Jul 31 02:35:14.291738 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:14.291645    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frztq\" (UniqueName: \"kubernetes.io/projected/9b30a520-ff8e-4605-8512-84634abe9fea-kube-api-access-frztq\") pod \"9b30a520-ff8e-4605-8512-84634abe9fea\" (UID: \"9b30a520-ff8e-4605-8512-84634abe9fea\") "
Jul 31 02:35:14.293983 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:14.293953    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b30a520-ff8e-4605-8512-84634abe9fea-kube-api-access-frztq" (OuterVolumeSpecName: "kube-api-access-frztq") pod "9b30a520-ff8e-4605-8512-84634abe9fea" (UID: "9b30a520-ff8e-4605-8512-84634abe9fea"). InnerVolumeSpecName "kube-api-access-frztq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:35:14.375641 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:14.375609    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7267-140354370364080"]
Jul 31 02:35:14.376140 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:14.376124    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b30a520-ff8e-4605-8512-84634abe9fea" containerName="test-curl-7267-140354370391088"
Jul 31 02:35:14.376209 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:14.376142    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b30a520-ff8e-4605-8512-84634abe9fea" containerName="test-curl-7267-140354370391088"
Jul 31 02:35:14.376246 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:14.376216    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b30a520-ff8e-4605-8512-84634abe9fea" containerName="test-curl-7267-140354370391088"
Jul 31 02:35:14.379560 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:14.379534    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7267-140354370364080"
Jul 31 02:35:14.382962 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:14.382935    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7267-140354370364080"]
Jul 31 02:35:14.392770 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:14.392744    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frztq\" (UniqueName: \"kubernetes.io/projected/9b30a520-ff8e-4605-8512-84634abe9fea-kube-api-access-frztq\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:35:14.493712 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:14.493678    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d49sg\" (UniqueName: \"kubernetes.io/projected/3315c69d-f815-494e-814e-b634fccbc24b-kube-api-access-d49sg\") pod \"test-curl-7267-140354370364080\" (UID: \"3315c69d-f815-494e-814e-b634fccbc24b\") " pod="opendatahub/test-curl-7267-140354370364080"
Jul 31 02:35:14.594253 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:14.594224    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d49sg\" (UniqueName: \"kubernetes.io/projected/3315c69d-f815-494e-814e-b634fccbc24b-kube-api-access-d49sg\") pod \"test-curl-7267-140354370364080\" (UID: \"3315c69d-f815-494e-814e-b634fccbc24b\") " pod="opendatahub/test-curl-7267-140354370364080"
Jul 31 02:35:14.602953 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:14.602929    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d49sg\" (UniqueName: \"kubernetes.io/projected/3315c69d-f815-494e-814e-b634fccbc24b-kube-api-access-d49sg\") pod \"test-curl-7267-140354370364080\" (UID: \"3315c69d-f815-494e-814e-b634fccbc24b\") " pod="opendatahub/test-curl-7267-140354370364080"
Jul 31 02:35:14.690760 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:14.690725    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7267-140354370364080"
Jul 31 02:35:14.833677 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:14.833653    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7267-140354370364080"]
Jul 31 02:35:14.835871 ip-10-0-133-91 kubenswrapper[2571]: W0731 02:35:14.835846    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3315c69d_f815_494e_814e_b634fccbc24b.slice/crio-d6c28836380b455fb262d73a12356cc50125511f4f37a34bfccda9527dc65f4e WatchSource:0}: Error finding container d6c28836380b455fb262d73a12356cc50125511f4f37a34bfccda9527dc65f4e: Status 404 returned error can't find the container with id d6c28836380b455fb262d73a12356cc50125511f4f37a34bfccda9527dc65f4e
Jul 31 02:35:15.048583 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:15.048543    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7267-140354370364080" event={"ID":"3315c69d-f815-494e-814e-b634fccbc24b","Type":"ContainerStarted","Data":"d6c28836380b455fb262d73a12356cc50125511f4f37a34bfccda9527dc65f4e"}
Jul 31 02:35:15.049734 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:15.049719    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5d35fe2eb6ab21a3e6b1a93cc8d1d1a89a05545c4bd4581d16a966b89259662"
Jul 31 02:35:15.049827 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:15.049752    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7267-140354370391088"
Jul 31 02:35:15.060730 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:35:15.060702    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7267-140354370391088\" is forbidden: User \"system:node:ip-10-0-133-91.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-91.ec2.internal' and this object" podUID="9b30a520-ff8e-4605-8512-84634abe9fea" pod="opendatahub/test-curl-7267-140354370391088"
Jul 31 02:35:15.992354 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:15.992324    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b30a520-ff8e-4605-8512-84634abe9fea" path="/var/lib/kubelet/pods/9b30a520-ff8e-4605-8512-84634abe9fea/volumes"
Jul 31 02:35:16.056716 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:16.056683    2571 generic.go:356] "Generic (PLEG): container finished" podID="3315c69d-f815-494e-814e-b634fccbc24b" containerID="aa60a3482eb983dcf2050522a29dca600f84120e51bde031fbf2297114bd6561" exitCode=0
Jul 31 02:35:16.056946 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:16.056773    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7267-140354370364080" event={"ID":"3315c69d-f815-494e-814e-b634fccbc24b","Type":"ContainerDied","Data":"aa60a3482eb983dcf2050522a29dca600f84120e51bde031fbf2297114bd6561"}
Jul 31 02:35:17.205719 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:17.205692    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7267-140354370364080"
Jul 31 02:35:17.226179 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:17.226136    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7267-140354370364080_3315c69d-f815-494e-814e-b634fccbc24b/test-curl-7267-140354370364080/0.log"
Jul 31 02:35:17.247969 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:17.247937    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7267-140354370364080"]
Jul 31 02:35:17.250740 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:17.250720    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7267-140354370364080"]
Jul 31 02:35:17.322331 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:17.322237    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d49sg\" (UniqueName: \"kubernetes.io/projected/3315c69d-f815-494e-814e-b634fccbc24b-kube-api-access-d49sg\") pod \"3315c69d-f815-494e-814e-b634fccbc24b\" (UID: \"3315c69d-f815-494e-814e-b634fccbc24b\") "
Jul 31 02:35:17.324341 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:17.324313    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3315c69d-f815-494e-814e-b634fccbc24b-kube-api-access-d49sg" (OuterVolumeSpecName: "kube-api-access-d49sg") pod "3315c69d-f815-494e-814e-b634fccbc24b" (UID: "3315c69d-f815-494e-814e-b634fccbc24b"). InnerVolumeSpecName "kube-api-access-d49sg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:35:17.411841 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:17.411806    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7267-140354370509968"]
Jul 31 02:35:17.412378 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:17.412359    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3315c69d-f815-494e-814e-b634fccbc24b" containerName="test-curl-7267-140354370364080"
Jul 31 02:35:17.412483 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:17.412379    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3315c69d-f815-494e-814e-b634fccbc24b" containerName="test-curl-7267-140354370364080"
Jul 31 02:35:17.412534 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:17.412495    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="3315c69d-f815-494e-814e-b634fccbc24b" containerName="test-curl-7267-140354370364080"
Jul 31 02:35:17.415622 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:17.415601    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7267-140354370509968"
Jul 31 02:35:17.421252 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:17.421231    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7267-140354370509968"]
Jul 31 02:35:17.423991 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:17.423697    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d49sg\" (UniqueName: \"kubernetes.io/projected/3315c69d-f815-494e-814e-b634fccbc24b-kube-api-access-d49sg\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:35:17.525336 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:17.525303    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rhsn\" (UniqueName: \"kubernetes.io/projected/70d70a55-3df8-4aca-af62-eaffaba35eb4-kube-api-access-4rhsn\") pod \"test-curl-7267-140354370509968\" (UID: \"70d70a55-3df8-4aca-af62-eaffaba35eb4\") " pod="opendatahub/test-curl-7267-140354370509968"
Jul 31 02:35:17.626814 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:17.626757    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rhsn\" (UniqueName: \"kubernetes.io/projected/70d70a55-3df8-4aca-af62-eaffaba35eb4-kube-api-access-4rhsn\") pod \"test-curl-7267-140354370509968\" (UID: \"70d70a55-3df8-4aca-af62-eaffaba35eb4\") " pod="opendatahub/test-curl-7267-140354370509968"
Jul 31 02:35:17.636228 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:17.636198    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rhsn\" (UniqueName: \"kubernetes.io/projected/70d70a55-3df8-4aca-af62-eaffaba35eb4-kube-api-access-4rhsn\") pod \"test-curl-7267-140354370509968\" (UID: \"70d70a55-3df8-4aca-af62-eaffaba35eb4\") " pod="opendatahub/test-curl-7267-140354370509968"
Jul 31 02:35:17.727055 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:17.727012    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7267-140354370509968"
Jul 31 02:35:17.866578 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:17.866546    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7267-140354370509968"]
Jul 31 02:35:17.868344 ip-10-0-133-91 kubenswrapper[2571]: W0731 02:35:17.868318    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70d70a55_3df8_4aca_af62_eaffaba35eb4.slice/crio-3187a14955054aac49d07d7c44c958ba2ee27bb7da659c1b2904ae06751b25b4 WatchSource:0}: Error finding container 3187a14955054aac49d07d7c44c958ba2ee27bb7da659c1b2904ae06751b25b4: Status 404 returned error can't find the container with id 3187a14955054aac49d07d7c44c958ba2ee27bb7da659c1b2904ae06751b25b4
Jul 31 02:35:17.994048 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:17.994006    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3315c69d-f815-494e-814e-b634fccbc24b" path="/var/lib/kubelet/pods/3315c69d-f815-494e-814e-b634fccbc24b/volumes"
Jul 31 02:35:18.069345 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:18.069320    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7267-140354370364080"
Jul 31 02:35:18.069345 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:18.069335    2571 scope.go:117] "RemoveContainer" containerID="aa60a3482eb983dcf2050522a29dca600f84120e51bde031fbf2297114bd6561"
Jul 31 02:35:18.070863 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:18.070824    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7267-140354370509968" event={"ID":"70d70a55-3df8-4aca-af62-eaffaba35eb4","Type":"ContainerStarted","Data":"3187a14955054aac49d07d7c44c958ba2ee27bb7da659c1b2904ae06751b25b4"}
Jul 31 02:35:19.078976 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:19.078947    2571 generic.go:356] "Generic (PLEG): container finished" podID="70d70a55-3df8-4aca-af62-eaffaba35eb4" containerID="0e1e1ec9232cb0b722563b4e57515323b7f518b311eaa9e6aa79472e71df7ca3" exitCode=0
Jul 31 02:35:19.079330 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:19.078987    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7267-140354370509968" event={"ID":"70d70a55-3df8-4aca-af62-eaffaba35eb4","Type":"ContainerDied","Data":"0e1e1ec9232cb0b722563b4e57515323b7f518b311eaa9e6aa79472e71df7ca3"}
Jul 31 02:35:20.224283 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:20.224256    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7267-140354370509968"
Jul 31 02:35:20.244798 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:20.244713    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7267-140354370509968_70d70a55-3df8-4aca-af62-eaffaba35eb4/test-curl-7267-140354370509968/0.log"
Jul 31 02:35:20.265773 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:20.265745    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7267-140354370509968"]
Jul 31 02:35:20.270579 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:20.270548    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7267-140354370509968"]
Jul 31 02:35:20.354012 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:20.353985    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rhsn\" (UniqueName: \"kubernetes.io/projected/70d70a55-3df8-4aca-af62-eaffaba35eb4-kube-api-access-4rhsn\") pod \"70d70a55-3df8-4aca-af62-eaffaba35eb4\" (UID: \"70d70a55-3df8-4aca-af62-eaffaba35eb4\") "
Jul 31 02:35:20.356090 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:20.356060    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70d70a55-3df8-4aca-af62-eaffaba35eb4-kube-api-access-4rhsn" (OuterVolumeSpecName: "kube-api-access-4rhsn") pod "70d70a55-3df8-4aca-af62-eaffaba35eb4" (UID: "70d70a55-3df8-4aca-af62-eaffaba35eb4"). InnerVolumeSpecName "kube-api-access-4rhsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:35:20.397838 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:20.397806    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7267-140354370509968"]
Jul 31 02:35:20.398306 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:20.398291    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70d70a55-3df8-4aca-af62-eaffaba35eb4" containerName="test-curl-7267-140354370509968"
Jul 31 02:35:20.398351 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:20.398308    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="70d70a55-3df8-4aca-af62-eaffaba35eb4" containerName="test-curl-7267-140354370509968"
Jul 31 02:35:20.398406 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:20.398396    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="70d70a55-3df8-4aca-af62-eaffaba35eb4" containerName="test-curl-7267-140354370509968"
Jul 31 02:35:20.402771 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:20.402754    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7267-140354370509968"
Jul 31 02:35:20.406755 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:20.406731    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7267-140354370509968"]
Jul 31 02:35:20.455549 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:20.455515    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rhsn\" (UniqueName: \"kubernetes.io/projected/70d70a55-3df8-4aca-af62-eaffaba35eb4-kube-api-access-4rhsn\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:35:20.557075 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:20.557037    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mqfh\" (UniqueName: \"kubernetes.io/projected/21aaa7d3-c80b-4006-b782-1b1369d37c70-kube-api-access-9mqfh\") pod \"test-curl-7267-140354370509968\" (UID: \"21aaa7d3-c80b-4006-b782-1b1369d37c70\") " pod="opendatahub/test-curl-7267-140354370509968"
Jul 31 02:35:20.658119 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:20.658017    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mqfh\" (UniqueName: \"kubernetes.io/projected/21aaa7d3-c80b-4006-b782-1b1369d37c70-kube-api-access-9mqfh\") pod \"test-curl-7267-140354370509968\" (UID: \"21aaa7d3-c80b-4006-b782-1b1369d37c70\") " pod="opendatahub/test-curl-7267-140354370509968"
Jul 31 02:35:20.666613 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:20.666586    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mqfh\" (UniqueName: \"kubernetes.io/projected/21aaa7d3-c80b-4006-b782-1b1369d37c70-kube-api-access-9mqfh\") pod \"test-curl-7267-140354370509968\" (UID: \"21aaa7d3-c80b-4006-b782-1b1369d37c70\") " pod="opendatahub/test-curl-7267-140354370509968"
Jul 31 02:35:20.715559 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:20.715522    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7267-140354370509968"
Jul 31 02:35:20.855025 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:20.854996    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7267-140354370509968"]
Jul 31 02:35:20.857056 ip-10-0-133-91 kubenswrapper[2571]: W0731 02:35:20.857031    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21aaa7d3_c80b_4006_b782_1b1369d37c70.slice/crio-ec1f6bd36b6098aaa80f853abebb329deafb7fada7605ce41d43b31f188ea47f WatchSource:0}: Error finding container ec1f6bd36b6098aaa80f853abebb329deafb7fada7605ce41d43b31f188ea47f: Status 404 returned error can't find the container with id ec1f6bd36b6098aaa80f853abebb329deafb7fada7605ce41d43b31f188ea47f
Jul 31 02:35:21.090350 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:21.090255    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7267-140354370509968" event={"ID":"21aaa7d3-c80b-4006-b782-1b1369d37c70","Type":"ContainerStarted","Data":"ec1f6bd36b6098aaa80f853abebb329deafb7fada7605ce41d43b31f188ea47f"}
Jul 31 02:35:21.091523 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:21.091503    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3187a14955054aac49d07d7c44c958ba2ee27bb7da659c1b2904ae06751b25b4"
Jul 31 02:35:21.091632 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:21.091528    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7267-140354370509968"
Jul 31 02:35:21.102658 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:21.102630    2571 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7267-140354370509968" oldPodUID="70d70a55-3df8-4aca-af62-eaffaba35eb4" podUID="21aaa7d3-c80b-4006-b782-1b1369d37c70"
Jul 31 02:35:21.993044 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:21.993012    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70d70a55-3df8-4aca-af62-eaffaba35eb4" path="/var/lib/kubelet/pods/70d70a55-3df8-4aca-af62-eaffaba35eb4/volumes"
Jul 31 02:35:22.098732 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:22.098699    2571 generic.go:356] "Generic (PLEG): container finished" podID="21aaa7d3-c80b-4006-b782-1b1369d37c70" containerID="d22363ead48cb8db683906a9355b55815bcf57cc6866351424a6e783f0548232" exitCode=0
Jul 31 02:35:22.098931 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:22.098789    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7267-140354370509968" event={"ID":"21aaa7d3-c80b-4006-b782-1b1369d37c70","Type":"ContainerDied","Data":"d22363ead48cb8db683906a9355b55815bcf57cc6866351424a6e783f0548232"}
Jul 31 02:35:23.246080 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:23.246056    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7267-140354370509968"
Jul 31 02:35:23.266276 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:23.266250    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7267-140354370509968_21aaa7d3-c80b-4006-b782-1b1369d37c70/test-curl-7267-140354370509968/0.log"
Jul 31 02:35:23.290056 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:23.290022    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7267-140354370509968"]
Jul 31 02:35:23.292234 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:23.292215    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7267-140354370509968"]
Jul 31 02:35:23.387162 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:23.387069    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mqfh\" (UniqueName: \"kubernetes.io/projected/21aaa7d3-c80b-4006-b782-1b1369d37c70-kube-api-access-9mqfh\") pod \"21aaa7d3-c80b-4006-b782-1b1369d37c70\" (UID: \"21aaa7d3-c80b-4006-b782-1b1369d37c70\") "
Jul 31 02:35:23.389143 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:23.389118    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21aaa7d3-c80b-4006-b782-1b1369d37c70-kube-api-access-9mqfh" (OuterVolumeSpecName: "kube-api-access-9mqfh") pod "21aaa7d3-c80b-4006-b782-1b1369d37c70" (UID: "21aaa7d3-c80b-4006-b782-1b1369d37c70"). InnerVolumeSpecName "kube-api-access-9mqfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:35:23.426355 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:23.426322    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7267-140354370437168"]
Jul 31 02:35:23.426751 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:23.426738    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21aaa7d3-c80b-4006-b782-1b1369d37c70" containerName="test-curl-7267-140354370509968"
Jul 31 02:35:23.426829 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:23.426752    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="21aaa7d3-c80b-4006-b782-1b1369d37c70" containerName="test-curl-7267-140354370509968"
Jul 31 02:35:23.426878 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:23.426850    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="21aaa7d3-c80b-4006-b782-1b1369d37c70" containerName="test-curl-7267-140354370509968"
Jul 31 02:35:23.429790 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:23.429775    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7267-140354370437168"
Jul 31 02:35:23.435788 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:23.435758    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7267-140354370437168"]
Jul 31 02:35:23.488840 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:23.488810    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6x28\" (UniqueName: \"kubernetes.io/projected/576c954c-2947-411a-8475-5de0f99d95b6-kube-api-access-l6x28\") pod \"test-curl-7267-140354370437168\" (UID: \"576c954c-2947-411a-8475-5de0f99d95b6\") " pod="opendatahub/test-curl-7267-140354370437168"
Jul 31 02:35:23.489037 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:23.488857    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mqfh\" (UniqueName: \"kubernetes.io/projected/21aaa7d3-c80b-4006-b782-1b1369d37c70-kube-api-access-9mqfh\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:35:23.589835 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:23.589801    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6x28\" (UniqueName: \"kubernetes.io/projected/576c954c-2947-411a-8475-5de0f99d95b6-kube-api-access-l6x28\") pod \"test-curl-7267-140354370437168\" (UID: \"576c954c-2947-411a-8475-5de0f99d95b6\") " pod="opendatahub/test-curl-7267-140354370437168"
Jul 31 02:35:23.598093 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:23.598062    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6x28\" (UniqueName: \"kubernetes.io/projected/576c954c-2947-411a-8475-5de0f99d95b6-kube-api-access-l6x28\") pod \"test-curl-7267-140354370437168\" (UID: \"576c954c-2947-411a-8475-5de0f99d95b6\") " pod="opendatahub/test-curl-7267-140354370437168"
Jul 31 02:35:23.741007 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:23.740917    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7267-140354370437168"
Jul 31 02:35:23.876334 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:23.876308    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7267-140354370437168"]
Jul 31 02:35:23.877880 ip-10-0-133-91 kubenswrapper[2571]: W0731 02:35:23.877854    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod576c954c_2947_411a_8475_5de0f99d95b6.slice/crio-3425fada95db2d22af721a07a0e26b731b9b503fcd85b4a9ad11b0c339d4d969 WatchSource:0}: Error finding container 3425fada95db2d22af721a07a0e26b731b9b503fcd85b4a9ad11b0c339d4d969: Status 404 returned error can't find the container with id 3425fada95db2d22af721a07a0e26b731b9b503fcd85b4a9ad11b0c339d4d969
Jul 31 02:35:23.992870 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:23.992788    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21aaa7d3-c80b-4006-b782-1b1369d37c70" path="/var/lib/kubelet/pods/21aaa7d3-c80b-4006-b782-1b1369d37c70/volumes"
Jul 31 02:35:24.110388 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:24.110351    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7267-140354370509968"
Jul 31 02:35:24.110553 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:24.110397    2571 scope.go:117] "RemoveContainer" containerID="d22363ead48cb8db683906a9355b55815bcf57cc6866351424a6e783f0548232"
Jul 31 02:35:24.111816 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:24.111785    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7267-140354370437168" event={"ID":"576c954c-2947-411a-8475-5de0f99d95b6","Type":"ContainerStarted","Data":"3425fada95db2d22af721a07a0e26b731b9b503fcd85b4a9ad11b0c339d4d969"}
Jul 31 02:35:25.119853 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:25.119823    2571 generic.go:356] "Generic (PLEG): container finished" podID="576c954c-2947-411a-8475-5de0f99d95b6" containerID="5209c6f1f34da93efa1fd31bf116d6653f372086d849439493e487b2b388ed42" exitCode=0
Jul 31 02:35:25.120401 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:25.119921    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7267-140354370437168" event={"ID":"576c954c-2947-411a-8475-5de0f99d95b6","Type":"ContainerDied","Data":"5209c6f1f34da93efa1fd31bf116d6653f372086d849439493e487b2b388ed42"}
Jul 31 02:35:26.260687 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:26.260663    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7267-140354370437168"
Jul 31 02:35:26.280168 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:26.280139    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7267-140354370437168_576c954c-2947-411a-8475-5de0f99d95b6/test-curl-7267-140354370437168/0.log"
Jul 31 02:35:26.304463 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:26.304435    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7267-140354370437168"]
Jul 31 02:35:26.306366 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:26.306343    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7267-140354370437168"]
Jul 31 02:35:26.311338 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:26.311317    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6x28\" (UniqueName: \"kubernetes.io/projected/576c954c-2947-411a-8475-5de0f99d95b6-kube-api-access-l6x28\") pod \"576c954c-2947-411a-8475-5de0f99d95b6\" (UID: \"576c954c-2947-411a-8475-5de0f99d95b6\") "
Jul 31 02:35:26.313372 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:26.313353    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/576c954c-2947-411a-8475-5de0f99d95b6-kube-api-access-l6x28" (OuterVolumeSpecName: "kube-api-access-l6x28") pod "576c954c-2947-411a-8475-5de0f99d95b6" (UID: "576c954c-2947-411a-8475-5de0f99d95b6"). InnerVolumeSpecName "kube-api-access-l6x28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:35:26.412091 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:26.412007    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6x28\" (UniqueName: \"kubernetes.io/projected/576c954c-2947-411a-8475-5de0f99d95b6-kube-api-access-l6x28\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:35:26.434958 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:26.434923    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7267-140354370437168"]
Jul 31 02:35:26.435371 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:26.435357    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="576c954c-2947-411a-8475-5de0f99d95b6" containerName="test-curl-7267-140354370437168"
Jul 31 02:35:26.435411 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:26.435374    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="576c954c-2947-411a-8475-5de0f99d95b6" containerName="test-curl-7267-140354370437168"
Jul 31 02:35:26.435460 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:26.435452    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="576c954c-2947-411a-8475-5de0f99d95b6" containerName="test-curl-7267-140354370437168"
Jul 31 02:35:26.438549 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:26.438514    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7267-140354370437168"
Jul 31 02:35:26.442432 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:26.442408    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7267-140354370437168"]
Jul 31 02:35:26.513381 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:26.513348    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r5bf\" (UniqueName: \"kubernetes.io/projected/f1bb34c0-84e4-4445-b7f4-a8afec748685-kube-api-access-9r5bf\") pod \"test-curl-7267-140354370437168\" (UID: \"f1bb34c0-84e4-4445-b7f4-a8afec748685\") " pod="opendatahub/test-curl-7267-140354370437168"
Jul 31 02:35:26.614314 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:26.614281    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r5bf\" (UniqueName: \"kubernetes.io/projected/f1bb34c0-84e4-4445-b7f4-a8afec748685-kube-api-access-9r5bf\") pod \"test-curl-7267-140354370437168\" (UID: \"f1bb34c0-84e4-4445-b7f4-a8afec748685\") " pod="opendatahub/test-curl-7267-140354370437168"
Jul 31 02:35:26.623014 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:26.622988    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r5bf\" (UniqueName: \"kubernetes.io/projected/f1bb34c0-84e4-4445-b7f4-a8afec748685-kube-api-access-9r5bf\") pod \"test-curl-7267-140354370437168\" (UID: \"f1bb34c0-84e4-4445-b7f4-a8afec748685\") " pod="opendatahub/test-curl-7267-140354370437168"
Jul 31 02:35:26.749804 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:26.749712    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7267-140354370437168"
Jul 31 02:35:26.882976 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:26.882945    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7267-140354370437168"]
Jul 31 02:35:26.884261 ip-10-0-133-91 kubenswrapper[2571]: W0731 02:35:26.884239    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1bb34c0_84e4_4445_b7f4_a8afec748685.slice/crio-917b2785fbd16806106c74b3b41e88c6eb9e0bbbc6447d64a3d9e506ea025cb3 WatchSource:0}: Error finding container 917b2785fbd16806106c74b3b41e88c6eb9e0bbbc6447d64a3d9e506ea025cb3: Status 404 returned error can't find the container with id 917b2785fbd16806106c74b3b41e88c6eb9e0bbbc6447d64a3d9e506ea025cb3
Jul 31 02:35:27.131862 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:27.131828    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7267-140354370437168" event={"ID":"f1bb34c0-84e4-4445-b7f4-a8afec748685","Type":"ContainerStarted","Data":"917b2785fbd16806106c74b3b41e88c6eb9e0bbbc6447d64a3d9e506ea025cb3"}
Jul 31 02:35:27.133091 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:27.133073    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3425fada95db2d22af721a07a0e26b731b9b503fcd85b4a9ad11b0c339d4d969"
Jul 31 02:35:27.133091 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:27.133086    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7267-140354370437168"
Jul 31 02:35:27.144533 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:27.144508    2571 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7267-140354370437168" oldPodUID="576c954c-2947-411a-8475-5de0f99d95b6" podUID="f1bb34c0-84e4-4445-b7f4-a8afec748685"
Jul 31 02:35:27.993120 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:27.993088    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="576c954c-2947-411a-8475-5de0f99d95b6" path="/var/lib/kubelet/pods/576c954c-2947-411a-8475-5de0f99d95b6/volumes"
Jul 31 02:35:28.139585 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:28.139550    2571 generic.go:356] "Generic (PLEG): container finished" podID="f1bb34c0-84e4-4445-b7f4-a8afec748685" containerID="8cd44f0f039ee39e0852c2ac7c49f8c6edeecab750ff201d49ee38ae2cacab10" exitCode=0
Jul 31 02:35:28.139760 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:28.139635    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7267-140354370437168" event={"ID":"f1bb34c0-84e4-4445-b7f4-a8afec748685","Type":"ContainerDied","Data":"8cd44f0f039ee39e0852c2ac7c49f8c6edeecab750ff201d49ee38ae2cacab10"}
Jul 31 02:35:29.289519 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:29.289497    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7267-140354370437168"
Jul 31 02:35:29.309537 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:29.309501    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7267-140354370437168_f1bb34c0-84e4-4445-b7f4-a8afec748685/test-curl-7267-140354370437168/0.log"
Jul 31 02:35:29.332251 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:29.332211    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7267-140354370437168"]
Jul 31 02:35:29.335674 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:29.335646    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7267-140354370437168"]
Jul 31 02:35:29.341911 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:29.341876    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9r5bf\" (UniqueName: \"kubernetes.io/projected/f1bb34c0-84e4-4445-b7f4-a8afec748685-kube-api-access-9r5bf\") pod \"f1bb34c0-84e4-4445-b7f4-a8afec748685\" (UID: \"f1bb34c0-84e4-4445-b7f4-a8afec748685\") "
Jul 31 02:35:29.343878 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:29.343857    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1bb34c0-84e4-4445-b7f4-a8afec748685-kube-api-access-9r5bf" (OuterVolumeSpecName: "kube-api-access-9r5bf") pod "f1bb34c0-84e4-4445-b7f4-a8afec748685" (UID: "f1bb34c0-84e4-4445-b7f4-a8afec748685"). InnerVolumeSpecName "kube-api-access-9r5bf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:35:29.442779 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:29.442685    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9r5bf\" (UniqueName: \"kubernetes.io/projected/f1bb34c0-84e4-4445-b7f4-a8afec748685-kube-api-access-9r5bf\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:35:29.992741 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:29.992706    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1bb34c0-84e4-4445-b7f4-a8afec748685" path="/var/lib/kubelet/pods/f1bb34c0-84e4-4445-b7f4-a8afec748685/volumes"
Jul 31 02:35:30.132833 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.132800    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"]
Jul 31 02:35:30.133411 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.133388    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1bb34c0-84e4-4445-b7f4-a8afec748685" containerName="test-curl-7267-140354370437168"
Jul 31 02:35:30.133411 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.133409    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1bb34c0-84e4-4445-b7f4-a8afec748685" containerName="test-curl-7267-140354370437168"
Jul 31 02:35:30.133699 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.133486    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1bb34c0-84e4-4445-b7f4-a8afec748685" containerName="test-curl-7267-140354370437168"
Jul 31 02:35:30.136963 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.136939    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.140174 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.140151    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-e0efa5-openshift-default-dockercfg-fk7jp\""
Jul 31 02:35:30.149180 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.149152    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istio-token\") pod \"e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") " pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.149301 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.149217    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istiod-ca-cert\") pod \"e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") " pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.149301 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.149265    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-credential-socket\") pod \"e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") " pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.149419 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.149328    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-workload-certs\") pod \"e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") " pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.149419 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.149361    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqmsz\" (UniqueName: \"kubernetes.io/projected/1f55bc7d-5432-45dc-a132-5e5e1bc50619-kube-api-access-pqmsz\") pod \"e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") " pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.149521 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.149431    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-workload-socket\") pod \"e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") " pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.149521 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.149454    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istio-podinfo\") pod \"e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") " pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.149521 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.149509    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istio-envoy\") pod \"e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") " pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.149694 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.149533    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istio-data\") pod \"e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") " pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.150763 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.150733    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"]
Jul 31 02:35:30.153483 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.153465    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7267-140354370437168"
Jul 31 02:35:30.153586 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.153570    2571 scope.go:117] "RemoveContainer" containerID="8cd44f0f039ee39e0852c2ac7c49f8c6edeecab750ff201d49ee38ae2cacab10"
Jul 31 02:35:30.251268 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.251157    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-credential-socket\") pod \"e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") " pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.251268 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.251232    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-workload-certs\") pod \"e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") " pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.251511 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.251270    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqmsz\" (UniqueName: \"kubernetes.io/projected/1f55bc7d-5432-45dc-a132-5e5e1bc50619-kube-api-access-pqmsz\") pod \"e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") " pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.251511 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.251341    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-workload-socket\") pod \"e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") " pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.251511 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.251367    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istio-podinfo\") pod \"e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") " pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.251511 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.251425    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istio-envoy\") pod \"e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") " pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.251716 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.251448    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istio-data\") pod \"e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") " pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.251772 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.251728    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-workload-certs\") pod \"e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") " pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.251963 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.251799    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-credential-socket\") pod \"e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") " pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.251963 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.251881    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-workload-socket\") pod \"e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") " pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.251963 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.251889    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istio-token\") pod \"e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") " pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.252115 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.252000    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istiod-ca-cert\") pod \"e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") " pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.252115 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.252103    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istio-data\") pod \"e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") " pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.252741 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.252719    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istiod-ca-cert\") pod \"e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") " pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.254539 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.254517    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istio-envoy\") pod \"e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") " pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.254663 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.254550    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istio-podinfo\") pod \"e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") " pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.260369 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.260337    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istio-token\") pod \"e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") " pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.260535 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.260517    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqmsz\" (UniqueName: \"kubernetes.io/projected/1f55bc7d-5432-45dc-a132-5e5e1bc50619-kube-api-access-pqmsz\") pod \"e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") " pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.451715 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.451677    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:30.600615 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.600589    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"]
Jul 31 02:35:30.601882 ip-10-0-133-91 kubenswrapper[2571]: W0731 02:35:30.601855    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f55bc7d_5432_45dc_a132_5e5e1bc50619.slice/crio-c7f258ff729da645c1adaca9d6d149ccac9cf4c280793ce6d9ef56ea59beb585 WatchSource:0}: Error finding container c7f258ff729da645c1adaca9d6d149ccac9cf4c280793ce6d9ef56ea59beb585: Status 404 returned error can't find the container with id c7f258ff729da645c1adaca9d6d149ccac9cf4c280793ce6d9ef56ea59beb585
Jul 31 02:35:30.604175 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.604138    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:35:30.604251 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.604223    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:35:30.604298 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:30.604266    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:35:31.161797 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:31.161763    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2" event={"ID":"1f55bc7d-5432-45dc-a132-5e5e1bc50619","Type":"ContainerStarted","Data":"d6866f0579749d361f6ffb26ec9163b4f677bb86c1deb7f5960026f737c6bf39"}
Jul 31 02:35:31.162023 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:31.161821    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2" event={"ID":"1f55bc7d-5432-45dc-a132-5e5e1bc50619","Type":"ContainerStarted","Data":"c7f258ff729da645c1adaca9d6d149ccac9cf4c280793ce6d9ef56ea59beb585"}
Jul 31 02:35:31.186609 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:31.186492    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2" podStartSLOduration=1.186472972 podStartE2EDuration="1.186472972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:35:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:35:31.182518361 +0000 UTC m=+3491.762759369" watchObservedRunningTime="2026-07-31 02:35:31.186472972 +0000 UTC m=+3491.766713968"
Jul 31 02:35:31.451885 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:31.451804    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:31.457482 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:31.457460    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:32.170636 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:32.170601    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:32.171636 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:32.171616    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:47.172868 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:47.172828    2571 patch_prober.go:28] interesting pod/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 31 02:35:47.173330 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:47.172922    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2" podUID="1f55bc7d-5432-45dc-a132-5e5e1bc50619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 31 02:35:47.259674 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:47.259642    2571 generic.go:356] "Generic (PLEG): container finished" podID="1f55bc7d-5432-45dc-a132-5e5e1bc50619" containerID="d6866f0579749d361f6ffb26ec9163b4f677bb86c1deb7f5960026f737c6bf39" exitCode=0
Jul 31 02:35:47.259854 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:47.259715    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2" event={"ID":"1f55bc7d-5432-45dc-a132-5e5e1bc50619","Type":"ContainerDied","Data":"d6866f0579749d361f6ffb26ec9163b4f677bb86c1deb7f5960026f737c6bf39"}
Jul 31 02:35:47.260198 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:47.260184    2571 scope.go:117] "RemoveContainer" containerID="d6866f0579749d361f6ffb26ec9163b4f677bb86c1deb7f5960026f737c6bf39"
Jul 31 02:35:47.261277 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:47.261252    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:35:47.261345 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:47.261321    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:35:47.261389 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:47.261358    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:35:48.268327 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:48.268297    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2" event={"ID":"1f55bc7d-5432-45dc-a132-5e5e1bc50619","Type":"ContainerStarted","Data":"ff13ba7dafd2611f41213de3c226a64f6886f241d17d3c577b26f1ff399d54c8"}
Jul 31 02:35:48.453201 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:48.453163    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:48.453660 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:48.453510    2571 patch_prober.go:28] interesting pod/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 31 02:35:48.454540 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:48.454508    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2" podUID="1f55bc7d-5432-45dc-a132-5e5e1bc50619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 31 02:35:49.452918 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:49.452870    2571 patch_prober.go:28] interesting pod/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 31 02:35:49.453963 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:49.453927    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2" podUID="1f55bc7d-5432-45dc-a132-5e5e1bc50619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 31 02:35:50.453078 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:50.453040    2571 patch_prober.go:28] interesting pod/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 31 02:35:50.453720 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:50.453689    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2" podUID="1f55bc7d-5432-45dc-a132-5e5e1bc50619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 31 02:35:51.452272 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:51.452227    2571 patch_prober.go:28] interesting pod/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 31 02:35:51.452504 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:51.452297    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2" podUID="1f55bc7d-5432-45dc-a132-5e5e1bc50619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 31 02:35:52.452493 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:52.452451    2571 patch_prober.go:28] interesting pod/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 31 02:35:52.453031 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:52.452524    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2" podUID="1f55bc7d-5432-45dc-a132-5e5e1bc50619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 31 02:35:53.453148 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:53.453104    2571 patch_prober.go:28] interesting pod/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 31 02:35:53.453556 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:53.453194    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2" podUID="1f55bc7d-5432-45dc-a132-5e5e1bc50619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 31 02:35:54.457009 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:54.456978    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:54.457470 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:54.457272    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:54.458063 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:54.458048    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:35:59.213133 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.212628    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"]
Jul 31 02:35:59.217832 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.217808    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.225236 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.225020    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-3dc29c-openshift-default-dockercfg-4h282\""
Jul 31 02:35:59.243212 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.243178    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"]
Jul 31 02:35:59.265686 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.265654    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istiod-ca-cert\") pod \"e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") " pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.265686 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.265700    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-credential-socket\") pod \"e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") " pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.265914 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.265715    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istio-envoy\") pod \"e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") " pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.265914 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.265762    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istio-data\") pod \"e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") " pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.265914 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.265783    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-workload-certs\") pod \"e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") " pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.265914 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.265809    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istio-podinfo\") pod \"e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") " pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.265914 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.265832    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-workload-socket\") pod \"e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") " pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.266084 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.265946    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istio-token\") pod \"e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") " pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.266084 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.265987    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knz8w\" (UniqueName: \"kubernetes.io/projected/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-kube-api-access-knz8w\") pod \"e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") " pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.366511 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.366476    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-credential-socket\") pod \"e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") " pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.366716 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.366526    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istio-envoy\") pod \"e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") " pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.366716 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.366569    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istio-data\") pod \"e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") " pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.366716 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.366602    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-workload-certs\") pod \"e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") " pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.366716 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.366679    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istio-podinfo\") pod \"e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") " pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.366970 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.366730    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-workload-socket\") pod \"e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") " pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.366970 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.366797    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istio-token\") pod \"e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") " pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.366970 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.366849    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knz8w\" (UniqueName: \"kubernetes.io/projected/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-kube-api-access-knz8w\") pod \"e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") " pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.366970 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.366954    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-credential-socket\") pod \"e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") " pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.366970 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.366964    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istiod-ca-cert\") pod \"e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") " pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.367228 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.367041    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istio-data\") pod \"e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") " pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.367461 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.367439    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-workload-certs\") pod \"e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") " pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.367561 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.367539    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-workload-socket\") pod \"e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") " pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.367603 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.367583    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istiod-ca-cert\") pod \"e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") " pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.368985 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.368963    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istio-envoy\") pod \"e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") " pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.369179 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.369160    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istio-podinfo\") pod \"e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") " pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.374808 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.374786    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istio-token\") pod \"e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") " pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.375016 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.374998    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knz8w\" (UniqueName: \"kubernetes.io/projected/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-kube-api-access-knz8w\") pod \"e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") " pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.542595 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.542495    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:35:59.684305 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.684276    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"]
Jul 31 02:35:59.685562 ip-10-0-133-91 kubenswrapper[2571]: W0731 02:35:59.685536    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d1ca91f_bd8e_4abb_8611_a7ec15c917db.slice/crio-08e6572abdf91ab5e3d0e041db9964a5a33757ef23862ddc3f39e68e507bc31b WatchSource:0}: Error finding container 08e6572abdf91ab5e3d0e041db9964a5a33757ef23862ddc3f39e68e507bc31b: Status 404 returned error can't find the container with id 08e6572abdf91ab5e3d0e041db9964a5a33757ef23862ddc3f39e68e507bc31b
Jul 31 02:35:59.687925 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.687881    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:35:59.688003 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.687958    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:35:59.688003 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:35:59.687996    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:36:00.337451 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:00.337409    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb" event={"ID":"5d1ca91f-bd8e-4abb-8611-a7ec15c917db","Type":"ContainerStarted","Data":"5d854f07a9ccc9ec3c90467a40def387bc7489eb849ec981d1c5aaec264d7b5c"}
Jul 31 02:36:00.337970 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:00.337475    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb" event={"ID":"5d1ca91f-bd8e-4abb-8611-a7ec15c917db","Type":"ContainerStarted","Data":"08e6572abdf91ab5e3d0e041db9964a5a33757ef23862ddc3f39e68e507bc31b"}
Jul 31 02:36:00.360196 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:00.360142    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb" podStartSLOduration=1.360114874 podStartE2EDuration="1.360114874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:35:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:36:00.358697869 +0000 UTC m=+3520.938938865" watchObservedRunningTime="2026-07-31 02:36:00.360114874 +0000 UTC m=+3520.940355869"
Jul 31 02:36:00.542741 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:00.542706    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:36:00.548395 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:00.548369    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:36:01.343149 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:01.343117    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:36:01.344171 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:01.344154    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:36:16.685071 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:16.685034    2571 patch_prober.go:28] interesting pod/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": read tcp 10.133.0.2:55206->10.133.0.70:15021: read: connection reset by peer" start-of-body=
Jul 31 02:36:16.685541 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:16.685106    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb" podUID="5d1ca91f-bd8e-4abb-8611-a7ec15c917db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": read tcp 10.133.0.2:55206->10.133.0.70:15021: read: connection reset by peer"
Jul 31 02:36:17.438009 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:17.437977    2571 generic.go:356] "Generic (PLEG): container finished" podID="5d1ca91f-bd8e-4abb-8611-a7ec15c917db" containerID="5d854f07a9ccc9ec3c90467a40def387bc7489eb849ec981d1c5aaec264d7b5c" exitCode=0
Jul 31 02:36:17.438203 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:17.438051    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb" event={"ID":"5d1ca91f-bd8e-4abb-8611-a7ec15c917db","Type":"ContainerDied","Data":"5d854f07a9ccc9ec3c90467a40def387bc7489eb849ec981d1c5aaec264d7b5c"}
Jul 31 02:36:17.438493 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:17.438474    2571 scope.go:117] "RemoveContainer" containerID="5d854f07a9ccc9ec3c90467a40def387bc7489eb849ec981d1c5aaec264d7b5c"
Jul 31 02:36:17.439606 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:17.439581    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:36:17.439659 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:17.439646    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:36:17.439700 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:17.439679    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:36:18.450061 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:18.450022    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb" event={"ID":"5d1ca91f-bd8e-4abb-8611-a7ec15c917db","Type":"ContainerStarted","Data":"e27f21639bbe22dc81c9d415216c9ad52625b058828217e3aea89533402c1bc6"}
Jul 31 02:36:18.543829 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:18.543788    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:36:18.544069 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:18.543949    2571 patch_prober.go:28] interesting pod/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 31 02:36:18.544069 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:18.543994    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb" podUID="5d1ca91f-bd8e-4abb-8611-a7ec15c917db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 31 02:36:19.543479 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:19.543439    2571 patch_prober.go:28] interesting pod/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 31 02:36:19.544114 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:19.544081    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb" podUID="5d1ca91f-bd8e-4abb-8611-a7ec15c917db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 31 02:36:20.543084 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:20.543039    2571 patch_prober.go:28] interesting pod/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 31 02:36:20.543297 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:20.543149    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb" podUID="5d1ca91f-bd8e-4abb-8611-a7ec15c917db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 31 02:36:21.543707 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:21.543663    2571 patch_prober.go:28] interesting pod/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 31 02:36:21.544251 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:21.543755    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb" podUID="5d1ca91f-bd8e-4abb-8611-a7ec15c917db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 31 02:36:22.543160 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:22.543110    2571 patch_prober.go:28] interesting pod/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 31 02:36:22.543392 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:22.543197    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb" podUID="5d1ca91f-bd8e-4abb-8611-a7ec15c917db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 31 02:36:23.547525 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:23.547493    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:36:23.548047 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:23.547873    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:36:23.548676 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:36:23.548651    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:37:30.433726 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.433695    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"]
Jul 31 02:37:30.437001 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.436974    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.439792 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.439771    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-9daafd-openshift-default-dockercfg-j6qtz\""
Jul 31 02:37:30.449116 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.449092    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"]
Jul 31 02:37:30.549917 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.549774    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-workload-socket\") pod \"e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") " pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.549917 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.549835    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f2df44a-b5a0-4178-98fb-fa918f644a30-istio-podinfo\") pod \"e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") " pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.549917 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.549918    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-credential-socket\") pod \"e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") " pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.550229 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.550017    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-workload-certs\") pod \"e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") " pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.550229 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.550064    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-istio-data\") pod \"e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") " pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.550229 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.550109    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f2df44a-b5a0-4178-98fb-fa918f644a30-istio-token\") pod \"e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") " pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.550229 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.550163    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-istio-envoy\") pod \"e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") " pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.550449 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.550243    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcss2\" (UniqueName: \"kubernetes.io/projected/1f2df44a-b5a0-4178-98fb-fa918f644a30-kube-api-access-qcss2\") pod \"e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") " pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.550449 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.550274    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f2df44a-b5a0-4178-98fb-fa918f644a30-istiod-ca-cert\") pod \"e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") " pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.651608 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.651567    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-workload-certs\") pod \"e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") " pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.651888 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.651870    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-istio-data\") pod \"e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") " pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.652127 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.652104    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f2df44a-b5a0-4178-98fb-fa918f644a30-istio-token\") pod \"e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") " pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.652262 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.652025    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-workload-certs\") pod \"e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") " pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.652262 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.652156    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-istio-envoy\") pod \"e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") " pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.652262 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.652182    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-istio-data\") pod \"e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") " pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.652262 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.652259    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcss2\" (UniqueName: \"kubernetes.io/projected/1f2df44a-b5a0-4178-98fb-fa918f644a30-kube-api-access-qcss2\") pod \"e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") " pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.652475 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.652282    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f2df44a-b5a0-4178-98fb-fa918f644a30-istiod-ca-cert\") pod \"e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") " pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.652475 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.652335    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-workload-socket\") pod \"e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") " pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.652475 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.652355    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f2df44a-b5a0-4178-98fb-fa918f644a30-istio-podinfo\") pod \"e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") " pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.652475 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.652402    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-credential-socket\") pod \"e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") " pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.652768 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.652749    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-credential-socket\") pod \"e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") " pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.653061 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.653039    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-workload-socket\") pod \"e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") " pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.653193 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.653169    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f2df44a-b5a0-4178-98fb-fa918f644a30-istiod-ca-cert\") pod \"e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") " pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.654700 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.654679    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-istio-envoy\") pod \"e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") " pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.655221 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.655201    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f2df44a-b5a0-4178-98fb-fa918f644a30-istio-podinfo\") pod \"e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") " pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.661096 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.661074    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f2df44a-b5a0-4178-98fb-fa918f644a30-istio-token\") pod \"e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") " pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.661461 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.661441    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcss2\" (UniqueName: \"kubernetes.io/projected/1f2df44a-b5a0-4178-98fb-fa918f644a30-kube-api-access-qcss2\") pod \"e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") " pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.750535 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.750459    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:30.893096 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.893069    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"]
Jul 31 02:37:30.894261 ip-10-0-133-91 kubenswrapper[2571]: W0731 02:37:30.894230    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f2df44a_b5a0_4178_98fb_fa918f644a30.slice/crio-8cc6a354d9ff0e3d91c86507303775e6c20b1255164d5ce40e6273c796c8aa63 WatchSource:0}: Error finding container 8cc6a354d9ff0e3d91c86507303775e6c20b1255164d5ce40e6273c796c8aa63: Status 404 returned error can't find the container with id 8cc6a354d9ff0e3d91c86507303775e6c20b1255164d5ce40e6273c796c8aa63
Jul 31 02:37:30.896446 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.896417    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:37:30.896539 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.896479    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:37:30.896539 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:30.896509    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:37:31.881069 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:31.881035    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r" event={"ID":"1f2df44a-b5a0-4178-98fb-fa918f644a30","Type":"ContainerStarted","Data":"eb3e57fa04c2c8b080a129287db0b35b82b727496e0c22e4529e5cd6fb80fff7"}
Jul 31 02:37:31.881485 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:31.881091    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r" event={"ID":"1f2df44a-b5a0-4178-98fb-fa918f644a30","Type":"ContainerStarted","Data":"8cc6a354d9ff0e3d91c86507303775e6c20b1255164d5ce40e6273c796c8aa63"}
Jul 31 02:37:31.902873 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:31.902824    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r" podStartSLOduration=1.902809127 podStartE2EDuration="1.902809127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:37:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:37:31.899692522 +0000 UTC m=+3612.479933529" watchObservedRunningTime="2026-07-31 02:37:31.902809127 +0000 UTC m=+3612.483050122"
Jul 31 02:37:32.751146 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:32.751108    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:32.756317 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:32.756287    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:32.887062 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:32.887027    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:32.888163 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:32.888144    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:48.929075 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:48.929033    2571 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 31 02:37:48.929502 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:48.929123    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r" podUID="1f2df44a-b5a0-4178-98fb-fa918f644a30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 31 02:37:49.996210 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:49.996178    2571 generic.go:356] "Generic (PLEG): container finished" podID="1f2df44a-b5a0-4178-98fb-fa918f644a30" containerID="eb3e57fa04c2c8b080a129287db0b35b82b727496e0c22e4529e5cd6fb80fff7" exitCode=0
Jul 31 02:37:49.996746 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:49.996235    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r" event={"ID":"1f2df44a-b5a0-4178-98fb-fa918f644a30","Type":"ContainerDied","Data":"eb3e57fa04c2c8b080a129287db0b35b82b727496e0c22e4529e5cd6fb80fff7"}
Jul 31 02:37:49.996746 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:49.996720    2571 scope.go:117] "RemoveContainer" containerID="eb3e57fa04c2c8b080a129287db0b35b82b727496e0c22e4529e5cd6fb80fff7"
Jul 31 02:37:49.997877 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:49.997848    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:37:49.998001 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:49.997943    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:37:49.998001 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:49.997976    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 31 02:37:51.004426 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:51.004391    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r" event={"ID":"1f2df44a-b5a0-4178-98fb-fa918f644a30","Type":"ContainerStarted","Data":"f6677208ee8f6fe4d9b1c86eeb8490ba546393472360fa2d92390033b0af8b92"}
Jul 31 02:37:51.753351 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:51.753317    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:51.753703 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:51.753355    2571 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 31 02:37:51.753927 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:51.753879    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r" podUID="1f2df44a-b5a0-4178-98fb-fa918f644a30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 31 02:37:52.751566 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:52.751518    2571 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 31 02:37:52.752104 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:52.751604    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r" podUID="1f2df44a-b5a0-4178-98fb-fa918f644a30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 31 02:37:53.751633 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:53.751594    2571 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 31 02:37:53.752295 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:53.752263    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r" podUID="1f2df44a-b5a0-4178-98fb-fa918f644a30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 31 02:37:54.751160 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:54.751118    2571 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 31 02:37:54.751388 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:54.751191    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r" podUID="1f2df44a-b5a0-4178-98fb-fa918f644a30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 31 02:37:55.751855 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:55.751804    2571 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 31 02:37:55.752415 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:55.751879    2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r" podUID="1f2df44a-b5a0-4178-98fb-fa918f644a30" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 31 02:37:56.754194 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:56.754163    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:56.754589 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:56.754551    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:37:56.755255 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:37:56.755235    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:38:21.949291 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:21.949252    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"]
Jul 31 02:38:21.949870 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:21.949543    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r" podUID="1f2df44a-b5a0-4178-98fb-fa918f644a30" containerName="istio-proxy" containerID="cri-o://f6677208ee8f6fe4d9b1c86eeb8490ba546393472360fa2d92390033b0af8b92" gracePeriod=30
Jul 31 02:38:26.757216 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:26.757174    2571 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 31 02:38:26.757605 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:26.757244    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r" podUID="1f2df44a-b5a0-4178-98fb-fa918f644a30" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 02:38:27.202090 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.202066    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:38:27.211844 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.211812    2571 generic.go:356] "Generic (PLEG): container finished" podID="1f2df44a-b5a0-4178-98fb-fa918f644a30" containerID="f6677208ee8f6fe4d9b1c86eeb8490ba546393472360fa2d92390033b0af8b92" exitCode=0
Jul 31 02:38:27.212034 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.211863    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"
Jul 31 02:38:27.212034 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.211868    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r" event={"ID":"1f2df44a-b5a0-4178-98fb-fa918f644a30","Type":"ContainerDied","Data":"f6677208ee8f6fe4d9b1c86eeb8490ba546393472360fa2d92390033b0af8b92"}
Jul 31 02:38:27.212034 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.211931    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r" event={"ID":"1f2df44a-b5a0-4178-98fb-fa918f644a30","Type":"ContainerDied","Data":"8cc6a354d9ff0e3d91c86507303775e6c20b1255164d5ce40e6273c796c8aa63"}
Jul 31 02:38:27.212034 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.211958    2571 scope.go:117] "RemoveContainer" containerID="f6677208ee8f6fe4d9b1c86eeb8490ba546393472360fa2d92390033b0af8b92"
Jul 31 02:38:27.221571 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.221549    2571 scope.go:117] "RemoveContainer" containerID="eb3e57fa04c2c8b080a129287db0b35b82b727496e0c22e4529e5cd6fb80fff7"
Jul 31 02:38:27.231976 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.231958    2571 scope.go:117] "RemoveContainer" containerID="f6677208ee8f6fe4d9b1c86eeb8490ba546393472360fa2d92390033b0af8b92"
Jul 31 02:38:27.232296 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:38:27.232274    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6677208ee8f6fe4d9b1c86eeb8490ba546393472360fa2d92390033b0af8b92\": container with ID starting with f6677208ee8f6fe4d9b1c86eeb8490ba546393472360fa2d92390033b0af8b92 not found: ID does not exist" containerID="f6677208ee8f6fe4d9b1c86eeb8490ba546393472360fa2d92390033b0af8b92"
Jul 31 02:38:27.232417 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.232299    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6677208ee8f6fe4d9b1c86eeb8490ba546393472360fa2d92390033b0af8b92"} err="failed to get container status \"f6677208ee8f6fe4d9b1c86eeb8490ba546393472360fa2d92390033b0af8b92\": rpc error: code = NotFound desc = could not find container \"f6677208ee8f6fe4d9b1c86eeb8490ba546393472360fa2d92390033b0af8b92\": container with ID starting with f6677208ee8f6fe4d9b1c86eeb8490ba546393472360fa2d92390033b0af8b92 not found: ID does not exist"
Jul 31 02:38:27.232417 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.232316    2571 scope.go:117] "RemoveContainer" containerID="eb3e57fa04c2c8b080a129287db0b35b82b727496e0c22e4529e5cd6fb80fff7"
Jul 31 02:38:27.232564 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:38:27.232539    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb3e57fa04c2c8b080a129287db0b35b82b727496e0c22e4529e5cd6fb80fff7\": container with ID starting with eb3e57fa04c2c8b080a129287db0b35b82b727496e0c22e4529e5cd6fb80fff7 not found: ID does not exist" containerID="eb3e57fa04c2c8b080a129287db0b35b82b727496e0c22e4529e5cd6fb80fff7"
Jul 31 02:38:27.232627 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.232573    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb3e57fa04c2c8b080a129287db0b35b82b727496e0c22e4529e5cd6fb80fff7"} err="failed to get container status \"eb3e57fa04c2c8b080a129287db0b35b82b727496e0c22e4529e5cd6fb80fff7\": rpc error: code = NotFound desc = could not find container \"eb3e57fa04c2c8b080a129287db0b35b82b727496e0c22e4529e5cd6fb80fff7\": container with ID starting with eb3e57fa04c2c8b080a129287db0b35b82b727496e0c22e4529e5cd6fb80fff7 not found: ID does not exist"
Jul 31 02:38:27.260612 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.260584    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-workload-certs\") pod \"1f2df44a-b5a0-4178-98fb-fa918f644a30\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") "
Jul 31 02:38:27.260778 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.260623    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-istio-envoy\") pod \"1f2df44a-b5a0-4178-98fb-fa918f644a30\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") "
Jul 31 02:38:27.260778 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.260655    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f2df44a-b5a0-4178-98fb-fa918f644a30-istio-podinfo\") pod \"1f2df44a-b5a0-4178-98fb-fa918f644a30\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") "
Jul 31 02:38:27.260778 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.260728    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-credential-socket\") pod \"1f2df44a-b5a0-4178-98fb-fa918f644a30\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") "
Jul 31 02:38:27.260778 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.260766    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-workload-socket\") pod \"1f2df44a-b5a0-4178-98fb-fa918f644a30\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") "
Jul 31 02:38:27.261052 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.260846    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f2df44a-b5a0-4178-98fb-fa918f644a30-istiod-ca-cert\") pod \"1f2df44a-b5a0-4178-98fb-fa918f644a30\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") "
Jul 31 02:38:27.261052 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.260873    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcss2\" (UniqueName: \"kubernetes.io/projected/1f2df44a-b5a0-4178-98fb-fa918f644a30-kube-api-access-qcss2\") pod \"1f2df44a-b5a0-4178-98fb-fa918f644a30\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") "
Jul 31 02:38:27.261052 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.260876    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1f2df44a-b5a0-4178-98fb-fa918f644a30" (UID: "1f2df44a-b5a0-4178-98fb-fa918f644a30"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:38:27.261052 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.260973    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f2df44a-b5a0-4178-98fb-fa918f644a30-istio-token\") pod \"1f2df44a-b5a0-4178-98fb-fa918f644a30\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") "
Jul 31 02:38:27.261052 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.261024    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-istio-data\") pod \"1f2df44a-b5a0-4178-98fb-fa918f644a30\" (UID: \"1f2df44a-b5a0-4178-98fb-fa918f644a30\") "
Jul 31 02:38:27.261317 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.261205    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f2df44a-b5a0-4178-98fb-fa918f644a30-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1f2df44a-b5a0-4178-98fb-fa918f644a30" (UID: "1f2df44a-b5a0-4178-98fb-fa918f644a30"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 02:38:27.261375 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.261328    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-istio-data" (OuterVolumeSpecName: "istio-data") pod "1f2df44a-b5a0-4178-98fb-fa918f644a30" (UID: "1f2df44a-b5a0-4178-98fb-fa918f644a30"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:38:27.261375 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.261347    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1f2df44a-b5a0-4178-98fb-fa918f644a30" (UID: "1f2df44a-b5a0-4178-98fb-fa918f644a30"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:38:27.261375 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.261367    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1f2df44a-b5a0-4178-98fb-fa918f644a30" (UID: "1f2df44a-b5a0-4178-98fb-fa918f644a30"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:38:27.261738 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.261713    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-credential-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:38:27.261820 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.261742    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-workload-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:38:27.261820 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.261757    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f2df44a-b5a0-4178-98fb-fa918f644a30-istiod-ca-cert\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:38:27.261820 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.261771    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-istio-data\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:38:27.261820 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.261784    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-workload-certs\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:38:27.263162 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.263129    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1f2df44a-b5a0-4178-98fb-fa918f644a30" (UID: "1f2df44a-b5a0-4178-98fb-fa918f644a30"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:38:27.263261 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.263236    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1f2df44a-b5a0-4178-98fb-fa918f644a30-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1f2df44a-b5a0-4178-98fb-fa918f644a30" (UID: "1f2df44a-b5a0-4178-98fb-fa918f644a30"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 02:38:27.263338 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.263314    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f2df44a-b5a0-4178-98fb-fa918f644a30-kube-api-access-qcss2" (OuterVolumeSpecName: "kube-api-access-qcss2") pod "1f2df44a-b5a0-4178-98fb-fa918f644a30" (UID: "1f2df44a-b5a0-4178-98fb-fa918f644a30"). InnerVolumeSpecName "kube-api-access-qcss2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:38:27.263516 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.263498    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f2df44a-b5a0-4178-98fb-fa918f644a30-istio-token" (OuterVolumeSpecName: "istio-token") pod "1f2df44a-b5a0-4178-98fb-fa918f644a30" (UID: "1f2df44a-b5a0-4178-98fb-fa918f644a30"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:38:27.363128 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.363086    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcss2\" (UniqueName: \"kubernetes.io/projected/1f2df44a-b5a0-4178-98fb-fa918f644a30-kube-api-access-qcss2\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:38:27.363128 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.363119    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f2df44a-b5a0-4178-98fb-fa918f644a30-istio-token\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:38:27.363128 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.363129    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f2df44a-b5a0-4178-98fb-fa918f644a30-istio-envoy\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:38:27.363128 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.363137    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f2df44a-b5a0-4178-98fb-fa918f644a30-istio-podinfo\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:38:27.533965 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.533936    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"]
Jul 31 02:38:27.537867 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.537842    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9daafd-openshift-default-54454cf894-mms8r"]
Jul 31 02:38:27.993668 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:38:27.993618    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f2df44a-b5a0-4178-98fb-fa918f644a30" path="/var/lib/kubelet/pods/1f2df44a-b5a0-4178-98fb-fa918f644a30/volumes"
Jul 31 02:39:35.259914 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:35.259862    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"]
Jul 31 02:39:35.602217 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:35.602155    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2" podUID="1f55bc7d-5432-45dc-a132-5e5e1bc50619" containerName="istio-proxy" containerID="cri-o://ff13ba7dafd2611f41213de3c226a64f6886f241d17d3c577b26f1ff399d54c8" gracePeriod=30
Jul 31 02:39:39.459615 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:39.459579    2571 patch_prober.go:28] interesting pod/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 31 02:39:39.460013 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:39.459646    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2" podUID="1f55bc7d-5432-45dc-a132-5e5e1bc50619" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 02:39:40.855349 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:40.855324    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:39:40.960046 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:40.959966    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istiod-ca-cert\") pod \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") "
Jul 31 02:39:40.960046 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:40.960022    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-workload-socket\") pod \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") "
Jul 31 02:39:40.960046 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:40.960047    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-credential-socket\") pod \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") "
Jul 31 02:39:40.960322 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:40.960098    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istio-data\") pod \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") "
Jul 31 02:39:40.960322 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:40.960112    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istio-envoy\") pod \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") "
Jul 31 02:39:40.960322 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:40.960135    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqmsz\" (UniqueName: \"kubernetes.io/projected/1f55bc7d-5432-45dc-a132-5e5e1bc50619-kube-api-access-pqmsz\") pod \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") "
Jul 31 02:39:40.960322 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:40.960183    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istio-podinfo\") pod \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") "
Jul 31 02:39:40.960322 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:40.960227    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-workload-certs\") pod \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") "
Jul 31 02:39:40.960322 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:40.960259    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istio-token\") pod \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\" (UID: \"1f55bc7d-5432-45dc-a132-5e5e1bc50619\") "
Jul 31 02:39:40.960637 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:40.960407    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1f55bc7d-5432-45dc-a132-5e5e1bc50619" (UID: "1f55bc7d-5432-45dc-a132-5e5e1bc50619"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:39:40.960637 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:40.960420    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1f55bc7d-5432-45dc-a132-5e5e1bc50619" (UID: "1f55bc7d-5432-45dc-a132-5e5e1bc50619"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:39:40.960637 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:40.960443    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1f55bc7d-5432-45dc-a132-5e5e1bc50619" (UID: "1f55bc7d-5432-45dc-a132-5e5e1bc50619"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 02:39:40.960637 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:40.960583    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istio-data" (OuterVolumeSpecName: "istio-data") pod "1f55bc7d-5432-45dc-a132-5e5e1bc50619" (UID: "1f55bc7d-5432-45dc-a132-5e5e1bc50619"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:39:40.960637 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:40.960608    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1f55bc7d-5432-45dc-a132-5e5e1bc50619" (UID: "1f55bc7d-5432-45dc-a132-5e5e1bc50619"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:39:40.960922 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:40.960719    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-workload-certs\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:39:40.960922 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:40.960738    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istiod-ca-cert\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:39:40.960922 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:40.960751    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-workload-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:39:40.960922 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:40.960763    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-credential-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:39:40.960922 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:40.960776    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istio-data\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:39:40.962506 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:40.962474    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1f55bc7d-5432-45dc-a132-5e5e1bc50619" (UID: "1f55bc7d-5432-45dc-a132-5e5e1bc50619"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:39:40.962506 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:40.962480    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1f55bc7d-5432-45dc-a132-5e5e1bc50619" (UID: "1f55bc7d-5432-45dc-a132-5e5e1bc50619"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 02:39:40.962877 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:40.962852    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istio-token" (OuterVolumeSpecName: "istio-token") pod "1f55bc7d-5432-45dc-a132-5e5e1bc50619" (UID: "1f55bc7d-5432-45dc-a132-5e5e1bc50619"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:39:40.962877 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:40.962865    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f55bc7d-5432-45dc-a132-5e5e1bc50619-kube-api-access-pqmsz" (OuterVolumeSpecName: "kube-api-access-pqmsz") pod "1f55bc7d-5432-45dc-a132-5e5e1bc50619" (UID: "1f55bc7d-5432-45dc-a132-5e5e1bc50619"). InnerVolumeSpecName "kube-api-access-pqmsz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:39:41.061750 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:41.061712    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istio-envoy\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:39:41.061750 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:41.061741    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqmsz\" (UniqueName: \"kubernetes.io/projected/1f55bc7d-5432-45dc-a132-5e5e1bc50619-kube-api-access-pqmsz\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:39:41.061750 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:41.061751    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istio-podinfo\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:39:41.062088 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:41.061762    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f55bc7d-5432-45dc-a132-5e5e1bc50619-istio-token\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:39:41.636415 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:41.636387    2571 generic.go:356] "Generic (PLEG): container finished" podID="1f55bc7d-5432-45dc-a132-5e5e1bc50619" containerID="ff13ba7dafd2611f41213de3c226a64f6886f241d17d3c577b26f1ff399d54c8" exitCode=0
Jul 31 02:39:41.636604 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:41.636436    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"
Jul 31 02:39:41.636604 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:41.636454    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2" event={"ID":"1f55bc7d-5432-45dc-a132-5e5e1bc50619","Type":"ContainerDied","Data":"ff13ba7dafd2611f41213de3c226a64f6886f241d17d3c577b26f1ff399d54c8"}
Jul 31 02:39:41.636604 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:41.636497    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2" event={"ID":"1f55bc7d-5432-45dc-a132-5e5e1bc50619","Type":"ContainerDied","Data":"c7f258ff729da645c1adaca9d6d149ccac9cf4c280793ce6d9ef56ea59beb585"}
Jul 31 02:39:41.636604 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:41.636520    2571 scope.go:117] "RemoveContainer" containerID="ff13ba7dafd2611f41213de3c226a64f6886f241d17d3c577b26f1ff399d54c8"
Jul 31 02:39:41.646325 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:41.646304    2571 scope.go:117] "RemoveContainer" containerID="d6866f0579749d361f6ffb26ec9163b4f677bb86c1deb7f5960026f737c6bf39"
Jul 31 02:39:41.655279 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:41.655258    2571 scope.go:117] "RemoveContainer" containerID="ff13ba7dafd2611f41213de3c226a64f6886f241d17d3c577b26f1ff399d54c8"
Jul 31 02:39:41.655994 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:39:41.655950    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff13ba7dafd2611f41213de3c226a64f6886f241d17d3c577b26f1ff399d54c8\": container with ID starting with ff13ba7dafd2611f41213de3c226a64f6886f241d17d3c577b26f1ff399d54c8 not found: ID does not exist" containerID="ff13ba7dafd2611f41213de3c226a64f6886f241d17d3c577b26f1ff399d54c8"
Jul 31 02:39:41.656126 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:41.656006    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff13ba7dafd2611f41213de3c226a64f6886f241d17d3c577b26f1ff399d54c8"} err="failed to get container status \"ff13ba7dafd2611f41213de3c226a64f6886f241d17d3c577b26f1ff399d54c8\": rpc error: code = NotFound desc = could not find container \"ff13ba7dafd2611f41213de3c226a64f6886f241d17d3c577b26f1ff399d54c8\": container with ID starting with ff13ba7dafd2611f41213de3c226a64f6886f241d17d3c577b26f1ff399d54c8 not found: ID does not exist"
Jul 31 02:39:41.656126 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:41.656027    2571 scope.go:117] "RemoveContainer" containerID="d6866f0579749d361f6ffb26ec9163b4f677bb86c1deb7f5960026f737c6bf39"
Jul 31 02:39:41.656320 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:39:41.656302    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6866f0579749d361f6ffb26ec9163b4f677bb86c1deb7f5960026f737c6bf39\": container with ID starting with d6866f0579749d361f6ffb26ec9163b4f677bb86c1deb7f5960026f737c6bf39 not found: ID does not exist" containerID="d6866f0579749d361f6ffb26ec9163b4f677bb86c1deb7f5960026f737c6bf39"
Jul 31 02:39:41.656368 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:41.656328    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6866f0579749d361f6ffb26ec9163b4f677bb86c1deb7f5960026f737c6bf39"} err="failed to get container status \"d6866f0579749d361f6ffb26ec9163b4f677bb86c1deb7f5960026f737c6bf39\": rpc error: code = NotFound desc = could not find container \"d6866f0579749d361f6ffb26ec9163b4f677bb86c1deb7f5960026f737c6bf39\": container with ID starting with d6866f0579749d361f6ffb26ec9163b4f677bb86c1deb7f5960026f737c6bf39 not found: ID does not exist"
Jul 31 02:39:41.658312 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:41.658295    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"]
Jul 31 02:39:41.664464 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:41.664443    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-e0efa5-openshift-default-7c64769466-28vg2"]
Jul 31 02:39:41.993988 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:41.993912    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f55bc7d-5432-45dc-a132-5e5e1bc50619" path="/var/lib/kubelet/pods/1f55bc7d-5432-45dc-a132-5e5e1bc50619/volumes"
Jul 31 02:39:52.851747 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:52.851716    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"]
Jul 31 02:39:52.852312 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:52.851949    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb" podUID="5d1ca91f-bd8e-4abb-8611-a7ec15c917db" containerName="istio-proxy" containerID="cri-o://e27f21639bbe22dc81c9d415216c9ad52625b058828217e3aea89533402c1bc6" gracePeriod=30
Jul 31 02:39:53.550044 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:53.550002    2571 patch_prober.go:28] interesting pod/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 31 02:39:53.550227 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:53.550070    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb" podUID="5d1ca91f-bd8e-4abb-8611-a7ec15c917db" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 02:39:58.119992 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.118835    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:39:58.238532 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.238496    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-credential-socket\") pod \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") "
Jul 31 02:39:58.238726 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.238543    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-workload-socket\") pod \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") "
Jul 31 02:39:58.238726 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.238563    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istio-podinfo\") pod \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") "
Jul 31 02:39:58.238726 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.238587    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istio-data\") pod \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") "
Jul 31 02:39:58.238726 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.238703    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-workload-certs\") pod \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") "
Jul 31 02:39:58.238967 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.238727    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istio-token\") pod \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") "
Jul 31 02:39:58.238967 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.238792    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knz8w\" (UniqueName: \"kubernetes.io/projected/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-kube-api-access-knz8w\") pod \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") "
Jul 31 02:39:58.238967 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.238838    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istio-envoy\") pod \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") "
Jul 31 02:39:58.238967 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.238877    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istiod-ca-cert\") pod \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\" (UID: \"5d1ca91f-bd8e-4abb-8611-a7ec15c917db\") "
Jul 31 02:39:58.239168 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.239045    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5d1ca91f-bd8e-4abb-8611-a7ec15c917db" (UID: "5d1ca91f-bd8e-4abb-8611-a7ec15c917db"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:39:58.239381 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.239357    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-workload-certs\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:39:58.239555 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.239366    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istio-data" (OuterVolumeSpecName: "istio-data") pod "5d1ca91f-bd8e-4abb-8611-a7ec15c917db" (UID: "5d1ca91f-bd8e-4abb-8611-a7ec15c917db"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:39:58.239659 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.239391    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5d1ca91f-bd8e-4abb-8611-a7ec15c917db" (UID: "5d1ca91f-bd8e-4abb-8611-a7ec15c917db"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 02:39:58.239659 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.239511    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5d1ca91f-bd8e-4abb-8611-a7ec15c917db" (UID: "5d1ca91f-bd8e-4abb-8611-a7ec15c917db"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:39:58.239659 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.239632    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5d1ca91f-bd8e-4abb-8611-a7ec15c917db" (UID: "5d1ca91f-bd8e-4abb-8611-a7ec15c917db"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:39:58.241390 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.241355    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5d1ca91f-bd8e-4abb-8611-a7ec15c917db" (UID: "5d1ca91f-bd8e-4abb-8611-a7ec15c917db"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 02:39:58.241498 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.241452    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5d1ca91f-bd8e-4abb-8611-a7ec15c917db" (UID: "5d1ca91f-bd8e-4abb-8611-a7ec15c917db"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:39:58.241578 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.241558    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-kube-api-access-knz8w" (OuterVolumeSpecName: "kube-api-access-knz8w") pod "5d1ca91f-bd8e-4abb-8611-a7ec15c917db" (UID: "5d1ca91f-bd8e-4abb-8611-a7ec15c917db"). InnerVolumeSpecName "kube-api-access-knz8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:39:58.241773 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.241752    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istio-token" (OuterVolumeSpecName: "istio-token") pod "5d1ca91f-bd8e-4abb-8611-a7ec15c917db" (UID: "5d1ca91f-bd8e-4abb-8611-a7ec15c917db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:39:58.341033 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.340995    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istio-envoy\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:39:58.341033 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.341031    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istiod-ca-cert\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:39:58.341231 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.341046    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-credential-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:39:58.341231 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.341060    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-workload-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:39:58.341231 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.341073    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istio-podinfo\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:39:58.341231 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.341085    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istio-data\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:39:58.341231 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.341096    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-istio-token\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:39:58.341231 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.341108    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knz8w\" (UniqueName: \"kubernetes.io/projected/5d1ca91f-bd8e-4abb-8611-a7ec15c917db-kube-api-access-knz8w\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:39:58.737339 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.737305    2571 generic.go:356] "Generic (PLEG): container finished" podID="5d1ca91f-bd8e-4abb-8611-a7ec15c917db" containerID="e27f21639bbe22dc81c9d415216c9ad52625b058828217e3aea89533402c1bc6" exitCode=0
Jul 31 02:39:58.737509 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.737349    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"
Jul 31 02:39:58.737509 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.737385    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb" event={"ID":"5d1ca91f-bd8e-4abb-8611-a7ec15c917db","Type":"ContainerDied","Data":"e27f21639bbe22dc81c9d415216c9ad52625b058828217e3aea89533402c1bc6"}
Jul 31 02:39:58.737509 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.737465    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb" event={"ID":"5d1ca91f-bd8e-4abb-8611-a7ec15c917db","Type":"ContainerDied","Data":"08e6572abdf91ab5e3d0e041db9964a5a33757ef23862ddc3f39e68e507bc31b"}
Jul 31 02:39:58.737629 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.737487    2571 scope.go:117] "RemoveContainer" containerID="e27f21639bbe22dc81c9d415216c9ad52625b058828217e3aea89533402c1bc6"
Jul 31 02:39:58.747584 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.747566    2571 scope.go:117] "RemoveContainer" containerID="5d854f07a9ccc9ec3c90467a40def387bc7489eb849ec981d1c5aaec264d7b5c"
Jul 31 02:39:58.756209 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.756189    2571 scope.go:117] "RemoveContainer" containerID="e27f21639bbe22dc81c9d415216c9ad52625b058828217e3aea89533402c1bc6"
Jul 31 02:39:58.756453 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:39:58.756432    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e27f21639bbe22dc81c9d415216c9ad52625b058828217e3aea89533402c1bc6\": container with ID starting with e27f21639bbe22dc81c9d415216c9ad52625b058828217e3aea89533402c1bc6 not found: ID does not exist" containerID="e27f21639bbe22dc81c9d415216c9ad52625b058828217e3aea89533402c1bc6"
Jul 31 02:39:58.756522 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.756461    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e27f21639bbe22dc81c9d415216c9ad52625b058828217e3aea89533402c1bc6"} err="failed to get container status \"e27f21639bbe22dc81c9d415216c9ad52625b058828217e3aea89533402c1bc6\": rpc error: code = NotFound desc = could not find container \"e27f21639bbe22dc81c9d415216c9ad52625b058828217e3aea89533402c1bc6\": container with ID starting with e27f21639bbe22dc81c9d415216c9ad52625b058828217e3aea89533402c1bc6 not found: ID does not exist"
Jul 31 02:39:58.756522 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.756479    2571 scope.go:117] "RemoveContainer" containerID="5d854f07a9ccc9ec3c90467a40def387bc7489eb849ec981d1c5aaec264d7b5c"
Jul 31 02:39:58.756737 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:39:58.756719    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d854f07a9ccc9ec3c90467a40def387bc7489eb849ec981d1c5aaec264d7b5c\": container with ID starting with 5d854f07a9ccc9ec3c90467a40def387bc7489eb849ec981d1c5aaec264d7b5c not found: ID does not exist" containerID="5d854f07a9ccc9ec3c90467a40def387bc7489eb849ec981d1c5aaec264d7b5c"
Jul 31 02:39:58.756775 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.756747    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d854f07a9ccc9ec3c90467a40def387bc7489eb849ec981d1c5aaec264d7b5c"} err="failed to get container status \"5d854f07a9ccc9ec3c90467a40def387bc7489eb849ec981d1c5aaec264d7b5c\": rpc error: code = NotFound desc = could not find container \"5d854f07a9ccc9ec3c90467a40def387bc7489eb849ec981d1c5aaec264d7b5c\": container with ID starting with 5d854f07a9ccc9ec3c90467a40def387bc7489eb849ec981d1c5aaec264d7b5c not found: ID does not exist"
Jul 31 02:39:58.760370 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.760350    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"]
Jul 31 02:39:58.764929 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:58.764906    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-3dc29c-openshift-default-54778b464-t9mdb"]
Jul 31 02:39:59.992600 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:39:59.992560    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d1ca91f-bd8e-4abb-8611-a7ec15c917db" path="/var/lib/kubelet/pods/5d1ca91f-bd8e-4abb-8611-a7ec15c917db/volumes"
Jul 31 02:40:04.777087 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:04.777054    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"]
Jul 31 02:40:04.777589 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:04.777311    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll" podUID="fc26e864-72db-4d61-a0c3-f9345a28c014" containerName="istio-proxy" containerID="cri-o://38c89bce6b911eed3e8d994328f08c72230049f498fb82c7f6d11d79b2349c98" gracePeriod=30
Jul 31 02:40:06.976640 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:06.976599    2571 patch_prober.go:28] interesting pod/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 31 02:40:06.977066 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:06.976682    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll" podUID="fc26e864-72db-4d61-a0c3-f9345a28c014" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 02:40:10.040151 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.040127    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:40:10.160326 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.160288    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-istio-envoy\") pod \"fc26e864-72db-4d61-a0c3-f9345a28c014\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") "
Jul 31 02:40:10.160326 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.160333    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-credential-socket\") pod \"fc26e864-72db-4d61-a0c3-f9345a28c014\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") "
Jul 31 02:40:10.160595 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.160368    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-istio-data\") pod \"fc26e864-72db-4d61-a0c3-f9345a28c014\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") "
Jul 31 02:40:10.160595 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.160406    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-565qf\" (UniqueName: \"kubernetes.io/projected/fc26e864-72db-4d61-a0c3-f9345a28c014-kube-api-access-565qf\") pod \"fc26e864-72db-4d61-a0c3-f9345a28c014\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") "
Jul 31 02:40:10.160595 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.160476    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc26e864-72db-4d61-a0c3-f9345a28c014-istio-token\") pod \"fc26e864-72db-4d61-a0c3-f9345a28c014\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") "
Jul 31 02:40:10.160758 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.160595    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-workload-socket\") pod \"fc26e864-72db-4d61-a0c3-f9345a28c014\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") "
Jul 31 02:40:10.160758 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.160645    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-workload-certs\") pod \"fc26e864-72db-4d61-a0c3-f9345a28c014\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") "
Jul 31 02:40:10.160758 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.160693    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc26e864-72db-4d61-a0c3-f9345a28c014-istiod-ca-cert\") pod \"fc26e864-72db-4d61-a0c3-f9345a28c014\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") "
Jul 31 02:40:10.160758 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.160701    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-istio-data" (OuterVolumeSpecName: "istio-data") pod "fc26e864-72db-4d61-a0c3-f9345a28c014" (UID: "fc26e864-72db-4d61-a0c3-f9345a28c014"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:40:10.160758 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.160711    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fc26e864-72db-4d61-a0c3-f9345a28c014" (UID: "fc26e864-72db-4d61-a0c3-f9345a28c014"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:40:10.160758 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.160722    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc26e864-72db-4d61-a0c3-f9345a28c014-istio-podinfo\") pod \"fc26e864-72db-4d61-a0c3-f9345a28c014\" (UID: \"fc26e864-72db-4d61-a0c3-f9345a28c014\") "
Jul 31 02:40:10.161110 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.160968    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fc26e864-72db-4d61-a0c3-f9345a28c014" (UID: "fc26e864-72db-4d61-a0c3-f9345a28c014"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:40:10.161110 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.161067    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc26e864-72db-4d61-a0c3-f9345a28c014-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fc26e864-72db-4d61-a0c3-f9345a28c014" (UID: "fc26e864-72db-4d61-a0c3-f9345a28c014"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 02:40:10.161285 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.161260    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fc26e864-72db-4d61-a0c3-f9345a28c014" (UID: "fc26e864-72db-4d61-a0c3-f9345a28c014"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:40:10.161760 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.161674    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc26e864-72db-4d61-a0c3-f9345a28c014-istiod-ca-cert\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:40:10.161760 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.161701    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-credential-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:40:10.161760 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.161714    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-istio-data\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:40:10.161760 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.161727    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-workload-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:40:10.161760 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.161738    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-workload-certs\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:40:10.162594 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.162569    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fc26e864-72db-4d61-a0c3-f9345a28c014" (UID: "fc26e864-72db-4d61-a0c3-f9345a28c014"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:40:10.162812 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.162791    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc26e864-72db-4d61-a0c3-f9345a28c014-istio-token" (OuterVolumeSpecName: "istio-token") pod "fc26e864-72db-4d61-a0c3-f9345a28c014" (UID: "fc26e864-72db-4d61-a0c3-f9345a28c014"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:40:10.162932 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.162858    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc26e864-72db-4d61-a0c3-f9345a28c014-kube-api-access-565qf" (OuterVolumeSpecName: "kube-api-access-565qf") pod "fc26e864-72db-4d61-a0c3-f9345a28c014" (UID: "fc26e864-72db-4d61-a0c3-f9345a28c014"). InnerVolumeSpecName "kube-api-access-565qf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:40:10.163056 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.163041    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fc26e864-72db-4d61-a0c3-f9345a28c014-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fc26e864-72db-4d61-a0c3-f9345a28c014" (UID: "fc26e864-72db-4d61-a0c3-f9345a28c014"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 02:40:10.262449 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.262412    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-565qf\" (UniqueName: \"kubernetes.io/projected/fc26e864-72db-4d61-a0c3-f9345a28c014-kube-api-access-565qf\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:40:10.262449 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.262444    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc26e864-72db-4d61-a0c3-f9345a28c014-istio-token\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:40:10.262449 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.262455    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc26e864-72db-4d61-a0c3-f9345a28c014-istio-podinfo\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:40:10.262756 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.262463    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc26e864-72db-4d61-a0c3-f9345a28c014-istio-envoy\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:40:10.811017 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.810978    2571 generic.go:356] "Generic (PLEG): container finished" podID="fc26e864-72db-4d61-a0c3-f9345a28c014" containerID="38c89bce6b911eed3e8d994328f08c72230049f498fb82c7f6d11d79b2349c98" exitCode=0
Jul 31 02:40:10.811224 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.811045    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"
Jul 31 02:40:10.811224 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.811057    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll" event={"ID":"fc26e864-72db-4d61-a0c3-f9345a28c014","Type":"ContainerDied","Data":"38c89bce6b911eed3e8d994328f08c72230049f498fb82c7f6d11d79b2349c98"}
Jul 31 02:40:10.811224 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.811137    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll" event={"ID":"fc26e864-72db-4d61-a0c3-f9345a28c014","Type":"ContainerDied","Data":"4fbe3d4d4e9147a9121c4a24fc04800231a26aefe04454cb51edac0a023e9ab7"}
Jul 31 02:40:10.811224 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.811159    2571 scope.go:117] "RemoveContainer" containerID="38c89bce6b911eed3e8d994328f08c72230049f498fb82c7f6d11d79b2349c98"
Jul 31 02:40:10.822736 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.822721    2571 scope.go:117] "RemoveContainer" containerID="c341f31561a4644643a1b205ee1783130596484a12cc18c69c662ca2c545bedb"
Jul 31 02:40:10.831779 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.831587    2571 scope.go:117] "RemoveContainer" containerID="38c89bce6b911eed3e8d994328f08c72230049f498fb82c7f6d11d79b2349c98"
Jul 31 02:40:10.832026 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:40:10.832004    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38c89bce6b911eed3e8d994328f08c72230049f498fb82c7f6d11d79b2349c98\": container with ID starting with 38c89bce6b911eed3e8d994328f08c72230049f498fb82c7f6d11d79b2349c98 not found: ID does not exist" containerID="38c89bce6b911eed3e8d994328f08c72230049f498fb82c7f6d11d79b2349c98"
Jul 31 02:40:10.832109 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.832042    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38c89bce6b911eed3e8d994328f08c72230049f498fb82c7f6d11d79b2349c98"} err="failed to get container status \"38c89bce6b911eed3e8d994328f08c72230049f498fb82c7f6d11d79b2349c98\": rpc error: code = NotFound desc = could not find container \"38c89bce6b911eed3e8d994328f08c72230049f498fb82c7f6d11d79b2349c98\": container with ID starting with 38c89bce6b911eed3e8d994328f08c72230049f498fb82c7f6d11d79b2349c98 not found: ID does not exist"
Jul 31 02:40:10.832109 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.832081    2571 scope.go:117] "RemoveContainer" containerID="c341f31561a4644643a1b205ee1783130596484a12cc18c69c662ca2c545bedb"
Jul 31 02:40:10.832367 ip-10-0-133-91 kubenswrapper[2571]: E0731 02:40:10.832348    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c341f31561a4644643a1b205ee1783130596484a12cc18c69c662ca2c545bedb\": container with ID starting with c341f31561a4644643a1b205ee1783130596484a12cc18c69c662ca2c545bedb not found: ID does not exist" containerID="c341f31561a4644643a1b205ee1783130596484a12cc18c69c662ca2c545bedb"
Jul 31 02:40:10.832436 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.832377    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c341f31561a4644643a1b205ee1783130596484a12cc18c69c662ca2c545bedb"} err="failed to get container status \"c341f31561a4644643a1b205ee1783130596484a12cc18c69c662ca2c545bedb\": rpc error: code = NotFound desc = could not find container \"c341f31561a4644643a1b205ee1783130596484a12cc18c69c662ca2c545bedb\": container with ID starting with c341f31561a4644643a1b205ee1783130596484a12cc18c69c662ca2c545bedb not found: ID does not exist"
Jul 31 02:40:10.834027 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.834008    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"]
Jul 31 02:40:10.842284 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:10.842263    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-2aed0b-openshift-default-6b85fd8c6d-vlkll"]
Jul 31 02:40:11.993568 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:11.993489    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc26e864-72db-4d61-a0c3-f9345a28c014" path="/var/lib/kubelet/pods/fc26e864-72db-4d61-a0c3-f9345a28c014/volumes"
Jul 31 02:40:22.726473 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:22.726440    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"]
Jul 31 02:40:22.726835 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:22.726673    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z" podUID="daef9f3f-e9e6-4c74-b13c-49fc743af9d9" containerName="istio-proxy" containerID="cri-o://49e026809179c6233c19d1a380d405c017436ceecc06ac1148e9e8c50863359f" gracePeriod=30
Jul 31 02:40:23.431398 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:23.431366    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c58894fcc-t9hck_61847e0e-da0b-4006-9cf5-2b7a5a601a2a/authorino/0.log"
Jul 31 02:40:27.909084 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:27.909051    2571 generic.go:356] "Generic (PLEG): container finished" podID="daef9f3f-e9e6-4c74-b13c-49fc743af9d9" containerID="49e026809179c6233c19d1a380d405c017436ceecc06ac1148e9e8c50863359f" exitCode=0
Jul 31 02:40:27.909586 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:27.909115    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z" event={"ID":"daef9f3f-e9e6-4c74-b13c-49fc743af9d9","Type":"ContainerDied","Data":"49e026809179c6233c19d1a380d405c017436ceecc06ac1148e9e8c50863359f"}
Jul 31 02:40:27.909586 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:27.909201    2571 scope.go:117] "RemoveContainer" containerID="258776a95241b1e3e2c612761a693dbec4d34ba80380d7d9b9739c082b1eccfe"
Jul 31 02:40:27.975810 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:27.975787    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:40:28.031492 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.031422    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istiod-ca-cert\") pod \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") "
Jul 31 02:40:28.031492 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.031471    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-credential-socket\") pod \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") "
Jul 31 02:40:28.031492 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.031492    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istio-data\") pod \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") "
Jul 31 02:40:28.031764 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.031511    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thr49\" (UniqueName: \"kubernetes.io/projected/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-kube-api-access-thr49\") pod \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") "
Jul 31 02:40:28.031764 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.031543    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istio-envoy\") pod \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") "
Jul 31 02:40:28.031764 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.031565    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-workload-certs\") pod \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") "
Jul 31 02:40:28.031764 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.031590    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istio-token\") pod \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") "
Jul 31 02:40:28.031764 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.031648    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-workload-socket\") pod \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") "
Jul 31 02:40:28.031764 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.031729    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istio-podinfo\") pod \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\" (UID: \"daef9f3f-e9e6-4c74-b13c-49fc743af9d9\") "
Jul 31 02:40:28.032131 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.031883    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "daef9f3f-e9e6-4c74-b13c-49fc743af9d9" (UID: "daef9f3f-e9e6-4c74-b13c-49fc743af9d9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:40:28.032131 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.031915    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istio-data" (OuterVolumeSpecName: "istio-data") pod "daef9f3f-e9e6-4c74-b13c-49fc743af9d9" (UID: "daef9f3f-e9e6-4c74-b13c-49fc743af9d9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:40:28.032131 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.031946    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "daef9f3f-e9e6-4c74-b13c-49fc743af9d9" (UID: "daef9f3f-e9e6-4c74-b13c-49fc743af9d9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 02:40:28.032131 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.032099    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "daef9f3f-e9e6-4c74-b13c-49fc743af9d9" (UID: "daef9f3f-e9e6-4c74-b13c-49fc743af9d9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:40:28.032131 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.032119    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "daef9f3f-e9e6-4c74-b13c-49fc743af9d9" (UID: "daef9f3f-e9e6-4c74-b13c-49fc743af9d9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:40:28.032395 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.032186    2571 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-workload-certs\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:40:28.032395 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.032216    2571 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istiod-ca-cert\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:40:28.032395 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.032229    2571 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-credential-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:40:28.032395 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.032244    2571 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istio-data\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:40:28.033867 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.033842    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "daef9f3f-e9e6-4c74-b13c-49fc743af9d9" (UID: "daef9f3f-e9e6-4c74-b13c-49fc743af9d9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 02:40:28.033995 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.033865    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-kube-api-access-thr49" (OuterVolumeSpecName: "kube-api-access-thr49") pod "daef9f3f-e9e6-4c74-b13c-49fc743af9d9" (UID: "daef9f3f-e9e6-4c74-b13c-49fc743af9d9"). InnerVolumeSpecName "kube-api-access-thr49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:40:28.034135 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.034113    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istio-token" (OuterVolumeSpecName: "istio-token") pod "daef9f3f-e9e6-4c74-b13c-49fc743af9d9" (UID: "daef9f3f-e9e6-4c74-b13c-49fc743af9d9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 02:40:28.034191 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.034152    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "daef9f3f-e9e6-4c74-b13c-49fc743af9d9" (UID: "daef9f3f-e9e6-4c74-b13c-49fc743af9d9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 02:40:28.133396 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.133363    2571 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-workload-socket\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:40:28.133396 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.133392    2571 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istio-podinfo\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:40:28.133668 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.133404    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thr49\" (UniqueName: \"kubernetes.io/projected/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-kube-api-access-thr49\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:40:28.133668 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.133414    2571 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istio-envoy\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:40:28.133668 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.133422    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daef9f3f-e9e6-4c74-b13c-49fc743af9d9-istio-token\") on node \"ip-10-0-133-91.ec2.internal\" DevicePath \"\""
Jul 31 02:40:28.915834 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.915802    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"
Jul 31 02:40:28.915834 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.915821    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z" event={"ID":"daef9f3f-e9e6-4c74-b13c-49fc743af9d9","Type":"ContainerDied","Data":"173de716d185b26baec5a8db52008e76c90b576d99dfb3117e659f1bb5714782"}
Jul 31 02:40:28.916369 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.915876    2571 scope.go:117] "RemoveContainer" containerID="49e026809179c6233c19d1a380d405c017436ceecc06ac1148e9e8c50863359f"
Jul 31 02:40:28.941314 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.941287    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"]
Jul 31 02:40:28.947496 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:28.947473    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-01a44c-openshift-default-685f6b8bcb-54m9z"]
Jul 31 02:40:29.227789 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:29.227706    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-j99bz_28b7c570-b419-4cf3-ad97-2a449e9f2e50/manager/0.log"
Jul 31 02:40:29.367613 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:29.367589    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-mlh8q_69736619-a3ac-401f-b5d9-d87c27c4e016/manager/0.log"
Jul 31 02:40:29.639011 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:29.638987    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-drmhh_b60fa90c-c0af-43d1-8e91-23eceb898f0e/server/0.log"
Jul 31 02:40:29.763816 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:29.763791    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-n2p4d_1af1fd09-ca7c-4981-a5a5-e1070360071c/manager/0.log"
Jul 31 02:40:29.883384 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:29.883356    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77df9dc58b-8bq85_477eada6-4571-4d0d-9150-35d28d5f40b9/copy-manifests/0.log"
Jul 31 02:40:29.892876 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:29.892814    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77df9dc58b-8bq85_477eada6-4571-4d0d-9150-35d28d5f40b9/manager/0.log"
Jul 31 02:40:29.992510 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:29.992472    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="daef9f3f-e9e6-4c74-b13c-49fc743af9d9" path="/var/lib/kubelet/pods/daef9f3f-e9e6-4c74-b13c-49fc743af9d9/volumes"
Jul 31 02:40:31.976537 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:31.976509    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c58894fcc-t9hck_61847e0e-da0b-4006-9cf5-2b7a5a601a2a/authorino/0.log"
Jul 31 02:40:32.107017 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:32.106985    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-knlpw_cce2ebb9-e2b3-48c9-8d22-cf870c2e69c9/manager/0.log"
Jul 31 02:40:32.529087 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:32.529061    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-vqdzw_0efdc495-8e17-4fe0-9d3c-75a8713c55fe/manager/0.log"
Jul 31 02:40:32.785047 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:32.784975    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-kkkph_b0c0becd-8b5b-4e72-9ac4-874e0aa24576/manager/0.log"
Jul 31 02:40:33.224370 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:33.224340    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc_7a88687a-ceee-4892-aa46-a7ba43f9e5c4/istio-proxy/0.log"
Jul 31 02:40:33.489709 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:33.489632    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-647dc4ddc5-4g7zg_8d0f53f2-f485-47c8-ac3c-a68e2b5fe382/kube-auth-proxy/0.log"
Jul 31 02:40:33.772907 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:33.772817    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-58nx6_90a0eefd-19e3-44f9-8390-2e82d93e10f3/istio-proxy/1.log"
Jul 31 02:40:34.160238 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:34.160209    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78d646dddb-6hkw9_03e216bb-cb12-4fb4-a9dd-a693daa5f657/router/0.log"
Jul 31 02:40:34.692509 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:34.692482    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-6pbbz_e3ed9fe3-fd2d-4712-997b-df2445e98a00/main/0.log"
Jul 31 02:40:34.816268 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:34.816238    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-zmgg7_ff87645b-4a15-41a6-8d6f-03efc0163c33/main/0.log"
Jul 31 02:40:41.588582 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.588547    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tsc55/must-gather-7qbfl"]
Jul 31 02:40:41.589005 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.588990    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f55bc7d-5432-45dc-a132-5e5e1bc50619" containerName="istio-proxy"
Jul 31 02:40:41.589005 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589001    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f55bc7d-5432-45dc-a132-5e5e1bc50619" containerName="istio-proxy"
Jul 31 02:40:41.589114 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589010    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d1ca91f-bd8e-4abb-8611-a7ec15c917db" containerName="istio-proxy"
Jul 31 02:40:41.589114 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589017    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d1ca91f-bd8e-4abb-8611-a7ec15c917db" containerName="istio-proxy"
Jul 31 02:40:41.589114 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589023    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f2df44a-b5a0-4178-98fb-fa918f644a30" containerName="istio-proxy"
Jul 31 02:40:41.589114 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589029    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f2df44a-b5a0-4178-98fb-fa918f644a30" containerName="istio-proxy"
Jul 31 02:40:41.589114 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589037    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc26e864-72db-4d61-a0c3-f9345a28c014" containerName="istio-proxy"
Jul 31 02:40:41.589114 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589042    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc26e864-72db-4d61-a0c3-f9345a28c014" containerName="istio-proxy"
Jul 31 02:40:41.589114 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589054    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daef9f3f-e9e6-4c74-b13c-49fc743af9d9" containerName="istio-proxy"
Jul 31 02:40:41.589114 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589059    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="daef9f3f-e9e6-4c74-b13c-49fc743af9d9" containerName="istio-proxy"
Jul 31 02:40:41.589114 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589071    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc26e864-72db-4d61-a0c3-f9345a28c014" containerName="istio-proxy"
Jul 31 02:40:41.589114 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589076    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc26e864-72db-4d61-a0c3-f9345a28c014" containerName="istio-proxy"
Jul 31 02:40:41.589114 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589084    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daef9f3f-e9e6-4c74-b13c-49fc743af9d9" containerName="istio-proxy"
Jul 31 02:40:41.589114 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589088    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="daef9f3f-e9e6-4c74-b13c-49fc743af9d9" containerName="istio-proxy"
Jul 31 02:40:41.589469 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589147    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f55bc7d-5432-45dc-a132-5e5e1bc50619" containerName="istio-proxy"
Jul 31 02:40:41.589469 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589154    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d1ca91f-bd8e-4abb-8611-a7ec15c917db" containerName="istio-proxy"
Jul 31 02:40:41.589469 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589161    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc26e864-72db-4d61-a0c3-f9345a28c014" containerName="istio-proxy"
Jul 31 02:40:41.589469 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589167    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="daef9f3f-e9e6-4c74-b13c-49fc743af9d9" containerName="istio-proxy"
Jul 31 02:40:41.589469 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589173    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f2df44a-b5a0-4178-98fb-fa918f644a30" containerName="istio-proxy"
Jul 31 02:40:41.589469 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589179    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc26e864-72db-4d61-a0c3-f9345a28c014" containerName="istio-proxy"
Jul 31 02:40:41.589469 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589186    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f2df44a-b5a0-4178-98fb-fa918f644a30" containerName="istio-proxy"
Jul 31 02:40:41.589469 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589191    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d1ca91f-bd8e-4abb-8611-a7ec15c917db" containerName="istio-proxy"
Jul 31 02:40:41.589469 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589198    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="daef9f3f-e9e6-4c74-b13c-49fc743af9d9" containerName="istio-proxy"
Jul 31 02:40:41.589469 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589267    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f55bc7d-5432-45dc-a132-5e5e1bc50619" containerName="istio-proxy"
Jul 31 02:40:41.589469 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589273    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f55bc7d-5432-45dc-a132-5e5e1bc50619" containerName="istio-proxy"
Jul 31 02:40:41.589469 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589279    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d1ca91f-bd8e-4abb-8611-a7ec15c917db" containerName="istio-proxy"
Jul 31 02:40:41.589469 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589283    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d1ca91f-bd8e-4abb-8611-a7ec15c917db" containerName="istio-proxy"
Jul 31 02:40:41.589469 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589290    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f2df44a-b5a0-4178-98fb-fa918f644a30" containerName="istio-proxy"
Jul 31 02:40:41.589469 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589294    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f2df44a-b5a0-4178-98fb-fa918f644a30" containerName="istio-proxy"
Jul 31 02:40:41.589469 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.589364    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f55bc7d-5432-45dc-a132-5e5e1bc50619" containerName="istio-proxy"
Jul 31 02:40:41.592195 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.592179    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tsc55/must-gather-7qbfl"
Jul 31 02:40:41.599510 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.597220    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tsc55\"/\"openshift-service-ca.crt\""
Jul 31 02:40:41.599510 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.598285    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tsc55\"/\"default-dockercfg-p9l6w\""
Jul 31 02:40:41.600631 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.600610    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tsc55\"/\"kube-root-ca.crt\""
Jul 31 02:40:41.633291 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.633259    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tsc55/must-gather-7qbfl"]
Jul 31 02:40:41.765312 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.765277    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6jkj\" (UniqueName: \"kubernetes.io/projected/819c7786-2ada-4baf-9113-ca5c2785a5e4-kube-api-access-g6jkj\") pod \"must-gather-7qbfl\" (UID: \"819c7786-2ada-4baf-9113-ca5c2785a5e4\") " pod="openshift-must-gather-tsc55/must-gather-7qbfl"
Jul 31 02:40:41.765502 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.765410    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/819c7786-2ada-4baf-9113-ca5c2785a5e4-must-gather-output\") pod \"must-gather-7qbfl\" (UID: \"819c7786-2ada-4baf-9113-ca5c2785a5e4\") " pod="openshift-must-gather-tsc55/must-gather-7qbfl"
Jul 31 02:40:41.866327 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.866296    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/819c7786-2ada-4baf-9113-ca5c2785a5e4-must-gather-output\") pod \"must-gather-7qbfl\" (UID: \"819c7786-2ada-4baf-9113-ca5c2785a5e4\") " pod="openshift-must-gather-tsc55/must-gather-7qbfl"
Jul 31 02:40:41.866483 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.866368    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6jkj\" (UniqueName: \"kubernetes.io/projected/819c7786-2ada-4baf-9113-ca5c2785a5e4-kube-api-access-g6jkj\") pod \"must-gather-7qbfl\" (UID: \"819c7786-2ada-4baf-9113-ca5c2785a5e4\") " pod="openshift-must-gather-tsc55/must-gather-7qbfl"
Jul 31 02:40:41.866629 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.866609    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/819c7786-2ada-4baf-9113-ca5c2785a5e4-must-gather-output\") pod \"must-gather-7qbfl\" (UID: \"819c7786-2ada-4baf-9113-ca5c2785a5e4\") " pod="openshift-must-gather-tsc55/must-gather-7qbfl"
Jul 31 02:40:41.892522 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.892494    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6jkj\" (UniqueName: \"kubernetes.io/projected/819c7786-2ada-4baf-9113-ca5c2785a5e4-kube-api-access-g6jkj\") pod \"must-gather-7qbfl\" (UID: \"819c7786-2ada-4baf-9113-ca5c2785a5e4\") " pod="openshift-must-gather-tsc55/must-gather-7qbfl"
Jul 31 02:40:41.908748 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:41.908721    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tsc55/must-gather-7qbfl"
Jul 31 02:40:42.068051 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:42.068010    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tsc55/must-gather-7qbfl"]
Jul 31 02:40:42.070351 ip-10-0-133-91 kubenswrapper[2571]: W0731 02:40:42.070326    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod819c7786_2ada_4baf_9113_ca5c2785a5e4.slice/crio-99cef7c58df70be0569413ea9c66ee28c98ac47b52b2eabb5d08541d02b2b93e WatchSource:0}: Error finding container 99cef7c58df70be0569413ea9c66ee28c98ac47b52b2eabb5d08541d02b2b93e: Status 404 returned error can't find the container with id 99cef7c58df70be0569413ea9c66ee28c98ac47b52b2eabb5d08541d02b2b93e
Jul 31 02:40:42.072287 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:42.072273    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 02:40:43.009444 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:43.009176    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tsc55/must-gather-7qbfl" event={"ID":"819c7786-2ada-4baf-9113-ca5c2785a5e4","Type":"ContainerStarted","Data":"404c88811e90da5fbce73c2112fe4cdfea047f3fd3b39159c566e3e77d66268c"}
Jul 31 02:40:43.009444 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:43.009225    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tsc55/must-gather-7qbfl" event={"ID":"819c7786-2ada-4baf-9113-ca5c2785a5e4","Type":"ContainerStarted","Data":"99cef7c58df70be0569413ea9c66ee28c98ac47b52b2eabb5d08541d02b2b93e"}
Jul 31 02:40:44.016767 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:44.016700    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tsc55/must-gather-7qbfl" event={"ID":"819c7786-2ada-4baf-9113-ca5c2785a5e4","Type":"ContainerStarted","Data":"36b15962d8aaad1f3f0112186a9049f4913a3e2b13dbb15bcd667edf492eead8"}
Jul 31 02:40:44.069881 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:44.069829    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tsc55/must-gather-7qbfl" podStartSLOduration=2.302585366 podStartE2EDuration="3.069810207s" totalImagesPullingTime="767.224841ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 02:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:40:44.06727899 +0000 UTC m=+3804.647519986" watchObservedRunningTime="2026-07-31 02:40:44.069810207 +0000 UTC m=+3804.650051203"
Jul 31 02:40:45.445963 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:45.445932    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5sd9h_d7a3c161-fb9a-48d4-b150-58fe365b2a6c/global-pull-secret-syncer/0.log"
Jul 31 02:40:45.975371 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:45.975337    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kxjk7_652076b0-3ea5-413f-8e40-396b7decfd5e/konnectivity-agent/0.log"
Jul 31 02:40:46.033255 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:46.033228    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-91.ec2.internal_2b1da00732300b353fe684ed60474f6b/haproxy/0.log"
Jul 31 02:40:49.806927 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:49.806531    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c58894fcc-t9hck_61847e0e-da0b-4006-9cf5-2b7a5a601a2a/authorino/0.log"
Jul 31 02:40:49.984746 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:49.984700    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-knlpw_cce2ebb9-e2b3-48c9-8d22-cf870c2e69c9/manager/0.log"
Jul 31 02:40:50.385917 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:50.384014    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-vqdzw_0efdc495-8e17-4fe0-9d3c-75a8713c55fe/manager/0.log"
Jul 31 02:40:50.616179 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:50.616142    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-kkkph_b0c0becd-8b5b-4e72-9ac4-874e0aa24576/manager/0.log"
Jul 31 02:40:52.374042 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:52.374003    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4d3d7df3-54dc-41e8-911e-991953869562/alertmanager/0.log"
Jul 31 02:40:52.424225 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:52.424190    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4d3d7df3-54dc-41e8-911e-991953869562/config-reloader/0.log"
Jul 31 02:40:52.497405 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:52.497358    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4d3d7df3-54dc-41e8-911e-991953869562/kube-rbac-proxy-web/0.log"
Jul 31 02:40:52.542477 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:52.542444    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4d3d7df3-54dc-41e8-911e-991953869562/kube-rbac-proxy/0.log"
Jul 31 02:40:52.596734 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:52.596709    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4d3d7df3-54dc-41e8-911e-991953869562/kube-rbac-proxy-metric/0.log"
Jul 31 02:40:52.652622 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:52.652548    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4d3d7df3-54dc-41e8-911e-991953869562/prom-label-proxy/0.log"
Jul 31 02:40:52.733871 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:52.733844    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4d3d7df3-54dc-41e8-911e-991953869562/init-config-reloader/0.log"
Jul 31 02:40:52.880511 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:52.880483    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-rc4bq_a800110d-2f4c-42b0-a1e6-89c0b3a2140c/kube-state-metrics/0.log"
Jul 31 02:40:52.932017 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:52.931932    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-rc4bq_a800110d-2f4c-42b0-a1e6-89c0b3a2140c/kube-rbac-proxy-main/0.log"
Jul 31 02:40:52.972280 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:52.972251    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-rc4bq_a800110d-2f4c-42b0-a1e6-89c0b3a2140c/kube-rbac-proxy-self/0.log"
Jul 31 02:40:53.035097 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:53.035073    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-749dc88778-z9gkf_b14026ed-4c0e-498d-89e4-4ebacc4c51e2/metrics-server/0.log"
Jul 31 02:40:53.108430 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:53.108403    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-k5kkh_b3247823-dc00-4058-ac7b-45b7155273b4/monitoring-plugin/0.log"
Jul 31 02:40:53.376405 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:53.376376    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9kqcl_97255a23-484f-40db-8480-d40cd155a620/node-exporter/0.log"
Jul 31 02:40:53.439289 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:53.439263    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9kqcl_97255a23-484f-40db-8480-d40cd155a620/kube-rbac-proxy/0.log"
Jul 31 02:40:53.498396 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:53.498366    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9kqcl_97255a23-484f-40db-8480-d40cd155a620/init-textfile/0.log"
Jul 31 02:40:54.411088 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:54.411052    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tsc55/perf-node-gather-daemonset-dzj9n"]
Jul 31 02:40:54.416103 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:54.416077    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-dzj9n"
Jul 31 02:40:54.434451 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:54.434421    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tsc55/perf-node-gather-daemonset-dzj9n"]
Jul 31 02:40:54.518622 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:54.518593    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8226a936-a661-422a-bf4d-4788edef504f-podres\") pod \"perf-node-gather-daemonset-dzj9n\" (UID: \"8226a936-a661-422a-bf4d-4788edef504f\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-dzj9n"
Jul 31 02:40:54.518622 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:54.518633    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8226a936-a661-422a-bf4d-4788edef504f-lib-modules\") pod \"perf-node-gather-daemonset-dzj9n\" (UID: \"8226a936-a661-422a-bf4d-4788edef504f\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-dzj9n"
Jul 31 02:40:54.518837 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:54.518669    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2cc7\" (UniqueName: \"kubernetes.io/projected/8226a936-a661-422a-bf4d-4788edef504f-kube-api-access-k2cc7\") pod \"perf-node-gather-daemonset-dzj9n\" (UID: \"8226a936-a661-422a-bf4d-4788edef504f\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-dzj9n"
Jul 31 02:40:54.518837 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:54.518736    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8226a936-a661-422a-bf4d-4788edef504f-proc\") pod \"perf-node-gather-daemonset-dzj9n\" (UID: \"8226a936-a661-422a-bf4d-4788edef504f\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-dzj9n"
Jul 31 02:40:54.518837 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:54.518775    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8226a936-a661-422a-bf4d-4788edef504f-sys\") pod \"perf-node-gather-daemonset-dzj9n\" (UID: \"8226a936-a661-422a-bf4d-4788edef504f\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-dzj9n"
Jul 31 02:40:54.589529 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:54.589503    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bb7c8956f-q9jb9_a60a9b09-5ec6-4b58-aeac-88ca6b97ea84/telemeter-client/0.log"
Jul 31 02:40:54.619785 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:54.619756    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8226a936-a661-422a-bf4d-4788edef504f-sys\") pod \"perf-node-gather-daemonset-dzj9n\" (UID: \"8226a936-a661-422a-bf4d-4788edef504f\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-dzj9n"
Jul 31 02:40:54.620006 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:54.619835    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8226a936-a661-422a-bf4d-4788edef504f-podres\") pod \"perf-node-gather-daemonset-dzj9n\" (UID: \"8226a936-a661-422a-bf4d-4788edef504f\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-dzj9n"
Jul 31 02:40:54.620006 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:54.619867    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8226a936-a661-422a-bf4d-4788edef504f-lib-modules\") pod \"perf-node-gather-daemonset-dzj9n\" (UID: \"8226a936-a661-422a-bf4d-4788edef504f\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-dzj9n"
Jul 31 02:40:54.620006 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:54.619918    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2cc7\" (UniqueName: \"kubernetes.io/projected/8226a936-a661-422a-bf4d-4788edef504f-kube-api-access-k2cc7\") pod \"perf-node-gather-daemonset-dzj9n\" (UID: \"8226a936-a661-422a-bf4d-4788edef504f\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-dzj9n"
Jul 31 02:40:54.620006 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:54.619922    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8226a936-a661-422a-bf4d-4788edef504f-sys\") pod \"perf-node-gather-daemonset-dzj9n\" (UID: \"8226a936-a661-422a-bf4d-4788edef504f\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-dzj9n"
Jul 31 02:40:54.620006 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:54.619960    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8226a936-a661-422a-bf4d-4788edef504f-proc\") pod \"perf-node-gather-daemonset-dzj9n\" (UID: \"8226a936-a661-422a-bf4d-4788edef504f\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-dzj9n"
Jul 31 02:40:54.620223 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:54.620026    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8226a936-a661-422a-bf4d-4788edef504f-podres\") pod \"perf-node-gather-daemonset-dzj9n\" (UID: \"8226a936-a661-422a-bf4d-4788edef504f\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-dzj9n"
Jul 31 02:40:54.620223 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:54.620034    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8226a936-a661-422a-bf4d-4788edef504f-proc\") pod \"perf-node-gather-daemonset-dzj9n\" (UID: \"8226a936-a661-422a-bf4d-4788edef504f\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-dzj9n"
Jul 31 02:40:54.620223 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:54.620092    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8226a936-a661-422a-bf4d-4788edef504f-lib-modules\") pod \"perf-node-gather-daemonset-dzj9n\" (UID: \"8226a936-a661-422a-bf4d-4788edef504f\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-dzj9n"
Jul 31 02:40:54.634560 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:54.634531    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2cc7\" (UniqueName: \"kubernetes.io/projected/8226a936-a661-422a-bf4d-4788edef504f-kube-api-access-k2cc7\") pod \"perf-node-gather-daemonset-dzj9n\" (UID: \"8226a936-a661-422a-bf4d-4788edef504f\") " pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-dzj9n"
Jul 31 02:40:54.643609 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:54.643582    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bb7c8956f-q9jb9_a60a9b09-5ec6-4b58-aeac-88ca6b97ea84/reload/0.log"
Jul 31 02:40:54.709906 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:54.709812    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bb7c8956f-q9jb9_a60a9b09-5ec6-4b58-aeac-88ca6b97ea84/kube-rbac-proxy/0.log"
Jul 31 02:40:54.727548 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:54.727511    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-dzj9n"
Jul 31 02:40:54.791868 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:54.791799    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6998c95b5c-pwxt7_50eb9b90-31e1-45a4-bfff-c8214570c5d4/thanos-query/0.log"
Jul 31 02:40:54.851306 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:54.851273    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6998c95b5c-pwxt7_50eb9b90-31e1-45a4-bfff-c8214570c5d4/kube-rbac-proxy-web/0.log"
Jul 31 02:40:54.919746 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:54.917690    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tsc55/perf-node-gather-daemonset-dzj9n"]
Jul 31 02:40:54.923480 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:54.922924    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6998c95b5c-pwxt7_50eb9b90-31e1-45a4-bfff-c8214570c5d4/kube-rbac-proxy/0.log"
Jul 31 02:40:54.924877 ip-10-0-133-91 kubenswrapper[2571]: W0731 02:40:54.924845    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8226a936_a661_422a_bf4d_4788edef504f.slice/crio-c2a80b1da7e6e1cae9a421b80b9bde53386cbd05388330fc1156e70fbc7b846d WatchSource:0}: Error finding container c2a80b1da7e6e1cae9a421b80b9bde53386cbd05388330fc1156e70fbc7b846d: Status 404 returned error can't find the container with id c2a80b1da7e6e1cae9a421b80b9bde53386cbd05388330fc1156e70fbc7b846d
Jul 31 02:40:54.951018 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:54.950993    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6998c95b5c-pwxt7_50eb9b90-31e1-45a4-bfff-c8214570c5d4/prom-label-proxy/0.log"
Jul 31 02:40:54.983146 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:54.983124    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6998c95b5c-pwxt7_50eb9b90-31e1-45a4-bfff-c8214570c5d4/kube-rbac-proxy-rules/0.log"
Jul 31 02:40:55.017092 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:55.017067    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6998c95b5c-pwxt7_50eb9b90-31e1-45a4-bfff-c8214570c5d4/kube-rbac-proxy-metrics/0.log"
Jul 31 02:40:55.113452 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:55.113412    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-dzj9n" event={"ID":"8226a936-a661-422a-bf4d-4788edef504f","Type":"ContainerStarted","Data":"ebce4b3f36c9904fb7ead01bc396bb69c8844611105d7352630d4991b36be0c3"}
Jul 31 02:40:55.113656 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:55.113479    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-dzj9n" event={"ID":"8226a936-a661-422a-bf4d-4788edef504f","Type":"ContainerStarted","Data":"c2a80b1da7e6e1cae9a421b80b9bde53386cbd05388330fc1156e70fbc7b846d"}
Jul 31 02:40:55.114335 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:55.114311    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-dzj9n"
Jul 31 02:40:55.140816 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:55.140760    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-dzj9n" podStartSLOduration=1.140740193 podStartE2EDuration="1.140740193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 02:40:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 02:40:55.138788309 +0000 UTC m=+3815.719029306" watchObservedRunningTime="2026-07-31 02:40:55.140740193 +0000 UTC m=+3815.720981188"
Jul 31 02:40:57.455213 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:57.455186    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6789d9cdbc-p8r68_560907ba-2c4f-4a57-9df8-00df1b27ac28/console/0.log"
Jul 31 02:40:58.108501 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:58.108477    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-jrpst_1e80ef61-7c6a-48d3-9406-7d1e7435fa6a/volume-data-source-validator/0.log"
Jul 31 02:40:59.288474 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:59.288440    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hpfnx_7cec939f-eacf-4254-abbd-75903f407f37/dns/0.log"
Jul 31 02:40:59.310478 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:59.310456    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hpfnx_7cec939f-eacf-4254-abbd-75903f407f37/kube-rbac-proxy/0.log"
Jul 31 02:40:59.375079 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:59.375049    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l4gcr_522b6666-22de-4d13-9794-07680e2375d6/dns-node-resolver/0.log"
Jul 31 02:40:59.974727 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:40:59.974702    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5744646c59-dd2zb_ab0653aa-986c-458e-9c33-d98bbcb9b39d/registry/0.log"
Jul 31 02:41:00.000709 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:00.000682    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5vkv9_09fec214-2f3f-4166-8687-3c1c822794c3/node-ca/0.log"
Jul 31 02:41:01.093924 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:01.093876    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc_7a88687a-ceee-4892-aa46-a7ba43f9e5c4/istio-proxy/0.log"
Jul 31 02:41:01.280193 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:01.280169    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-647dc4ddc5-4g7zg_8d0f53f2-f485-47c8-ac3c-a68e2b5fe382/kube-auth-proxy/0.log"
Jul 31 02:41:01.347457 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:01.347369    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-58nx6_90a0eefd-19e3-44f9-8390-2e82d93e10f3/istio-proxy/0.log"
Jul 31 02:41:01.356530 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:01.356492    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-58nx6_90a0eefd-19e3-44f9-8390-2e82d93e10f3/istio-proxy/1.log"
Jul 31 02:41:01.458198 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:01.458160    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78d646dddb-6hkw9_03e216bb-cb12-4fb4-a9dd-a693daa5f657/router/0.log"
Jul 31 02:41:02.151277 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:02.151252    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tsc55/perf-node-gather-daemonset-dzj9n"
Jul 31 02:41:02.340519 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:02.340482    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-djswh_275216a4-fea3-4c16-bb45-425da974aa47/serve-healthcheck-canary/0.log"
Jul 31 02:41:03.169615 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:03.169566    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-gklgq_7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22/insights-operator/0.log"
Jul 31 02:41:03.172727 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:03.172703    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-gklgq_7f90bf7d-b0d8-4c7d-97bf-472bf70ebf22/insights-operator/1.log"
Jul 31 02:41:03.455832 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:03.455794    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tqt22_7d67508f-6254-4125-a86a-74d85ac5e22c/kube-rbac-proxy/0.log"
Jul 31 02:41:03.507573 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:03.507544    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tqt22_7d67508f-6254-4125-a86a-74d85ac5e22c/exporter/0.log"
Jul 31 02:41:03.553962 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:03.553937    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tqt22_7d67508f-6254-4125-a86a-74d85ac5e22c/extractor/0.log"
Jul 31 02:41:05.494176 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:05.494146    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc_7a88687a-ceee-4892-aa46-a7ba43f9e5c4/istio-proxy/0.log"
Jul 31 02:41:05.671255 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:05.671224    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-647dc4ddc5-4g7zg_8d0f53f2-f485-47c8-ac3c-a68e2b5fe382/kube-auth-proxy/0.log"
Jul 31 02:41:05.723858 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:05.723831    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-58nx6_90a0eefd-19e3-44f9-8390-2e82d93e10f3/istio-proxy/0.log"
Jul 31 02:41:05.731103 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:05.731080    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-58nx6_90a0eefd-19e3-44f9-8390-2e82d93e10f3/istio-proxy/1.log"
Jul 31 02:41:05.800877 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:05.800795    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78d646dddb-6hkw9_03e216bb-cb12-4fb4-a9dd-a693daa5f657/router/0.log"
Jul 31 02:41:06.260421 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:06.260388    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-j99bz_28b7c570-b419-4cf3-ad97-2a449e9f2e50/manager/0.log"
Jul 31 02:41:06.558733 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:06.558707    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-mlh8q_69736619-a3ac-401f-b5d9-d87c27c4e016/manager/0.log"
Jul 31 02:41:06.755926 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:06.755866    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-drmhh_b60fa90c-c0af-43d1-8e91-23eceb898f0e/server/0.log"
Jul 31 02:41:06.860951 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:06.860914    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-n2p4d_1af1fd09-ca7c-4981-a5a5-e1070360071c/manager/0.log"
Jul 31 02:41:06.928980 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:06.928950    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77df9dc58b-8bq85_477eada6-4571-4d0d-9150-35d28d5f40b9/manager/0.log"
Jul 31 02:41:07.000457 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:07.000426    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77df9dc58b-8bq85_477eada6-4571-4d0d-9150-35d28d5f40b9/copy-manifests/0.log"
Jul 31 02:41:07.259189 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:07.259103    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-82scc_7a88687a-ceee-4892-aa46-a7ba43f9e5c4/istio-proxy/0.log"
Jul 31 02:41:07.453432 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:07.453401    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-647dc4ddc5-4g7zg_8d0f53f2-f485-47c8-ac3c-a68e2b5fe382/kube-auth-proxy/0.log"
Jul 31 02:41:07.534522 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:07.534454    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-58nx6_90a0eefd-19e3-44f9-8390-2e82d93e10f3/istio-proxy/0.log"
Jul 31 02:41:07.542544 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:07.542523    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-58nx6_90a0eefd-19e3-44f9-8390-2e82d93e10f3/istio-proxy/1.log"
Jul 31 02:41:07.628611 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:07.628578    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78d646dddb-6hkw9_03e216bb-cb12-4fb4-a9dd-a693daa5f657/router/0.log"
Jul 31 02:41:08.797680 ip-10-0-133-91 kubenswrapper[2571]: I0731 02:41:08.797656    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-7bf6d_eb90837c-8841-4a5b-ac9e-62734e84f24d/openshift-lws-operator/0.log"