Jul 28 20:25:14.390102 ip-10-0-136-118 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 20:25:14.778463 ip-10-0-136-118 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 20:25:14.778463 ip-10-0-136-118 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 20:25:14.778463 ip-10-0-136-118 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 20:25:14.778463 ip-10-0-136-118 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 20:25:14.778463 ip-10-0-136-118 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 20:25:14.780553 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.780470    2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 20:25:14.787152 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787137    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 20:25:14.787152 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787153    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 20:25:14.787215 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787157    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 20:25:14.787215 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787160    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 20:25:14.787215 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787163    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 20:25:14.787215 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787165    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 20:25:14.787215 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787168    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 20:25:14.787215 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787171    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 20:25:14.787215 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787174    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 20:25:14.787215 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787177    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 20:25:14.787215 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787179    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 20:25:14.787215 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787187    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 20:25:14.787215 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787190    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 20:25:14.787215 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787193    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 20:25:14.787215 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787195    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 20:25:14.787215 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787198    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 20:25:14.787215 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787201    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 20:25:14.787215 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787203    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 20:25:14.787215 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787206    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 20:25:14.787215 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787208    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 20:25:14.787215 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787211    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 20:25:14.787215 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787213    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 20:25:14.787697 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787217    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 20:25:14.787697 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787222    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 20:25:14.787697 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787225    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 20:25:14.787697 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787228    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 20:25:14.787697 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787231    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 20:25:14.787697 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787233    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 20:25:14.787697 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787236    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 20:25:14.787697 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787238    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 20:25:14.787697 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787241    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 20:25:14.787697 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787243    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 20:25:14.787697 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787246    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 20:25:14.787697 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787249    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 20:25:14.787697 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787251    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 20:25:14.787697 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787254    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 20:25:14.787697 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787256    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 20:25:14.787697 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787259    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 20:25:14.787697 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787261    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 20:25:14.787697 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787264    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 20:25:14.787697 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787266    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 20:25:14.787697 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787269    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 20:25:14.788237 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787271    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 20:25:14.788237 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787274    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 20:25:14.788237 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787276    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 20:25:14.788237 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787278    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 20:25:14.788237 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787281    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 20:25:14.788237 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787283    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 20:25:14.788237 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787286    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 20:25:14.788237 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787288    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 20:25:14.788237 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787291    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 20:25:14.788237 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787293    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 20:25:14.788237 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787295    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 20:25:14.788237 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787298    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 20:25:14.788237 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787300    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 20:25:14.788237 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787304    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 20:25:14.788237 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787306    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 20:25:14.788237 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787309    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 20:25:14.788237 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787312    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 20:25:14.788237 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787314    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 20:25:14.788237 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787316    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 20:25:14.788237 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787320    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 20:25:14.788735 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787322    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 20:25:14.788735 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787325    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 20:25:14.788735 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787328    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 20:25:14.788735 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787332    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 20:25:14.788735 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787335    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 20:25:14.788735 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787337    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 20:25:14.788735 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787340    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 20:25:14.788735 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787343    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 20:25:14.788735 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787345    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 20:25:14.788735 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787349    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 20:25:14.788735 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787351    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 20:25:14.788735 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787353    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 20:25:14.788735 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787356    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 20:25:14.788735 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787358    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 20:25:14.788735 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787361    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 20:25:14.788735 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787363    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 20:25:14.788735 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787366    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 20:25:14.788735 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787368    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 20:25:14.788735 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787371    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 20:25:14.789221 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787373    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 20:25:14.789221 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787378    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 20:25:14.789221 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787380    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 20:25:14.789221 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787383    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 20:25:14.789221 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787385    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 20:25:14.789221 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787388    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 20:25:14.789221 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787391    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 20:25:14.789221 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787394    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 20:25:14.789221 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787396    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 20:25:14.789221 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787399    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 20:25:14.789221 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787402    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 20:25:14.789221 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787404    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 20:25:14.789221 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787407    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 20:25:14.789221 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787411    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 20:25:14.789221 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787414    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 20:25:14.789221 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787417    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 20:25:14.789221 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787420    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 20:25:14.789221 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.787423    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 20:25:14.789221 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788145    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 20:25:14.789703 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788155    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 20:25:14.789703 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788159    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 20:25:14.789703 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788162    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 20:25:14.789703 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788164    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 20:25:14.789703 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788167    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 20:25:14.789703 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788171    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 20:25:14.789703 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788174    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 20:25:14.789703 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788177    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 20:25:14.789703 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788179    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 20:25:14.789703 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788182    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 20:25:14.789703 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788185    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 20:25:14.789703 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788188    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 20:25:14.789703 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788190    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 20:25:14.789703 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788193    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 20:25:14.789703 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788195    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 20:25:14.789703 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788198    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 20:25:14.789703 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788200    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 20:25:14.789703 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788203    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 20:25:14.789703 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788205    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 20:25:14.789703 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788209    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 20:25:14.790213 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788212    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 20:25:14.790213 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788215    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 20:25:14.790213 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788217    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 20:25:14.790213 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788220    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 20:25:14.790213 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788222    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 20:25:14.790213 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788224    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 20:25:14.790213 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788228    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 20:25:14.790213 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788232    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 20:25:14.790213 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788235    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 20:25:14.790213 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788238    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 20:25:14.790213 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788241    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 20:25:14.790213 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788244    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 20:25:14.790213 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788247    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 20:25:14.790213 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788251    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 20:25:14.790213 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788256    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 20:25:14.790213 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788258    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 20:25:14.790213 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788261    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 20:25:14.790213 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788264    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 20:25:14.790213 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788267    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 20:25:14.790683 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788270    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 20:25:14.790683 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788272    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 20:25:14.790683 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788275    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 20:25:14.790683 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788277    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 20:25:14.790683 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788280    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 20:25:14.790683 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788282    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 20:25:14.790683 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788285    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 20:25:14.790683 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788287    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 20:25:14.790683 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788290    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 20:25:14.790683 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788292    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 20:25:14.790683 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788296    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 20:25:14.790683 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788298    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 20:25:14.790683 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788301    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 20:25:14.790683 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788304    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 20:25:14.790683 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788306    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 20:25:14.790683 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788309    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 20:25:14.790683 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788311    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 20:25:14.790683 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788314    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 20:25:14.790683 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788316    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 20:25:14.790683 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788319    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 20:25:14.791233 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788321    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 20:25:14.791233 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788323    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 20:25:14.791233 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788326    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 20:25:14.791233 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788328    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 20:25:14.791233 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788331    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 20:25:14.791233 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788333    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 20:25:14.791233 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788337    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 20:25:14.791233 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788339    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 20:25:14.791233 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788342    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 20:25:14.791233 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788344    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 20:25:14.791233 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788346    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 20:25:14.791233 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788349    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 20:25:14.791233 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788352    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 20:25:14.791233 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788355    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 20:25:14.791233 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788357    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 20:25:14.791233 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788359    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 20:25:14.791233 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788362    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 20:25:14.791233 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788364    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 20:25:14.791233 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788367    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 20:25:14.791233 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788369    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 20:25:14.791724 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788372    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 20:25:14.791724 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788374    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 20:25:14.791724 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788377    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 20:25:14.791724 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788380    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 20:25:14.791724 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788383    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 20:25:14.791724 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788385    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 20:25:14.791724 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788388    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 20:25:14.791724 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788390    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 20:25:14.791724 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788392    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 20:25:14.791724 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788395    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 20:25:14.791724 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788397    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 20:25:14.791724 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788400    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 20:25:14.791724 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788402    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 20:25:14.791724 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788405    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 20:25:14.791724 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788407    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 20:25:14.791724 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788410    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 20:25:14.791724 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788412    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 20:25:14.791724 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788415    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 20:25:14.791724 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788417    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 20:25:14.791724 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788786    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 20:25:14.792231 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788791    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 20:25:14.792231 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788794    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 20:25:14.792231 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788798    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 20:25:14.792231 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788801    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 20:25:14.792231 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788804    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 20:25:14.792231 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788807    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 20:25:14.792231 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788810    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 20:25:14.792231 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788812    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 20:25:14.792231 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788816    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 20:25:14.792231 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788819    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 20:25:14.792231 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788822    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 20:25:14.792231 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788824    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 20:25:14.792231 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788827    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 20:25:14.792231 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788844    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 20:25:14.792231 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788848    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 20:25:14.792231 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788851    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 20:25:14.792231 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788854    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 20:25:14.792231 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788857    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 20:25:14.792231 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788859    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 20:25:14.792231 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788862    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 20:25:14.792723 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788865    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 20:25:14.792723 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788868    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 20:25:14.792723 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788871    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 20:25:14.792723 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788873    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 20:25:14.792723 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788876    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 20:25:14.792723 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788878    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 20:25:14.792723 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788881    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 20:25:14.792723 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788884    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 20:25:14.792723 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788886    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 20:25:14.792723 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788889    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 20:25:14.792723 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788892    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 20:25:14.792723 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788896    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 20:25:14.792723 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788899    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 20:25:14.792723 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788902    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 20:25:14.792723 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788905    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 20:25:14.792723 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788907    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 20:25:14.792723 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788914    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 20:25:14.792723 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788917    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 20:25:14.792723 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788919    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 20:25:14.792723 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788922    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 20:25:14.793259 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788925    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 20:25:14.793259 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788927    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 20:25:14.793259 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788930    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 20:25:14.793259 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788933    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 20:25:14.793259 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788936    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 20:25:14.793259 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788938    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 20:25:14.793259 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788941    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 20:25:14.793259 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788944    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 20:25:14.793259 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788947    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 20:25:14.793259 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788949    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 20:25:14.793259 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788952    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 20:25:14.793259 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788954    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 20:25:14.793259 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788957    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 20:25:14.793259 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788959    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 20:25:14.793259 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788962    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 20:25:14.793259 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788964    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 20:25:14.793259 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788967    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 20:25:14.793259 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788970    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 20:25:14.793259 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788973    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 20:25:14.793731 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788976    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 20:25:14.793731 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788979    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 20:25:14.793731 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788982    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 20:25:14.793731 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788985    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 20:25:14.793731 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788988    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 20:25:14.793731 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788991    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 20:25:14.793731 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788993    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 20:25:14.793731 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788996    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 20:25:14.793731 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.788998    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 20:25:14.793731 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789001    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 20:25:14.793731 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789004    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 20:25:14.793731 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789007    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 20:25:14.793731 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789010    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 20:25:14.793731 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789012    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 20:25:14.793731 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789015    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 20:25:14.793731 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789017    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 20:25:14.793731 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789020    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 20:25:14.793731 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789022    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 20:25:14.793731 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789024    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 20:25:14.793731 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789027    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 20:25:14.794228 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789029    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 20:25:14.794228 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789032    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 20:25:14.794228 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789035    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 20:25:14.794228 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789037    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 20:25:14.794228 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789040    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 20:25:14.794228 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789042    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 20:25:14.794228 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789045    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 20:25:14.794228 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789047    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 20:25:14.794228 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789050    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 20:25:14.794228 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789052    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 20:25:14.794228 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789055    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 20:25:14.794228 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789057    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 20:25:14.794228 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789060    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 20:25:14.794228 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789062    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 20:25:14.794228 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789065    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 20:25:14.794228 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789067    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 20:25:14.794228 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789069    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 20:25:14.794228 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789072    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 20:25:14.794228 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789074    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 20:25:14.794700 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789134    2556 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 20:25:14.794700 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789141    2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 20:25:14.794700 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789147    2556 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 20:25:14.794700 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789151    2556 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 20:25:14.794700 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789155    2556 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 20:25:14.794700 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789159    2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 20:25:14.794700 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789163    2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 20:25:14.794700 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789167    2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 20:25:14.794700 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789170    2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 20:25:14.794700 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789173    2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 20:25:14.794700 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789176    2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 20:25:14.794700 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789179    2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 20:25:14.794700 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789185    2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 20:25:14.794700 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789188    2556 flags.go:64] FLAG: --cgroup-root=""
Jul 28 20:25:14.794700 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789191    2556 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 20:25:14.794700 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789194    2556 flags.go:64] FLAG: --client-ca-file=""
Jul 28 20:25:14.794700 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789197    2556 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 20:25:14.794700 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789201    2556 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 20:25:14.794700 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789205    2556 flags.go:64] FLAG: --cluster-domain=""
Jul 28 20:25:14.794700 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789208    2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 20:25:14.794700 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789211    2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 20:25:14.794700 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789214    2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 20:25:14.794700 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789217    2556 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 20:25:14.794700 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789221    2556 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 20:25:14.795352 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789224    2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 20:25:14.795352 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789227    2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 20:25:14.795352 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789231    2556 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 20:25:14.795352 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789234    2556 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 20:25:14.795352 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789237    2556 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 20:25:14.795352 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789240    2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 20:25:14.795352 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789243    2556 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 20:25:14.795352 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789246    2556 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 20:25:14.795352 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789250    2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 20:25:14.795352 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789253    2556 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 20:25:14.795352 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789255    2556 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 20:25:14.795352 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789258    2556 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 20:25:14.795352 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789261    2556 flags.go:64] FLAG: --enable-server="true"
Jul 28 20:25:14.795352 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789264    2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 20:25:14.795352 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789269    2556 flags.go:64] FLAG: --event-burst="100"
Jul 28 20:25:14.795352 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789273    2556 flags.go:64] FLAG: --event-qps="50"
Jul 28 20:25:14.795352 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789275    2556 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 20:25:14.795352 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789279    2556 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 20:25:14.795352 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789281    2556 flags.go:64] FLAG: --eviction-hard=""
Jul 28 20:25:14.795352 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789285    2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 20:25:14.795352 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789290    2556 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 20:25:14.795352 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789293    2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 20:25:14.795352 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789296    2556 flags.go:64] FLAG: --eviction-soft=""
Jul 28 20:25:14.795352 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789299    2556 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 20:25:14.795352 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789302    2556 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 20:25:14.796024 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789305    2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 20:25:14.796024 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789308    2556 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 20:25:14.796024 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789311    2556 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 20:25:14.796024 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789314    2556 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 20:25:14.796024 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789318    2556 flags.go:64] FLAG: --feature-gates=""
Jul 28 20:25:14.796024 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789321    2556 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 20:25:14.796024 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789324    2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 20:25:14.796024 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789327    2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 20:25:14.796024 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789330    2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 20:25:14.796024 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789333    2556 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 20:25:14.796024 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789336    2556 flags.go:64] FLAG: --help="false"
Jul 28 20:25:14.796024 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789339    2556 flags.go:64] FLAG: --hostname-override="ip-10-0-136-118.ec2.internal"
Jul 28 20:25:14.796024 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789342    2556 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 20:25:14.796024 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789345    2556 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 20:25:14.796024 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789347    2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 20:25:14.796024 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789351    2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 20:25:14.796024 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789354    2556 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 20:25:14.796024 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789357    2556 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 20:25:14.796024 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789360    2556 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 20:25:14.796024 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789362    2556 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 20:25:14.796024 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789365    2556 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 20:25:14.796024 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789369    2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 20:25:14.796024 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789372    2556 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 20:25:14.796024 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789375    2556 flags.go:64] FLAG: --kube-reserved=""
Jul 28 20:25:14.796617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789377    2556 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 20:25:14.796617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789380    2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 20:25:14.796617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789383    2556 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 20:25:14.796617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789387    2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 20:25:14.796617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789390    2556 flags.go:64] FLAG: --lock-file=""
Jul 28 20:25:14.796617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789394    2556 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 20:25:14.796617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789397    2556 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 20:25:14.796617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789400    2556 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 20:25:14.796617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789406    2556 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 20:25:14.796617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789408    2556 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 20:25:14.796617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789411    2556 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 20:25:14.796617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789414    2556 flags.go:64] FLAG: --logging-format="text"
Jul 28 20:25:14.796617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789417    2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 20:25:14.796617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789420    2556 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 20:25:14.796617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789423    2556 flags.go:64] FLAG: --manifest-url=""
Jul 28 20:25:14.796617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789426    2556 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 20:25:14.796617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789430    2556 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 20:25:14.796617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789433    2556 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 20:25:14.796617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789437    2556 flags.go:64] FLAG: --max-pods="110"
Jul 28 20:25:14.796617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789440    2556 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 20:25:14.796617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789443    2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 20:25:14.796617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789446    2556 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 20:25:14.796617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789449    2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 20:25:14.796617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789452    2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 20:25:14.796617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789455    2556 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 20:25:14.797243 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789458    2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 20:25:14.797243 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789464    2556 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 20:25:14.797243 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789467    2556 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 20:25:14.797243 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789470    2556 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 20:25:14.797243 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789473    2556 flags.go:64] FLAG: --pod-cidr=""
Jul 28 20:25:14.797243 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789477    2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 20:25:14.797243 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789482    2556 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 20:25:14.797243 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789485    2556 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 20:25:14.797243 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789488    2556 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 20:25:14.797243 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789491    2556 flags.go:64] FLAG: --port="10250"
Jul 28 20:25:14.797243 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789495    2556 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 20:25:14.797243 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789498    2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07345372d637ef2c4"
Jul 28 20:25:14.797243 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789502    2556 flags.go:64] FLAG: --qos-reserved=""
Jul 28 20:25:14.797243 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789506    2556 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 20:25:14.797243 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789509    2556 flags.go:64] FLAG: --register-node="true"
Jul 28 20:25:14.797243 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789512    2556 flags.go:64] FLAG: --register-with-taints=""
Jul 28 20:25:14.797243 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789515    2556 flags.go:64] FLAG: --registry-burst="10"
Jul 28 20:25:14.797243 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789518    2556 flags.go:64] FLAG: --registry-qps="5"
Jul 28 20:25:14.797243 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789521    2556 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 20:25:14.797243 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789524    2556 flags.go:64] FLAG: --reserved-memory=""
Jul 28 20:25:14.797243 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789527    2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 20:25:14.797243 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789530    2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 20:25:14.797243 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789533    2556 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 20:25:14.797243 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789536    2556 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 20:25:14.797243 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789539    2556 flags.go:64] FLAG: --runonce="false"
Jul 28 20:25:14.797866 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789542    2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 20:25:14.797866 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789545    2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 20:25:14.797866 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789548    2556 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 20:25:14.797866 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789551    2556 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 20:25:14.797866 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789554    2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 20:25:14.797866 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789557    2556 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 20:25:14.797866 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789560    2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 20:25:14.797866 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789563    2556 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 20:25:14.797866 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789566    2556 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 20:25:14.797866 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789569    2556 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 20:25:14.797866 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789572    2556 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 20:25:14.797866 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789575    2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 20:25:14.797866 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789578    2556 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 20:25:14.797866 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789581    2556 flags.go:64] FLAG: --system-cgroups=""
Jul 28 20:25:14.797866 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789584    2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 20:25:14.797866 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789589    2556 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 20:25:14.797866 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789592    2556 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 20:25:14.797866 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789596    2556 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 20:25:14.797866 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789600    2556 flags.go:64] FLAG: --tls-min-version=""
Jul 28 20:25:14.797866 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789603    2556 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 20:25:14.797866 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789607    2556 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 20:25:14.797866 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789610    2556 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 20:25:14.797866 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789613    2556 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 20:25:14.797866 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789616    2556 flags.go:64] FLAG: --v="2"
Jul 28 20:25:14.797866 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789620    2556 flags.go:64] FLAG: --version="false"
Jul 28 20:25:14.798482 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789624    2556 flags.go:64] FLAG: --vmodule=""
Jul 28 20:25:14.798482 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789627    2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 20:25:14.798482 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.789631    2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 20:25:14.798482 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789739    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 20:25:14.798482 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789744    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 20:25:14.798482 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789747    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 20:25:14.798482 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789750    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 20:25:14.798482 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789753    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 20:25:14.798482 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789756    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 20:25:14.798482 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789759    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 20:25:14.798482 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789761    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 20:25:14.798482 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789764    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 20:25:14.798482 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789766    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 20:25:14.798482 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789769    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 20:25:14.798482 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789771    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 20:25:14.798482 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789774    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 20:25:14.798482 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789776    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 20:25:14.798482 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789779    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 20:25:14.798482 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789781    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 20:25:14.798482 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789798    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 20:25:14.799051 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789802    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 20:25:14.799051 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789805    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 20:25:14.799051 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789809    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 20:25:14.799051 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789812    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 20:25:14.799051 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789816    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 20:25:14.799051 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789819    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 20:25:14.799051 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789822    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 20:25:14.799051 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789827    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 20:25:14.799051 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789842    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 20:25:14.799051 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789846    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 20:25:14.799051 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789849    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 20:25:14.799051 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789852    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 20:25:14.799051 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789854    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 20:25:14.799051 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789857    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 20:25:14.799051 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789860    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 20:25:14.799051 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789863    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 20:25:14.799051 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789866    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 20:25:14.799051 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789868    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 20:25:14.799051 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789871    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 20:25:14.799525 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789874    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 20:25:14.799525 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789876    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 20:25:14.799525 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789879    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 20:25:14.799525 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789882    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 20:25:14.799525 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789884    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 20:25:14.799525 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789887    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 20:25:14.799525 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789889    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 20:25:14.799525 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789892    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 20:25:14.799525 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789895    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 20:25:14.799525 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789897    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 20:25:14.799525 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789900    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 20:25:14.799525 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789902    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 20:25:14.799525 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789905    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 20:25:14.799525 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789907    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 20:25:14.799525 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789910    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 20:25:14.799525 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789913    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 20:25:14.799525 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789916    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 20:25:14.799525 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789920    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 20:25:14.799525 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789922    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 20:25:14.799525 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789925    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 20:25:14.800026 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789929    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 20:25:14.800026 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789932    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 20:25:14.800026 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789934    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 20:25:14.800026 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789937    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 20:25:14.800026 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789940    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 20:25:14.800026 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789942    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 20:25:14.800026 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789945    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 20:25:14.800026 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789948    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 20:25:14.800026 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789950    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 20:25:14.800026 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789953    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 20:25:14.800026 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789955    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 20:25:14.800026 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789958    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 20:25:14.800026 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789961    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 20:25:14.800026 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789963    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 20:25:14.800026 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789966    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 20:25:14.800026 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789968    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 20:25:14.800026 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789971    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 20:25:14.800026 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789973    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 20:25:14.800026 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789976    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 20:25:14.800026 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789978    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 20:25:14.800549 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789981    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 20:25:14.800549 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789984    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 20:25:14.800549 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789986    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 20:25:14.800549 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789989    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 20:25:14.800549 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789991    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 20:25:14.800549 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789994    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 20:25:14.800549 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789996    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 20:25:14.800549 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.789999    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 20:25:14.800549 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.790002    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 20:25:14.800549 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.790006    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 20:25:14.800549 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.790009    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 20:25:14.800549 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.790011    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 20:25:14.800549 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.790015    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 20:25:14.800549 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.790018    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 20:25:14.800549 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.790021    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 20:25:14.800549 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.790023    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 20:25:14.800549 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.790027    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 20:25:14.800549 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.790031    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 20:25:14.800549 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.790034    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 20:25:14.800549 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.790037    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 20:25:14.801057 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.790040    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 20:25:14.801057 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.790043    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 20:25:14.801057 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.790046    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 20:25:14.801057 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.790051    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 20:25:14.801057 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.796892    2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 20:25:14.801057 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.796910    2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 20:25:14.801057 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.796929    2556 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 20:25:14.801057 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.796934    2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 20:25:14.801057 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.796996    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 20:25:14.801057 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797002    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 20:25:14.801057 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797005    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 20:25:14.801057 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797008    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 20:25:14.801057 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797011    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 20:25:14.801057 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797025    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 20:25:14.801412 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797030    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 20:25:14.801412 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797035    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 20:25:14.801412 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797039    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 20:25:14.801412 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797042    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 20:25:14.801412 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797046    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 20:25:14.801412 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797050    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 20:25:14.801412 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797054    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 20:25:14.801412 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797059    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 20:25:14.801412 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797061    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 20:25:14.801412 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797064    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 20:25:14.801412 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797067    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 20:25:14.801412 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797070    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 20:25:14.801412 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797073    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 20:25:14.801412 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797076    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 20:25:14.801412 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797079    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 20:25:14.801412 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797087    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 20:25:14.801412 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797090    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 20:25:14.801412 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797092    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 20:25:14.801412 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797095    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 20:25:14.801412 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797098    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 20:25:14.801916 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797101    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 20:25:14.801916 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797103    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 20:25:14.801916 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797106    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 20:25:14.801916 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797114    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 20:25:14.801916 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797117    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 20:25:14.801916 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797120    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 20:25:14.801916 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797122    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 20:25:14.801916 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797125    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 20:25:14.801916 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797127    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 20:25:14.801916 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797130    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 20:25:14.801916 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797132    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 20:25:14.801916 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797135    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 20:25:14.801916 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797139    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 20:25:14.801916 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797143    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 20:25:14.801916 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797147    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 20:25:14.801916 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797150    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 20:25:14.801916 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797153    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 20:25:14.801916 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797156    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 20:25:14.801916 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797159    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 20:25:14.802377 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797162    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 20:25:14.802377 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797165    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 20:25:14.802377 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797167    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 20:25:14.802377 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797170    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 20:25:14.802377 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797173    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 20:25:14.802377 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797175    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 20:25:14.802377 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797178    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 20:25:14.802377 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797180    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 20:25:14.802377 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797183    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 20:25:14.802377 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797185    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 20:25:14.802377 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797188    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 20:25:14.802377 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797191    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 20:25:14.802377 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797193    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 20:25:14.802377 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797196    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 20:25:14.802377 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797198    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 20:25:14.802377 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797201    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 20:25:14.802377 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797204    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 20:25:14.802377 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797214    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 20:25:14.802377 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797217    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 20:25:14.802377 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797219    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 20:25:14.803087 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797222    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 20:25:14.803087 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797224    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 20:25:14.803087 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797227    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 20:25:14.803087 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797229    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 20:25:14.803087 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797232    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 20:25:14.803087 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797234    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 20:25:14.803087 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797236    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 20:25:14.803087 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797239    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 20:25:14.803087 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797241    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 20:25:14.803087 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797244    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 20:25:14.803087 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797247    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 20:25:14.803087 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797249    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 20:25:14.803087 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797252    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 20:25:14.803087 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797255    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 20:25:14.803087 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797258    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 20:25:14.803087 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797260    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 20:25:14.803087 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797263    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 20:25:14.803087 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797266    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 20:25:14.803087 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797268    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 20:25:14.803087 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797271    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 20:25:14.803569 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797274    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 20:25:14.803569 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797278    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 20:25:14.803569 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797281    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 20:25:14.803569 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797284    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 20:25:14.803569 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797287    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 20:25:14.803569 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797290    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 20:25:14.803569 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797293    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 20:25:14.803569 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797295    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 20:25:14.803569 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797298    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 20:25:14.803569 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797301    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 20:25:14.803569 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797309    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 20:25:14.803569 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797312    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 20:25:14.803569 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797314    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 20:25:14.803569 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797317    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 20:25:14.803964 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.797322    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 20:25:14.803964 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797471    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 20:25:14.803964 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797476    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 20:25:14.803964 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797479    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 20:25:14.803964 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797483    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 20:25:14.803964 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797485    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 20:25:14.803964 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797488    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 20:25:14.803964 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797490    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 20:25:14.803964 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797493    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 20:25:14.803964 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797495    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 20:25:14.803964 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797498    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 20:25:14.803964 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797501    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 20:25:14.803964 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797504    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 20:25:14.803964 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797506    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 20:25:14.803964 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797508    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 20:25:14.804339 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797511    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 20:25:14.804339 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797513    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 20:25:14.804339 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797516    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 20:25:14.804339 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797518    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 20:25:14.804339 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797521    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 20:25:14.804339 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797523    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 20:25:14.804339 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797525    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 20:25:14.804339 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797528    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 20:25:14.804339 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797530    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 20:25:14.804339 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797533    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 20:25:14.804339 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797536    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 20:25:14.804339 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797538    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 20:25:14.804339 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797541    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 20:25:14.804339 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797543    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 20:25:14.804339 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797551    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 20:25:14.804339 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797554    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 20:25:14.804339 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797556    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 20:25:14.804339 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797558    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 20:25:14.804339 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797561    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 20:25:14.804339 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797563    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 20:25:14.804822 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797566    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 20:25:14.804822 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797568    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 20:25:14.804822 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797572    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 20:25:14.804822 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797575    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 20:25:14.804822 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797578    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 20:25:14.804822 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797581    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 20:25:14.804822 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797583    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 20:25:14.804822 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797586    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 20:25:14.804822 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797589    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 20:25:14.804822 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797591    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 20:25:14.804822 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797594    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 20:25:14.804822 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797596    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 20:25:14.804822 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797599    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 20:25:14.804822 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797601    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 20:25:14.804822 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797603    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 20:25:14.804822 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797606    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 20:25:14.804822 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797608    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 20:25:14.804822 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797611    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 20:25:14.804822 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797613    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 20:25:14.805293 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797615    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 20:25:14.805293 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797618    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 20:25:14.805293 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797620    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 20:25:14.805293 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797623    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 20:25:14.805293 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797626    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 20:25:14.805293 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797628    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 20:25:14.805293 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797631    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 20:25:14.805293 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797633    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 20:25:14.805293 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797641    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 20:25:14.805293 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797644    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 20:25:14.805293 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797646    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 20:25:14.805293 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797648    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 20:25:14.805293 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797651    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 20:25:14.805293 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797654    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 20:25:14.805293 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797656    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 20:25:14.805293 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797660    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 20:25:14.805293 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797663    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 20:25:14.805293 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797666    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 20:25:14.805733 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797669    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 20:25:14.805733 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797671    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 20:25:14.805733 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797674    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 20:25:14.805733 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797676    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 20:25:14.805733 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797679    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 20:25:14.805733 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797682    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 20:25:14.805733 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797685    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 20:25:14.805733 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797687    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 20:25:14.805733 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797690    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 20:25:14.805733 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797692    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 20:25:14.805733 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797695    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 20:25:14.805733 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797697    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 20:25:14.805733 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797699    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 20:25:14.805733 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797702    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 20:25:14.805733 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797705    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 20:25:14.805733 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797709    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 20:25:14.805733 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797711    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 20:25:14.805733 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797714    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 20:25:14.805733 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797716    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 20:25:14.805733 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797724    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 20:25:14.806236 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797726    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 20:25:14.806236 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797729    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 20:25:14.806236 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797731    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 20:25:14.806236 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797740    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 20:25:14.806236 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797743    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 20:25:14.806236 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797746    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 20:25:14.806236 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797749    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 20:25:14.806236 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:14.797751    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 20:25:14.806236 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.797756    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 20:25:14.806236 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.797891    2556 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 20:25:14.806236 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.801150    2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 20:25:14.806236 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.802695    2556 server.go:1019] "Starting client certificate rotation"
Jul 28 20:25:14.806236 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.802794    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 20:25:14.806236 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.802852    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 20:25:14.808446 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.808426    2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 20:25:14.809828 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.809809    2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 20:25:14.823430 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.823411    2556 log.go:25] "Validated CRI v1 runtime API"
Jul 28 20:25:14.825332 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.825319    2556 log.go:25] "Validated CRI v1 image API"
Jul 28 20:25:14.826185 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.826172    2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 20:25:14.828482 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.828464    2556 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b32e3d20-8be9-4b88-aff0-039b6e453df5:/dev/nvme0n1p3 ced67884-fe0f-4ce7-91ef-c9832d2fb8ea:/dev/nvme0n1p4]
Jul 28 20:25:14.828543 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.828482    2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 20:25:14.830541 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.830525    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 20:25:14.834103 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.833996    2556 manager.go:216] Machine: {Timestamp:2026-07-28 20:25:14.832797428 +0000 UTC m=+0.329696764 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096636 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2270c79a82fbb4df9c7559a46fb008 SystemUUID:ec2270c7-9a82-fbb4-df9c-7559a46fb008 BootID:3ab65c0d-c306-4723-b2ee-71cf19108a4e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:93:e1:bc:aa:0f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:93:e1:bc:aa:0f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:36:fe:13:27:01 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 20:25:14.834103 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.834098    2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 20:25:14.834210 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.834175    2556 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 20:25:14.835619 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.835590    2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 20:25:14.835774 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.835622    2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-118.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 20:25:14.836391 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.836381    2556 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 20:25:14.836426 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.836394    2556 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 20:25:14.836426 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.836406    2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 20:25:14.837097 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.837086    2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 20:25:14.837941 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.837931    2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 20:25:14.839791 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.839780    2556 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 20:25:14.839912 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.839903    2556 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 20:25:14.839944 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.839932    2556 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 20:25:14.839975 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.839959    2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 20:25:14.840006 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.839976    2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 20:25:14.840006 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.839989    2556 kubelet.go:398] "Adding apiserver pod source"
Jul 28 20:25:14.840006 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.840000    2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 20:25:14.840510 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.840485    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 20:25:14.840604 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.840515    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 20:25:14.843132 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.843113    2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 20:25:14.847440 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.847417    2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 20:25:14.847507 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.847462    2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 20:25:14.849567 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.849553    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 20:25:14.849616 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.849577    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 20:25:14.849616 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.849586    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 20:25:14.849616 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.849595    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 20:25:14.849616 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.849608    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 20:25:14.849616 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.849616    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 20:25:14.849749 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.849630    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 20:25:14.849749 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.849639    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 20:25:14.849749 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.849649    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 20:25:14.849749 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.849658    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 20:25:14.849749 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.849680    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 20:25:14.849749 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.849689    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 20:25:14.849749 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.849723    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 20:25:14.849749 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.849734    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 20:25:14.850276 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:14.850248    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-118.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 20:25:14.850276 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:14.850248    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 20:25:14.851906 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.851885    2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-118.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 20:25:14.853084 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.853066    2556 server.go:1268] "Started kubelet"
Jul 28 20:25:14.853196 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.853148    2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 20:25:14.853247 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.853216    2556 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 20:25:14.853295 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.853274    2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 20:25:14.854000 ip-10-0-136-118 systemd[1]: Started Kubernetes Kubelet.
Jul 28 20:25:14.854932 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.854885    2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 20:25:14.855460 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.855447    2556 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 20:25:14.858140 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:14.858118    2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 20:25:14.859079 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.859055    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ct2hd"
Jul 28 20:25:14.859294 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:14.858193    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-118.ec2.internal.18c68de480dd709d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-118.ec2.internal,UID:ip-10-0-136-118.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-118.ec2.internal,},FirstTimestamp:2026-07-28 20:25:14.853036189 +0000 UTC m=+0.349935526,LastTimestamp:2026-07-28 20:25:14.853036189 +0000 UTC m=+0.349935526,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-118.ec2.internal,}"
Jul 28 20:25:14.861972 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.861958    2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 20:25:14.861972 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.861964    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 20:25:14.862145 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:14.862122    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-118.ec2.internal\" not found"
Jul 28 20:25:14.862511 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.862492    2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 20:25:14.862511 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.862494    2556 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 20:25:14.862632 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.862524    2556 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 20:25:14.862691 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.862631    2556 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 20:25:14.862691 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.862641    2556 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 20:25:14.863251 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.863217    2556 factory.go:55] Registering systemd factory
Jul 28 20:25:14.863251 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.863241    2556 factory.go:223] Registration of the systemd container factory successfully
Jul 28 20:25:14.863484 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.863470    2556 factory.go:153] Registering CRI-O factory
Jul 28 20:25:14.863550 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.863489    2556 factory.go:223] Registration of the crio container factory successfully
Jul 28 20:25:14.863550 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.863540    2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 20:25:14.863633 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.863566    2556 factory.go:103] Registering Raw factory
Jul 28 20:25:14.863633 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.863584    2556 manager.go:1196] Started watching for new ooms in manager
Jul 28 20:25:14.864205 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.864188    2556 manager.go:349] Starting recovery of all containers
Jul 28 20:25:14.867205 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.867180    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ct2hd"
Jul 28 20:25:14.869390 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:14.869364    2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-118.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 28 20:25:14.869478 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:14.869457    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 28 20:25:14.873550 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.873526    2556 manager.go:354] Recovery completed
Jul 28 20:25:14.879170 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.879157    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:25:14.881716 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.881701    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:25:14.881769 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.881728    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:25:14.881769 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.881738    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:25:14.882278 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.882263    2556 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 20:25:14.882278 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.882276    2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 20:25:14.882402 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.882290    2556 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 20:25:14.882402 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.882301    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:25:14.883807 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.883796    2556 policy_none.go:49] "None policy: Start"
Jul 28 20:25:14.883865 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.883812    2556 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 20:25:14.883865 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.883821    2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 20:25:14.884960 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.884945    2556 policy_none.go:47] "Start"
Jul 28 20:25:14.886907 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.886891    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:25:14.886993 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.886917    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:25:14.886993 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.886931    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:25:14.915971 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.915810    2556 manager.go:337] "Starting Device Plugin manager"
Jul 28 20:25:14.916051 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:14.915990    2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 20:25:14.916051 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.916005    2556 server.go:87] "Starting device plugin registration server"
Jul 28 20:25:14.916192 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.916180    2556 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 20:25:14.916225 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.916196    2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 20:25:14.916291 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.916271    2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 20:25:14.916371 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.916354    2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 20:25:14.916371 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:14.916369    2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 20:25:14.916891 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:14.916869    2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 20:25:14.916985 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:14.916917    2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-118.ec2.internal\" not found"
Jul 28 20:25:16.294735 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.294711    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:25:16.295614 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.295592    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:25:16.295721 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.295624    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:25:16.295721 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.295641    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:25:16.295721 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.295669    2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-118.ec2.internal"
Jul 28 20:25:16.305782 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.305753    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 20:25:16.307114 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.307069    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 20:25:16.307196 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.307122    2556 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 20:25:16.307196 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.307147    2556 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 20:25:16.307196 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:16.307190    2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 20:25:16.308933 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.308913    2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-118.ec2.internal"
Jul 28 20:25:16.309022 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:16.308939    2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-118.ec2.internal\": node \"ip-10-0-136-118.ec2.internal\" not found"
Jul 28 20:25:16.309827 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.309813    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 20:25:16.363942 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:16.363919    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-118.ec2.internal\" not found"
Jul 28 20:25:16.407995 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.407975    2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-118.ec2.internal"]
Jul 28 20:25:16.408083 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.408035    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:25:16.409022 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.409007    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:25:16.409079 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.409037    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:25:16.409079 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.409050    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:25:16.410368 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.410324    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:25:16.410446 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.410430    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal"
Jul 28 20:25:16.410490 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.410462    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:25:16.411191 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.411171    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:25:16.411191 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.411183    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:25:16.411339 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.411202    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:25:16.411339 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.411208    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:25:16.411339 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.411216    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:25:16.411339 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.411223    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:25:16.412518 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.412503    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-118.ec2.internal"
Jul 28 20:25:16.412594 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.412554    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 20:25:16.413207 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.413193    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 20:25:16.413271 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.413221    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 20:25:16.413271 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.413233    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeHasSufficientPID"
Jul 28 20:25:16.437948 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:16.437930    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-118.ec2.internal\" not found" node="ip-10-0-136-118.ec2.internal"
Jul 28 20:25:16.440847 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.440830    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/86367fdd94c7d90921bcf24ee0684a91-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal\" (UID: \"86367fdd94c7d90921bcf24ee0684a91\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal"
Jul 28 20:25:16.440904 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.440858    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86367fdd94c7d90921bcf24ee0684a91-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal\" (UID: \"86367fdd94c7d90921bcf24ee0684a91\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal"
Jul 28 20:25:16.440904 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.440881    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6f550312f83763fae04905f9587ee14d-config\") pod \"kube-apiserver-proxy-ip-10-0-136-118.ec2.internal\" (UID: \"6f550312f83763fae04905f9587ee14d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-118.ec2.internal"
Jul 28 20:25:16.442566 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:16.442549    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-118.ec2.internal\" not found" node="ip-10-0-136-118.ec2.internal"
Jul 28 20:25:16.464390 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:16.464369    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-118.ec2.internal\" not found"
Jul 28 20:25:16.541007 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.540976    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/86367fdd94c7d90921bcf24ee0684a91-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal\" (UID: \"86367fdd94c7d90921bcf24ee0684a91\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal"
Jul 28 20:25:16.541104 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.541017    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86367fdd94c7d90921bcf24ee0684a91-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal\" (UID: \"86367fdd94c7d90921bcf24ee0684a91\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal"
Jul 28 20:25:16.541104 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.541025    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/86367fdd94c7d90921bcf24ee0684a91-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal\" (UID: \"86367fdd94c7d90921bcf24ee0684a91\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal"
Jul 28 20:25:16.541104 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.541042    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6f550312f83763fae04905f9587ee14d-config\") pod \"kube-apiserver-proxy-ip-10-0-136-118.ec2.internal\" (UID: \"6f550312f83763fae04905f9587ee14d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-118.ec2.internal"
Jul 28 20:25:16.541104 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.541069    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6f550312f83763fae04905f9587ee14d-config\") pod \"kube-apiserver-proxy-ip-10-0-136-118.ec2.internal\" (UID: \"6f550312f83763fae04905f9587ee14d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-118.ec2.internal"
Jul 28 20:25:16.541228 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.541102    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86367fdd94c7d90921bcf24ee0684a91-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal\" (UID: \"86367fdd94c7d90921bcf24ee0684a91\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal"
Jul 28 20:25:16.565484 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:16.565436    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-118.ec2.internal\" not found"
Jul 28 20:25:16.666248 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:16.666204    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-118.ec2.internal\" not found"
Jul 28 20:25:16.740438 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.740403    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal"
Jul 28 20:25:16.746165 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:16.746145    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-118.ec2.internal"
Jul 28 20:25:16.766851 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:16.766826    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-118.ec2.internal\" not found"
Jul 28 20:25:16.867467 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:16.867375    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-118.ec2.internal\" not found"
Jul 28 20:25:16.967856 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:16.967823    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-118.ec2.internal\" not found"
Jul 28 20:25:17.068356 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:17.068326    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-118.ec2.internal\" not found"
Jul 28 20:25:17.079157 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:17.079135    2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 20:25:17.079284 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:17.079267    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 20:25:17.080855 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:17.080837    2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 20:25:17.149852 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:17.149774    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 20:20:16 +0000 UTC" deadline="2028-01-31 19:07:38.835248849 +0000 UTC"
Jul 28 20:25:17.149852 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:17.149799    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13246h42m21.685452612s"
Jul 28 20:25:17.168951 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:17.168922    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-118.ec2.internal\" not found"
Jul 28 20:25:17.269553 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:17.269523    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-118.ec2.internal\" not found"
Jul 28 20:25:17.277528 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:17.277504    2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 20:25:17.370590 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:17.370552    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-118.ec2.internal\" not found"
Jul 28 20:25:17.380114 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:17.380086    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f550312f83763fae04905f9587ee14d.slice/crio-d4edaaee801646ffce6878cb9ab64403b94e9947c47010e95b8d68aed97904bf WatchSource:0}: Error finding container d4edaaee801646ffce6878cb9ab64403b94e9947c47010e95b8d68aed97904bf: Status 404 returned error can't find the container with id d4edaaee801646ffce6878cb9ab64403b94e9947c47010e95b8d68aed97904bf
Jul 28 20:25:17.381549 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:17.381524    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86367fdd94c7d90921bcf24ee0684a91.slice/crio-ed9cd6d40d35a857545a2f2acd353ca600571abaf18541e1015f997e2d39acf8 WatchSource:0}: Error finding container ed9cd6d40d35a857545a2f2acd353ca600571abaf18541e1015f997e2d39acf8: Status 404 returned error can't find the container with id ed9cd6d40d35a857545a2f2acd353ca600571abaf18541e1015f997e2d39acf8
Jul 28 20:25:17.386281 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:17.386262    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 20:25:17.471060 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:17.470981    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-118.ec2.internal\" not found"
Jul 28 20:25:17.571462 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:17.571426    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-118.ec2.internal\" not found"
Jul 28 20:25:17.664270 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:17.664240    2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 20:25:17.740556 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:17.740483    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal"
Jul 28 20:25:17.753300 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:17.753268    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 20:25:17.754209 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:17.754191    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-118.ec2.internal"
Jul 28 20:25:17.773360 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:17.773331    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 20:25:18.119154 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.119072    2556 apiserver.go:52] "Watching apiserver"
Jul 28 20:25:18.127249 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.127214    2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 20:25:18.128013 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.127988    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-q5clp","openshift-ovn-kubernetes/ovnkube-node-gt2x6","kube-system/konnectivity-agent-nzzb2","kube-system/kube-apiserver-proxy-ip-10-0-136-118.ec2.internal","openshift-cluster-node-tuning-operator/tuned-v9cdq","openshift-dns/node-resolver-bdgqd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal","openshift-network-diagnostics/network-check-target-qfldd","openshift-network-operator/iptables-alerter-jnl9p","kube-system/global-pull-secret-syncer-vg2dj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7","openshift-image-registry/node-ca-g6f47","openshift-multus/multus-additional-cni-plugins-kbd9n","openshift-multus/multus-rks6q"]
Jul 28 20:25:18.129643 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.129620    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kbd9n"
Jul 28 20:25:18.130020 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.129998    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 20:25:18.131692 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.131674    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.132647 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.132628    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 20:25:18.132876 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.132857    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vrljx\""
Jul 28 20:25:18.132959 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.132882    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 20:25:18.133021 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.132626    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 20:25:18.133093 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.132653    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 20:25:18.135012 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.134727    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nzzb2"
Jul 28 20:25:18.136484 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.136029    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 20:25:18.136484 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.136082    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 20:25:18.136484 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.136228    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 20:25:18.136484 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.136263    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 20:25:18.136484 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.136367    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 20:25:18.137429 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.137055    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 20:25:18.137429 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.137249    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 20:25:18.137429 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.137256    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 20:25:18.137618 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.137486    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-48fxh\""
Jul 28 20:25:18.137706 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.137683    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 20:25:18.139558 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.139540    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vxsh9\""
Jul 28 20:25:18.140156 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.140135    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 20:25:18.141559 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.141543    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:18.141652 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:18.141621    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5clp" podUID="1bd6b65c-2bb9-43c4-bde8-420e312202ce"
Jul 28 20:25:18.143616 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.143570    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.144383 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.144365    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bdgqd"
Jul 28 20:25:18.146456 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.146420    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 20:25:18.146591 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.146575    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.146927 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.146909    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 20:25:18.147078 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.147063    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qrj4q\""
Jul 28 20:25:18.147197 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.147182    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dkcjj\""
Jul 28 20:25:18.147257 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.147135    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 20:25:18.147655 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.147639    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 20:25:18.148011 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.147995    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:18.148086 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:18.148061    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfldd" podUID="93e5d919-86e5-4cf9-b433-12ec1ea8cd0f"
Jul 28 20:25:18.150662 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.150646    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jnl9p"
Jul 28 20:25:18.150910 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.150889    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/428c633c-6652-4692-b11c-f7fd49dfef27-ovn-node-metrics-cert\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.150985 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.150925    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-systemd-units\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.150985 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.150951    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-host-cni-bin\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.151097 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.150980    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/428c633c-6652-4692-b11c-f7fd49dfef27-ovnkube-config\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.151097 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151013    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs4l9\" (UniqueName: \"kubernetes.io/projected/428c633c-6652-4692-b11c-f7fd49dfef27-kube-api-access-gs4l9\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.151097 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151039    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2dpd\" (UniqueName: \"kubernetes.io/projected/1bd6b65c-2bb9-43c4-bde8-420e312202ce-kube-api-access-d2dpd\") pod \"network-metrics-daemon-q5clp\" (UID: \"1bd6b65c-2bb9-43c4-bde8-420e312202ce\") " pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:18.151097 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151081    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-node-log\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.151287 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151113    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzk8l\" (UniqueName: \"kubernetes.io/projected/1d7a6538-4785-41e2-a656-c38ff732f34f-kube-api-access-qzk8l\") pod \"multus-additional-cni-plugins-kbd9n\" (UID: \"1d7a6538-4785-41e2-a656-c38ff732f34f\") " pod="openshift-multus/multus-additional-cni-plugins-kbd9n"
Jul 28 20:25:18.151287 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151152    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-host-kubelet\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.151287 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151177    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d7a6538-4785-41e2-a656-c38ff732f34f-system-cni-dir\") pod \"multus-additional-cni-plugins-kbd9n\" (UID: \"1d7a6538-4785-41e2-a656-c38ff732f34f\") " pod="openshift-multus/multus-additional-cni-plugins-kbd9n"
Jul 28 20:25:18.151287 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151200    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d7a6538-4785-41e2-a656-c38ff732f34f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kbd9n\" (UID: \"1d7a6538-4785-41e2-a656-c38ff732f34f\") " pod="openshift-multus/multus-additional-cni-plugins-kbd9n"
Jul 28 20:25:18.151287 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151234    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1d7a6538-4785-41e2-a656-c38ff732f34f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kbd9n\" (UID: \"1d7a6538-4785-41e2-a656-c38ff732f34f\") " pod="openshift-multus/multus-additional-cni-plugins-kbd9n"
Jul 28 20:25:18.151287 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151259    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-run-ovn\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.151587 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151282    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/428c633c-6652-4692-b11c-f7fd49dfef27-ovnkube-script-lib\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.151587 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151322    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 20:25:18.151587 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151325    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d7a6538-4785-41e2-a656-c38ff732f34f-cni-binary-copy\") pod \"multus-additional-cni-plugins-kbd9n\" (UID: \"1d7a6538-4785-41e2-a656-c38ff732f34f\") " pod="openshift-multus/multus-additional-cni-plugins-kbd9n"
Jul 28 20:25:18.151587 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151372    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7c198bb1-4a1e-4292-ab80-8d7a2560e1d0-konnectivity-ca\") pod \"konnectivity-agent-nzzb2\" (UID: \"7c198bb1-4a1e-4292-ab80-8d7a2560e1d0\") " pod="kube-system/konnectivity-agent-nzzb2"
Jul 28 20:25:18.151587 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151401    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-host-run-ovn-kubernetes\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.151587 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151433    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.151587 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151457    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-var-lib-openvswitch\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.151587 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151480    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-etc-openvswitch\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.151587 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151519    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-log-socket\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.151587 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151543    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hcqjg\""
Jul 28 20:25:18.152041 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151541    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/428c633c-6652-4692-b11c-f7fd49dfef27-env-overrides\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.152041 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151693    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7c198bb1-4a1e-4292-ab80-8d7a2560e1d0-agent-certs\") pod \"konnectivity-agent-nzzb2\" (UID: \"7c198bb1-4a1e-4292-ab80-8d7a2560e1d0\") " pod="kube-system/konnectivity-agent-nzzb2"
Jul 28 20:25:18.152041 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151719    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1d7a6538-4785-41e2-a656-c38ff732f34f-os-release\") pod \"multus-additional-cni-plugins-kbd9n\" (UID: \"1d7a6538-4785-41e2-a656-c38ff732f34f\") " pod="openshift-multus/multus-additional-cni-plugins-kbd9n"
Jul 28 20:25:18.152041 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151754    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-host-run-netns\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.152041 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151781    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bd6b65c-2bb9-43c4-bde8-420e312202ce-metrics-certs\") pod \"network-metrics-daemon-q5clp\" (UID: \"1bd6b65c-2bb9-43c4-bde8-420e312202ce\") " pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:18.152041 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151805    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-host-slash\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.152041 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151812    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:18.152041 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151826    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-run-openvswitch\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.152041 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151849    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d7a6538-4785-41e2-a656-c38ff732f34f-cnibin\") pod \"multus-additional-cni-plugins-kbd9n\" (UID: \"1d7a6538-4785-41e2-a656-c38ff732f34f\") " pod="openshift-multus/multus-additional-cni-plugins-kbd9n"
Jul 28 20:25:18.152041 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:18.151865    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vg2dj" podUID="57cc3100-f7ce-4374-ae22-73b79eb8db6a"
Jul 28 20:25:18.152041 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151874    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1d7a6538-4785-41e2-a656-c38ff732f34f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kbd9n\" (UID: \"1d7a6538-4785-41e2-a656-c38ff732f34f\") " pod="openshift-multus/multus-additional-cni-plugins-kbd9n"
Jul 28 20:25:18.152041 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151896    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-run-systemd\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.152041 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.151917    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-host-cni-netd\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.153163 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.153145    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 20:25:18.153538 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.153298    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2s5l5\""
Jul 28 20:25:18.153538 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.153369    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 20:25:18.153538 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.153423    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 20:25:18.153751 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.153734    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7"
Jul 28 20:25:18.154595 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.154564    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 20:25:18.155016 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.154998    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g6f47"
Jul 28 20:25:18.156207 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.156188    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 20:25:18.156447 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.156425    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 20:25:18.156829 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.156770    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 20:25:18.157112 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.157022    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-z2g6f\""
Jul 28 20:25:18.157645 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.157627    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 20:25:18.157758 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.157743    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 20:25:18.158002 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.157953    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sk7x9\""
Jul 28 20:25:18.158221 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.158198    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 20:25:18.200776 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.200572    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vx6r4"
Jul 28 20:25:18.208055 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.208033    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vx6r4"
Jul 28 20:25:18.241410 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.241323    2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 20:25:18.252211 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.252184    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-var-lib-openvswitch\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.252378 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.252232    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/428c633c-6652-4692-b11c-f7fd49dfef27-env-overrides\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.252378 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.252280    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-etc-modprobe-d\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.252378 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.252316    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-etc-sysctl-conf\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.252378 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.252329    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-var-lib-openvswitch\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.252378 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.252357    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5038e87e-8040-462d-b863-d61fefcd473b-multus-daemon-config\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.252602 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.252383    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-lib-modules\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.252602 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.252405    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcbsm\" (UniqueName: \"kubernetes.io/projected/2de8bfb7-7284-4efa-b9f5-226703b4bce6-kube-api-access-lcbsm\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.252602 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.252429    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7km9\" (UniqueName: \"kubernetes.io/projected/780efb8a-2479-40d2-84d3-ff6e99a90d36-kube-api-access-q7km9\") pod \"node-resolver-bdgqd\" (UID: \"780efb8a-2479-40d2-84d3-ff6e99a90d36\") " pod="openshift-dns/node-resolver-bdgqd"
Jul 28 20:25:18.252602 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.252452    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-var-lib-kubelet\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.252602 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.252478    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d7a6538-4785-41e2-a656-c38ff732f34f-cnibin\") pod \"multus-additional-cni-plugins-kbd9n\" (UID: \"1d7a6538-4785-41e2-a656-c38ff732f34f\") " pod="openshift-multus/multus-additional-cni-plugins-kbd9n"
Jul 28 20:25:18.252602 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.252502    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1d7a6538-4785-41e2-a656-c38ff732f34f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kbd9n\" (UID: \"1d7a6538-4785-41e2-a656-c38ff732f34f\") " pod="openshift-multus/multus-additional-cni-plugins-kbd9n"
Jul 28 20:25:18.252602 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.252528    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-host-cni-netd\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.252602 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.252551    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-host-run-k8s-cni-cncf-io\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.252602 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.252574    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs4l9\" (UniqueName: \"kubernetes.io/projected/428c633c-6652-4692-b11c-f7fd49dfef27-kube-api-access-gs4l9\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.252906 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.252598    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2dpd\" (UniqueName: \"kubernetes.io/projected/1bd6b65c-2bb9-43c4-bde8-420e312202ce-kube-api-access-d2dpd\") pod \"network-metrics-daemon-q5clp\" (UID: \"1bd6b65c-2bb9-43c4-bde8-420e312202ce\") " pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:18.252906 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.252633    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2de8bfb7-7284-4efa-b9f5-226703b4bce6-tmp\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.252906 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.252655    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/780efb8a-2479-40d2-84d3-ff6e99a90d36-tmp-dir\") pod \"node-resolver-bdgqd\" (UID: \"780efb8a-2479-40d2-84d3-ff6e99a90d36\") " pod="openshift-dns/node-resolver-bdgqd"
Jul 28 20:25:18.252906 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.252679    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ad66e7ad-4244-460f-9d3c-d7477b63eb42-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6ghd7\" (UID: \"ad66e7ad-4244-460f-9d3c-d7477b63eb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7"
Jul 28 20:25:18.252906 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.252707    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ad66e7ad-4244-460f-9d3c-d7477b63eb42-device-dir\") pod \"aws-ebs-csi-driver-node-6ghd7\" (UID: \"ad66e7ad-4244-460f-9d3c-d7477b63eb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7"
Jul 28 20:25:18.252906 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.252734    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzk8l\" (UniqueName: \"kubernetes.io/projected/1d7a6538-4785-41e2-a656-c38ff732f34f-kube-api-access-qzk8l\") pod \"multus-additional-cni-plugins-kbd9n\" (UID: \"1d7a6538-4785-41e2-a656-c38ff732f34f\") " pod="openshift-multus/multus-additional-cni-plugins-kbd9n"
Jul 28 20:25:18.252906 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.252771    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d7a6538-4785-41e2-a656-c38ff732f34f-cnibin\") pod \"multus-additional-cni-plugins-kbd9n\" (UID: \"1d7a6538-4785-41e2-a656-c38ff732f34f\") " pod="openshift-multus/multus-additional-cni-plugins-kbd9n"
Jul 28 20:25:18.252906 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.252779    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-host-kubelet\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.252906 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.252854    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-run-ovn\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.252906 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.252877    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/428c633c-6652-4692-b11c-f7fd49dfef27-ovnkube-script-lib\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.252906 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.252897    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2de8bfb7-7284-4efa-b9f5-226703b4bce6-etc-tuned\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.253299 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.252946    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5038e87e-8040-462d-b863-d61fefcd473b-cni-binary-copy\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.253299 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.252993    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-run-ovn\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.253299 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253111    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-host-kubelet\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.253299 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253161    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fa72c226-5d99-455b-a62e-5a6cb0082abc-serviceca\") pod \"node-ca-g6f47\" (UID: \"fa72c226-5d99-455b-a62e-5a6cb0082abc\") " pod="openshift-image-registry/node-ca-g6f47"
Jul 28 20:25:18.253299 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253194    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d7a6538-4785-41e2-a656-c38ff732f34f-cni-binary-copy\") pod \"multus-additional-cni-plugins-kbd9n\" (UID: \"1d7a6538-4785-41e2-a656-c38ff732f34f\") " pod="openshift-multus/multus-additional-cni-plugins-kbd9n"
Jul 28 20:25:18.253299 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253218    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7c198bb1-4a1e-4292-ab80-8d7a2560e1d0-konnectivity-ca\") pod \"konnectivity-agent-nzzb2\" (UID: \"7c198bb1-4a1e-4292-ab80-8d7a2560e1d0\") " pod="kube-system/konnectivity-agent-nzzb2"
Jul 28 20:25:18.253299 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253242    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-host-var-lib-cni-multus\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.253299 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253267    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-host-var-lib-kubelet\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.253299 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253289    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/18736bc6-d100-45e8-b4f4-2e74fae960f6-iptables-alerter-script\") pod \"iptables-alerter-jnl9p\" (UID: \"18736bc6-d100-45e8-b4f4-2e74fae960f6\") " pod="openshift-network-operator/iptables-alerter-jnl9p"
Jul 28 20:25:18.253723 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253313    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q8rf\" (UniqueName: \"kubernetes.io/projected/ad66e7ad-4244-460f-9d3c-d7477b63eb42-kube-api-access-5q8rf\") pod \"aws-ebs-csi-driver-node-6ghd7\" (UID: \"ad66e7ad-4244-460f-9d3c-d7477b63eb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7"
Jul 28 20:25:18.253723 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253336    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa72c226-5d99-455b-a62e-5a6cb0082abc-host\") pod \"node-ca-g6f47\" (UID: \"fa72c226-5d99-455b-a62e-5a6cb0082abc\") " pod="openshift-image-registry/node-ca-g6f47"
Jul 28 20:25:18.253723 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253383    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-host-run-ovn-kubernetes\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.253723 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253407    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-etc-sysctl-d\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.253723 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253448    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-run\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.253723 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253482    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1d7a6538-4785-41e2-a656-c38ff732f34f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kbd9n\" (UID: \"1d7a6538-4785-41e2-a656-c38ff732f34f\") " pod="openshift-multus/multus-additional-cni-plugins-kbd9n"
Jul 28 20:25:18.253723 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253491    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-host-run-ovn-kubernetes\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.253723 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253530    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/428c633c-6652-4692-b11c-f7fd49dfef27-env-overrides\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.253723 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253542    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-multus-cni-dir\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.253723 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253547    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-host-cni-netd\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.253723 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253562    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/428c633c-6652-4692-b11c-f7fd49dfef27-ovnkube-script-lib\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.253723 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253571    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-hostroot\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.253723 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253667    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/57cc3100-f7ce-4374-ae22-73b79eb8db6a-kubelet-config\") pod \"global-pull-secret-syncer-vg2dj\" (UID: \"57cc3100-f7ce-4374-ae22-73b79eb8db6a\") " pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:18.253723 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253706    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-etc-openvswitch\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.254414 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253741    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-log-socket\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.254414 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253767    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7c198bb1-4a1e-4292-ab80-8d7a2560e1d0-agent-certs\") pod \"konnectivity-agent-nzzb2\" (UID: \"7c198bb1-4a1e-4292-ab80-8d7a2560e1d0\") " pod="kube-system/konnectivity-agent-nzzb2"
Jul 28 20:25:18.254414 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253788    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-etc-openvswitch\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.254414 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253834    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/780efb8a-2479-40d2-84d3-ff6e99a90d36-hosts-file\") pod \"node-resolver-bdgqd\" (UID: \"780efb8a-2479-40d2-84d3-ff6e99a90d36\") " pod="openshift-dns/node-resolver-bdgqd"
Jul 28 20:25:18.254414 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253856    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-host-run-netns\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.254414 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253886    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-log-socket\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.254414 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253903    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7c198bb1-4a1e-4292-ab80-8d7a2560e1d0-konnectivity-ca\") pod \"konnectivity-agent-nzzb2\" (UID: \"7c198bb1-4a1e-4292-ab80-8d7a2560e1d0\") " pod="kube-system/konnectivity-agent-nzzb2"
Jul 28 20:25:18.254414 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253957    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1d7a6538-4785-41e2-a656-c38ff732f34f-os-release\") pod \"multus-additional-cni-plugins-kbd9n\" (UID: \"1d7a6538-4785-41e2-a656-c38ff732f34f\") " pod="openshift-multus/multus-additional-cni-plugins-kbd9n"
Jul 28 20:25:18.254414 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253979    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d7a6538-4785-41e2-a656-c38ff732f34f-cni-binary-copy\") pod \"multus-additional-cni-plugins-kbd9n\" (UID: \"1d7a6538-4785-41e2-a656-c38ff732f34f\") " pod="openshift-multus/multus-additional-cni-plugins-kbd9n"
Jul 28 20:25:18.254414 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.253985    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-host-run-netns\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.254414 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254010    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bd6b65c-2bb9-43c4-bde8-420e312202ce-metrics-certs\") pod \"network-metrics-daemon-q5clp\" (UID: \"1bd6b65c-2bb9-43c4-bde8-420e312202ce\") " pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:18.254414 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254015    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1d7a6538-4785-41e2-a656-c38ff732f34f-os-release\") pod \"multus-additional-cni-plugins-kbd9n\" (UID: \"1d7a6538-4785-41e2-a656-c38ff732f34f\") " pod="openshift-multus/multus-additional-cni-plugins-kbd9n"
Jul 28 20:25:18.254414 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254034    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-etc-kubernetes\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.254414 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254055    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-host-run-netns\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.254414 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254059    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbbjj\" (UniqueName: \"kubernetes.io/projected/18736bc6-d100-45e8-b4f4-2e74fae960f6-kube-api-access-zbbjj\") pod \"iptables-alerter-jnl9p\" (UID: \"18736bc6-d100-45e8-b4f4-2e74fae960f6\") " pod="openshift-network-operator/iptables-alerter-jnl9p"
Jul 28 20:25:18.254414 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254100    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/57cc3100-f7ce-4374-ae22-73b79eb8db6a-dbus\") pod \"global-pull-secret-syncer-vg2dj\" (UID: \"57cc3100-f7ce-4374-ae22-73b79eb8db6a\") " pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:18.254414 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254125    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ad66e7ad-4244-460f-9d3c-d7477b63eb42-etc-selinux\") pod \"aws-ebs-csi-driver-node-6ghd7\" (UID: \"ad66e7ad-4244-460f-9d3c-d7477b63eb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7"
Jul 28 20:25:18.255203 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254197    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-host-slash\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.255203 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254213    2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 20:25:18.255203 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:18.254135    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:25:18.255203 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254230    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-run-openvswitch\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.255203 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254268    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-run-openvswitch\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.255203 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254269    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-host-slash\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.255203 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:18.254290    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bd6b65c-2bb9-43c4-bde8-420e312202ce-metrics-certs podName:1bd6b65c-2bb9-43c4-bde8-420e312202ce nodeName:}" failed. No retries permitted until 2026-07-28 20:25:18.754268153 +0000 UTC m=+2.973657029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bd6b65c-2bb9-43c4-bde8-420e312202ce-metrics-certs") pod "network-metrics-daemon-q5clp" (UID: "1bd6b65c-2bb9-43c4-bde8-420e312202ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:25:18.255203 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254310    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-etc-sysconfig\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.255203 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254376    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-host-run-multus-certs\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.255203 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254401    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdv2q\" (UniqueName: \"kubernetes.io/projected/93e5d919-86e5-4cf9-b433-12ec1ea8cd0f-kube-api-access-pdv2q\") pod \"network-check-target-qfldd\" (UID: \"93e5d919-86e5-4cf9-b433-12ec1ea8cd0f\") " pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:18.255203 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254428    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/18736bc6-d100-45e8-b4f4-2e74fae960f6-host-slash\") pod \"iptables-alerter-jnl9p\" (UID: \"18736bc6-d100-45e8-b4f4-2e74fae960f6\") " pod="openshift-network-operator/iptables-alerter-jnl9p"
Jul 28 20:25:18.255203 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254452    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57cc3100-f7ce-4374-ae22-73b79eb8db6a-original-pull-secret\") pod \"global-pull-secret-syncer-vg2dj\" (UID: \"57cc3100-f7ce-4374-ae22-73b79eb8db6a\") " pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:18.255203 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254516    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-run-systemd\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.255203 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254536    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/428c633c-6652-4692-b11c-f7fd49dfef27-ovn-node-metrics-cert\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.255203 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254553    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-host\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.255203 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254575    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-run-systemd\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.255203 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254586    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-multus-socket-dir-parent\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.255921 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254604    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ad66e7ad-4244-460f-9d3c-d7477b63eb42-socket-dir\") pod \"aws-ebs-csi-driver-node-6ghd7\" (UID: \"ad66e7ad-4244-460f-9d3c-d7477b63eb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7"
Jul 28 20:25:18.255921 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254635    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ad66e7ad-4244-460f-9d3c-d7477b63eb42-registration-dir\") pod \"aws-ebs-csi-driver-node-6ghd7\" (UID: \"ad66e7ad-4244-460f-9d3c-d7477b63eb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7"
Jul 28 20:25:18.255921 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254661    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-os-release\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.255921 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254687    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-systemd-units\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.255921 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254710    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-host-cni-bin\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.255921 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254745    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/428c633c-6652-4692-b11c-f7fd49dfef27-ovnkube-config\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.255921 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254756    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-systemd-units\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.255921 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254768    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-etc-kubernetes\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.255921 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254756    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-host-cni-bin\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.255921 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254810    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-etc-systemd\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.255921 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254846    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-multus-conf-dir\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.255921 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254874    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ad66e7ad-4244-460f-9d3c-d7477b63eb42-sys-fs\") pod \"aws-ebs-csi-driver-node-6ghd7\" (UID: \"ad66e7ad-4244-460f-9d3c-d7477b63eb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7"
Jul 28 20:25:18.255921 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254900    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-node-log\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.255921 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254926    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d7a6538-4785-41e2-a656-c38ff732f34f-system-cni-dir\") pod \"multus-additional-cni-plugins-kbd9n\" (UID: \"1d7a6538-4785-41e2-a656-c38ff732f34f\") " pod="openshift-multus/multus-additional-cni-plugins-kbd9n"
Jul 28 20:25:18.255921 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254953    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d7a6538-4785-41e2-a656-c38ff732f34f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kbd9n\" (UID: \"1d7a6538-4785-41e2-a656-c38ff732f34f\") " pod="openshift-multus/multus-additional-cni-plugins-kbd9n"
Jul 28 20:25:18.255921 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254978    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1d7a6538-4785-41e2-a656-c38ff732f34f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kbd9n\" (UID: \"1d7a6538-4785-41e2-a656-c38ff732f34f\") " pod="openshift-multus/multus-additional-cni-plugins-kbd9n"
Jul 28 20:25:18.255921 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.254986    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-node-log\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.256614 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.255001    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-sys\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.256614 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.255038    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-host-var-lib-cni-bin\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.256614 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.255061    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-cnibin\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.256614 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.255088    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgm2x\" (UniqueName: \"kubernetes.io/projected/5038e87e-8040-462d-b863-d61fefcd473b-kube-api-access-kgm2x\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.256614 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.255112    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vckvm\" (UniqueName: \"kubernetes.io/projected/fa72c226-5d99-455b-a62e-5a6cb0082abc-kube-api-access-vckvm\") pod \"node-ca-g6f47\" (UID: \"fa72c226-5d99-455b-a62e-5a6cb0082abc\") " pod="openshift-image-registry/node-ca-g6f47"
Jul 28 20:25:18.256614 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.255139    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d7a6538-4785-41e2-a656-c38ff732f34f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kbd9n\" (UID: \"1d7a6538-4785-41e2-a656-c38ff732f34f\") " pod="openshift-multus/multus-additional-cni-plugins-kbd9n"
Jul 28 20:25:18.256614 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.255143    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.256614 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.255179    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-system-cni-dir\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.256614 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.255186    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/428c633c-6652-4692-b11c-f7fd49dfef27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.256614 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.255195    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/428c633c-6652-4692-b11c-f7fd49dfef27-ovnkube-config\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.256614 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.255259    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d7a6538-4785-41e2-a656-c38ff732f34f-system-cni-dir\") pod \"multus-additional-cni-plugins-kbd9n\" (UID: \"1d7a6538-4785-41e2-a656-c38ff732f34f\") " pod="openshift-multus/multus-additional-cni-plugins-kbd9n"
Jul 28 20:25:18.256614 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.255687    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1d7a6538-4785-41e2-a656-c38ff732f34f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kbd9n\" (UID: \"1d7a6538-4785-41e2-a656-c38ff732f34f\") " pod="openshift-multus/multus-additional-cni-plugins-kbd9n"
Jul 28 20:25:18.257944 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.257918    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/428c633c-6652-4692-b11c-f7fd49dfef27-ovn-node-metrics-cert\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.258055 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.258039    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7c198bb1-4a1e-4292-ab80-8d7a2560e1d0-agent-certs\") pod \"konnectivity-agent-nzzb2\" (UID: \"7c198bb1-4a1e-4292-ab80-8d7a2560e1d0\") " pod="kube-system/konnectivity-agent-nzzb2"
Jul 28 20:25:18.261804 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.261784    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs4l9\" (UniqueName: \"kubernetes.io/projected/428c633c-6652-4692-b11c-f7fd49dfef27-kube-api-access-gs4l9\") pod \"ovnkube-node-gt2x6\" (UID: \"428c633c-6652-4692-b11c-f7fd49dfef27\") " pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.262016 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.261999    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2dpd\" (UniqueName: \"kubernetes.io/projected/1bd6b65c-2bb9-43c4-bde8-420e312202ce-kube-api-access-d2dpd\") pod \"network-metrics-daemon-q5clp\" (UID: \"1bd6b65c-2bb9-43c4-bde8-420e312202ce\") " pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:18.262268 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.262247    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzk8l\" (UniqueName: \"kubernetes.io/projected/1d7a6538-4785-41e2-a656-c38ff732f34f-kube-api-access-qzk8l\") pod \"multus-additional-cni-plugins-kbd9n\" (UID: \"1d7a6538-4785-41e2-a656-c38ff732f34f\") " pod="openshift-multus/multus-additional-cni-plugins-kbd9n"
Jul 28 20:25:18.313907 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.313858    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-118.ec2.internal" event={"ID":"6f550312f83763fae04905f9587ee14d","Type":"ContainerStarted","Data":"d4edaaee801646ffce6878cb9ab64403b94e9947c47010e95b8d68aed97904bf"}
Jul 28 20:25:18.315221 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.315192    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal" event={"ID":"86367fdd94c7d90921bcf24ee0684a91","Type":"ContainerStarted","Data":"ed9cd6d40d35a857545a2f2acd353ca600571abaf18541e1015f997e2d39acf8"}
Jul 28 20:25:18.356036 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356005    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-run\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.356036 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356040    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-multus-cni-dir\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.356242 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356061    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-hostroot\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.356242 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356082    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/57cc3100-f7ce-4374-ae22-73b79eb8db6a-kubelet-config\") pod \"global-pull-secret-syncer-vg2dj\" (UID: \"57cc3100-f7ce-4374-ae22-73b79eb8db6a\") " pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:18.356242 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356104    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/780efb8a-2479-40d2-84d3-ff6e99a90d36-hosts-file\") pod \"node-resolver-bdgqd\" (UID: \"780efb8a-2479-40d2-84d3-ff6e99a90d36\") " pod="openshift-dns/node-resolver-bdgqd"
Jul 28 20:25:18.356242 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356124    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-host-run-netns\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.356242 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356158    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-etc-kubernetes\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.356242 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356183    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbbjj\" (UniqueName: \"kubernetes.io/projected/18736bc6-d100-45e8-b4f4-2e74fae960f6-kube-api-access-zbbjj\") pod \"iptables-alerter-jnl9p\" (UID: \"18736bc6-d100-45e8-b4f4-2e74fae960f6\") " pod="openshift-network-operator/iptables-alerter-jnl9p"
Jul 28 20:25:18.356242 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356205    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/57cc3100-f7ce-4374-ae22-73b79eb8db6a-dbus\") pod \"global-pull-secret-syncer-vg2dj\" (UID: \"57cc3100-f7ce-4374-ae22-73b79eb8db6a\") " pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:18.356242 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356205    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-run\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.356242 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356231    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/780efb8a-2479-40d2-84d3-ff6e99a90d36-hosts-file\") pod \"node-resolver-bdgqd\" (UID: \"780efb8a-2479-40d2-84d3-ff6e99a90d36\") " pod="openshift-dns/node-resolver-bdgqd"
Jul 28 20:25:18.356711 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356255    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-etc-kubernetes\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.356711 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356259    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-host-run-netns\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.356711 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356205    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-hostroot\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.356711 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356293    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ad66e7ad-4244-460f-9d3c-d7477b63eb42-etc-selinux\") pod \"aws-ebs-csi-driver-node-6ghd7\" (UID: \"ad66e7ad-4244-460f-9d3c-d7477b63eb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7"
Jul 28 20:25:18.356711 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356313    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/57cc3100-f7ce-4374-ae22-73b79eb8db6a-kubelet-config\") pod \"global-pull-secret-syncer-vg2dj\" (UID: \"57cc3100-f7ce-4374-ae22-73b79eb8db6a\") " pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:18.356711 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356332    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-multus-cni-dir\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.356711 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356334    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-etc-sysconfig\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.356711 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356383    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-host-run-multus-certs\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.356711 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356389    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-etc-sysconfig\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.356711 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356426    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ad66e7ad-4244-460f-9d3c-d7477b63eb42-etc-selinux\") pod \"aws-ebs-csi-driver-node-6ghd7\" (UID: \"ad66e7ad-4244-460f-9d3c-d7477b63eb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7"
Jul 28 20:25:18.356711 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356436    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/57cc3100-f7ce-4374-ae22-73b79eb8db6a-dbus\") pod \"global-pull-secret-syncer-vg2dj\" (UID: \"57cc3100-f7ce-4374-ae22-73b79eb8db6a\") " pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:18.356711 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356436    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-host-run-multus-certs\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.356711 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356459    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdv2q\" (UniqueName: \"kubernetes.io/projected/93e5d919-86e5-4cf9-b433-12ec1ea8cd0f-kube-api-access-pdv2q\") pod \"network-check-target-qfldd\" (UID: \"93e5d919-86e5-4cf9-b433-12ec1ea8cd0f\") " pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:18.356711 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356486    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/18736bc6-d100-45e8-b4f4-2e74fae960f6-host-slash\") pod \"iptables-alerter-jnl9p\" (UID: \"18736bc6-d100-45e8-b4f4-2e74fae960f6\") " pod="openshift-network-operator/iptables-alerter-jnl9p"
Jul 28 20:25:18.356711 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356510    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57cc3100-f7ce-4374-ae22-73b79eb8db6a-original-pull-secret\") pod \"global-pull-secret-syncer-vg2dj\" (UID: \"57cc3100-f7ce-4374-ae22-73b79eb8db6a\") " pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:18.356711 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356538    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-host\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.356711 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356562    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-multus-socket-dir-parent\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.356711 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356588    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ad66e7ad-4244-460f-9d3c-d7477b63eb42-socket-dir\") pod \"aws-ebs-csi-driver-node-6ghd7\" (UID: \"ad66e7ad-4244-460f-9d3c-d7477b63eb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7"
Jul 28 20:25:18.357514 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:18.356601    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 20:25:18.357514 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356607    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-host\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.357514 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356610    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ad66e7ad-4244-460f-9d3c-d7477b63eb42-registration-dir\") pod \"aws-ebs-csi-driver-node-6ghd7\" (UID: \"ad66e7ad-4244-460f-9d3c-d7477b63eb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7"
Jul 28 20:25:18.357514 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:18.356655    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57cc3100-f7ce-4374-ae22-73b79eb8db6a-original-pull-secret podName:57cc3100-f7ce-4374-ae22-73b79eb8db6a nodeName:}" failed. No retries permitted until 2026-07-28 20:25:18.856636997 +0000 UTC m=+3.076025874 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57cc3100-f7ce-4374-ae22-73b79eb8db6a-original-pull-secret") pod "global-pull-secret-syncer-vg2dj" (UID: "57cc3100-f7ce-4374-ae22-73b79eb8db6a") : object "kube-system"/"original-pull-secret" not registered
Jul 28 20:25:18.357514 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356675    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-os-release\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.357514 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356684    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-multus-socket-dir-parent\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.357514 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356539    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/18736bc6-d100-45e8-b4f4-2e74fae960f6-host-slash\") pod \"iptables-alerter-jnl9p\" (UID: \"18736bc6-d100-45e8-b4f4-2e74fae960f6\") " pod="openshift-network-operator/iptables-alerter-jnl9p"
Jul 28 20:25:18.357514 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356653    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ad66e7ad-4244-460f-9d3c-d7477b63eb42-registration-dir\") pod \"aws-ebs-csi-driver-node-6ghd7\" (UID: \"ad66e7ad-4244-460f-9d3c-d7477b63eb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7"
Jul 28 20:25:18.357514 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356703    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-etc-kubernetes\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.357514 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356726    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-etc-systemd\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.357514 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356748    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-multus-conf-dir\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.357514 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356759    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ad66e7ad-4244-460f-9d3c-d7477b63eb42-socket-dir\") pod \"aws-ebs-csi-driver-node-6ghd7\" (UID: \"ad66e7ad-4244-460f-9d3c-d7477b63eb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7"
Jul 28 20:25:18.357514 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356758    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-os-release\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.357514 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356772    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ad66e7ad-4244-460f-9d3c-d7477b63eb42-sys-fs\") pod \"aws-ebs-csi-driver-node-6ghd7\" (UID: \"ad66e7ad-4244-460f-9d3c-d7477b63eb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7"
Jul 28 20:25:18.357514 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356804    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-etc-kubernetes\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.357514 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356806    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-sys\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.357514 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356823    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ad66e7ad-4244-460f-9d3c-d7477b63eb42-sys-fs\") pod \"aws-ebs-csi-driver-node-6ghd7\" (UID: \"ad66e7ad-4244-460f-9d3c-d7477b63eb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7"
Jul 28 20:25:18.358319 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356829    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-host-var-lib-cni-bin\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.358319 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356845    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-sys\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.358319 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356856    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-cnibin\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.358319 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356882    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgm2x\" (UniqueName: \"kubernetes.io/projected/5038e87e-8040-462d-b863-d61fefcd473b-kube-api-access-kgm2x\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.358319 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356888    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-etc-systemd\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.358319 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356894    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-multus-conf-dir\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.358319 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356907    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vckvm\" (UniqueName: \"kubernetes.io/projected/fa72c226-5d99-455b-a62e-5a6cb0082abc-kube-api-access-vckvm\") pod \"node-ca-g6f47\" (UID: \"fa72c226-5d99-455b-a62e-5a6cb0082abc\") " pod="openshift-image-registry/node-ca-g6f47"
Jul 28 20:25:18.358319 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356933    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-cnibin\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.358319 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356935    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-system-cni-dir\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.358319 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356965    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-etc-modprobe-d\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.358319 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356977    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-system-cni-dir\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.358319 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356859    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-host-var-lib-cni-bin\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.358319 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.356989    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-etc-sysctl-conf\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.358319 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357013    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5038e87e-8040-462d-b863-d61fefcd473b-multus-daemon-config\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.358319 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357032    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-lib-modules\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.358319 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357056    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcbsm\" (UniqueName: \"kubernetes.io/projected/2de8bfb7-7284-4efa-b9f5-226703b4bce6-kube-api-access-lcbsm\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.358319 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357067    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-etc-modprobe-d\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.358319 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357085    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7km9\" (UniqueName: \"kubernetes.io/projected/780efb8a-2479-40d2-84d3-ff6e99a90d36-kube-api-access-q7km9\") pod \"node-resolver-bdgqd\" (UID: \"780efb8a-2479-40d2-84d3-ff6e99a90d36\") " pod="openshift-dns/node-resolver-bdgqd"
Jul 28 20:25:18.359058 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357106    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-var-lib-kubelet\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.359058 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357124    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-host-run-k8s-cni-cncf-io\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.359058 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357152    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-host-run-k8s-cni-cncf-io\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.359058 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357180    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-etc-sysctl-conf\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.359058 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357188    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-var-lib-kubelet\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.359058 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357105    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-lib-modules\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.359058 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357278    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2de8bfb7-7284-4efa-b9f5-226703b4bce6-tmp\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.359058 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357294    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/780efb8a-2479-40d2-84d3-ff6e99a90d36-tmp-dir\") pod \"node-resolver-bdgqd\" (UID: \"780efb8a-2479-40d2-84d3-ff6e99a90d36\") " pod="openshift-dns/node-resolver-bdgqd"
Jul 28 20:25:18.359058 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357309    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ad66e7ad-4244-460f-9d3c-d7477b63eb42-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6ghd7\" (UID: \"ad66e7ad-4244-460f-9d3c-d7477b63eb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7"
Jul 28 20:25:18.359058 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357330    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ad66e7ad-4244-460f-9d3c-d7477b63eb42-device-dir\") pod \"aws-ebs-csi-driver-node-6ghd7\" (UID: \"ad66e7ad-4244-460f-9d3c-d7477b63eb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7"
Jul 28 20:25:18.359058 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357371    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2de8bfb7-7284-4efa-b9f5-226703b4bce6-etc-tuned\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.359058 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357393    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5038e87e-8040-462d-b863-d61fefcd473b-cni-binary-copy\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.359058 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357412    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fa72c226-5d99-455b-a62e-5a6cb0082abc-serviceca\") pod \"node-ca-g6f47\" (UID: \"fa72c226-5d99-455b-a62e-5a6cb0082abc\") " pod="openshift-image-registry/node-ca-g6f47"
Jul 28 20:25:18.359058 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357431    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-host-var-lib-cni-multus\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.359058 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357454    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-host-var-lib-kubelet\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.359058 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357476    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/18736bc6-d100-45e8-b4f4-2e74fae960f6-iptables-alerter-script\") pod \"iptables-alerter-jnl9p\" (UID: \"18736bc6-d100-45e8-b4f4-2e74fae960f6\") " pod="openshift-network-operator/iptables-alerter-jnl9p"
Jul 28 20:25:18.359058 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357501    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q8rf\" (UniqueName: \"kubernetes.io/projected/ad66e7ad-4244-460f-9d3c-d7477b63eb42-kube-api-access-5q8rf\") pod \"aws-ebs-csi-driver-node-6ghd7\" (UID: \"ad66e7ad-4244-460f-9d3c-d7477b63eb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7"
Jul 28 20:25:18.359729 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357524    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa72c226-5d99-455b-a62e-5a6cb0082abc-host\") pod \"node-ca-g6f47\" (UID: \"fa72c226-5d99-455b-a62e-5a6cb0082abc\") " pod="openshift-image-registry/node-ca-g6f47"
Jul 28 20:25:18.359729 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357545    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-etc-sysctl-d\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.359729 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357624    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-host-var-lib-cni-multus\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.359729 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357674    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5038e87e-8040-462d-b863-d61fefcd473b-multus-daemon-config\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.359729 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357855    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/780efb8a-2479-40d2-84d3-ff6e99a90d36-tmp-dir\") pod \"node-resolver-bdgqd\" (UID: \"780efb8a-2479-40d2-84d3-ff6e99a90d36\") " pod="openshift-dns/node-resolver-bdgqd"
Jul 28 20:25:18.359729 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357937    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5038e87e-8040-462d-b863-d61fefcd473b-host-var-lib-kubelet\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.359729 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.357976    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa72c226-5d99-455b-a62e-5a6cb0082abc-host\") pod \"node-ca-g6f47\" (UID: \"fa72c226-5d99-455b-a62e-5a6cb0082abc\") " pod="openshift-image-registry/node-ca-g6f47"
Jul 28 20:25:18.359729 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.358392    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/18736bc6-d100-45e8-b4f4-2e74fae960f6-iptables-alerter-script\") pod \"iptables-alerter-jnl9p\" (UID: \"18736bc6-d100-45e8-b4f4-2e74fae960f6\") " pod="openshift-network-operator/iptables-alerter-jnl9p"
Jul 28 20:25:18.359729 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.358458    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ad66e7ad-4244-460f-9d3c-d7477b63eb42-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6ghd7\" (UID: \"ad66e7ad-4244-460f-9d3c-d7477b63eb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7"
Jul 28 20:25:18.359729 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.358503    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5038e87e-8040-462d-b863-d61fefcd473b-cni-binary-copy\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.359729 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.358508    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ad66e7ad-4244-460f-9d3c-d7477b63eb42-device-dir\") pod \"aws-ebs-csi-driver-node-6ghd7\" (UID: \"ad66e7ad-4244-460f-9d3c-d7477b63eb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7"
Jul 28 20:25:18.359729 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.358596    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2de8bfb7-7284-4efa-b9f5-226703b4bce6-etc-sysctl-d\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.359729 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.358660    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fa72c226-5d99-455b-a62e-5a6cb0082abc-serviceca\") pod \"node-ca-g6f47\" (UID: \"fa72c226-5d99-455b-a62e-5a6cb0082abc\") " pod="openshift-image-registry/node-ca-g6f47"
Jul 28 20:25:18.360483 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.360460    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2de8bfb7-7284-4efa-b9f5-226703b4bce6-etc-tuned\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.360730 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.360708    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2de8bfb7-7284-4efa-b9f5-226703b4bce6-tmp\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.366103 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.365976    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbbjj\" (UniqueName: \"kubernetes.io/projected/18736bc6-d100-45e8-b4f4-2e74fae960f6-kube-api-access-zbbjj\") pod \"iptables-alerter-jnl9p\" (UID: \"18736bc6-d100-45e8-b4f4-2e74fae960f6\") " pod="openshift-network-operator/iptables-alerter-jnl9p"
Jul 28 20:25:18.366103 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:18.366073    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 20:25:18.366103 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:18.366089    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 20:25:18.366103 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:18.366102    2556 projected.go:196] Error preparing data for projected volume kube-api-access-pdv2q for pod openshift-network-diagnostics/network-check-target-qfldd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:25:18.366337 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:18.366159    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93e5d919-86e5-4cf9-b433-12ec1ea8cd0f-kube-api-access-pdv2q podName:93e5d919-86e5-4cf9-b433-12ec1ea8cd0f nodeName:}" failed. No retries permitted until 2026-07-28 20:25:18.866142192 +0000 UTC m=+3.085531072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pdv2q" (UniqueName: "kubernetes.io/projected/93e5d919-86e5-4cf9-b433-12ec1ea8cd0f-kube-api-access-pdv2q") pod "network-check-target-qfldd" (UID: "93e5d919-86e5-4cf9-b433-12ec1ea8cd0f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:25:18.367171 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.367145    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vckvm\" (UniqueName: \"kubernetes.io/projected/fa72c226-5d99-455b-a62e-5a6cb0082abc-kube-api-access-vckvm\") pod \"node-ca-g6f47\" (UID: \"fa72c226-5d99-455b-a62e-5a6cb0082abc\") " pod="openshift-image-registry/node-ca-g6f47"
Jul 28 20:25:18.368443 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.368418    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcbsm\" (UniqueName: \"kubernetes.io/projected/2de8bfb7-7284-4efa-b9f5-226703b4bce6-kube-api-access-lcbsm\") pod \"tuned-v9cdq\" (UID: \"2de8bfb7-7284-4efa-b9f5-226703b4bce6\") " pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.369109 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.369067    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q8rf\" (UniqueName: \"kubernetes.io/projected/ad66e7ad-4244-460f-9d3c-d7477b63eb42-kube-api-access-5q8rf\") pod \"aws-ebs-csi-driver-node-6ghd7\" (UID: \"ad66e7ad-4244-460f-9d3c-d7477b63eb42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7"
Jul 28 20:25:18.371198 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.371144    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7km9\" (UniqueName: \"kubernetes.io/projected/780efb8a-2479-40d2-84d3-ff6e99a90d36-kube-api-access-q7km9\") pod \"node-resolver-bdgqd\" (UID: \"780efb8a-2479-40d2-84d3-ff6e99a90d36\") " pod="openshift-dns/node-resolver-bdgqd"
Jul 28 20:25:18.371968 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.371913    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgm2x\" (UniqueName: \"kubernetes.io/projected/5038e87e-8040-462d-b863-d61fefcd473b-kube-api-access-kgm2x\") pod \"multus-rks6q\" (UID: \"5038e87e-8040-462d-b863-d61fefcd473b\") " pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.446854 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.446816    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kbd9n"
Jul 28 20:25:18.454681 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.454660    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:18.463510 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.463489    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nzzb2"
Jul 28 20:25:18.470924 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.470900    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v9cdq"
Jul 28 20:25:18.478571 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.478550    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bdgqd"
Jul 28 20:25:18.487903 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.487885    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rks6q"
Jul 28 20:25:18.496401 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.496383    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jnl9p"
Jul 28 20:25:18.506931 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.506910    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7"
Jul 28 20:25:18.513491 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.513471    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g6f47"
Jul 28 20:25:18.760487 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.760396    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bd6b65c-2bb9-43c4-bde8-420e312202ce-metrics-certs\") pod \"network-metrics-daemon-q5clp\" (UID: \"1bd6b65c-2bb9-43c4-bde8-420e312202ce\") " pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:18.760641 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:18.760559    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:25:18.760641 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:18.760635    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bd6b65c-2bb9-43c4-bde8-420e312202ce-metrics-certs podName:1bd6b65c-2bb9-43c4-bde8-420e312202ce nodeName:}" failed. No retries permitted until 2026-07-28 20:25:19.760615556 +0000 UTC m=+3.980004432 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bd6b65c-2bb9-43c4-bde8-420e312202ce-metrics-certs") pod "network-metrics-daemon-q5clp" (UID: "1bd6b65c-2bb9-43c4-bde8-420e312202ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:25:18.861608 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.861572    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57cc3100-f7ce-4374-ae22-73b79eb8db6a-original-pull-secret\") pod \"global-pull-secret-syncer-vg2dj\" (UID: \"57cc3100-f7ce-4374-ae22-73b79eb8db6a\") " pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:18.861747 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:18.861713    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 20:25:18.861793 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:18.861774    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57cc3100-f7ce-4374-ae22-73b79eb8db6a-original-pull-secret podName:57cc3100-f7ce-4374-ae22-73b79eb8db6a nodeName:}" failed. No retries permitted until 2026-07-28 20:25:19.861759901 +0000 UTC m=+4.081148763 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57cc3100-f7ce-4374-ae22-73b79eb8db6a-original-pull-secret") pod "global-pull-secret-syncer-vg2dj" (UID: "57cc3100-f7ce-4374-ae22-73b79eb8db6a") : object "kube-system"/"original-pull-secret" not registered
Jul 28 20:25:18.962974 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:18.962931    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdv2q\" (UniqueName: \"kubernetes.io/projected/93e5d919-86e5-4cf9-b433-12ec1ea8cd0f-kube-api-access-pdv2q\") pod \"network-check-target-qfldd\" (UID: \"93e5d919-86e5-4cf9-b433-12ec1ea8cd0f\") " pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:18.963161 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:18.963086    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 20:25:18.963161 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:18.963102    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 20:25:18.963161 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:18.963114    2556 projected.go:196] Error preparing data for projected volume kube-api-access-pdv2q for pod openshift-network-diagnostics/network-check-target-qfldd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:25:18.963335 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:18.963180    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93e5d919-86e5-4cf9-b433-12ec1ea8cd0f-kube-api-access-pdv2q podName:93e5d919-86e5-4cf9-b433-12ec1ea8cd0f nodeName:}" failed. No retries permitted until 2026-07-28 20:25:19.963161403 +0000 UTC m=+4.182550333 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pdv2q" (UniqueName: "kubernetes.io/projected/93e5d919-86e5-4cf9-b433-12ec1ea8cd0f-kube-api-access-pdv2q") pod "network-check-target-qfldd" (UID: "93e5d919-86e5-4cf9-b433-12ec1ea8cd0f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:25:19.182135 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:19.182053    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod780efb8a_2479_40d2_84d3_ff6e99a90d36.slice/crio-8110dcffb1637783ae8f6fab1b1e1d894179b1340fa1eb4513b7685f3df97926 WatchSource:0}: Error finding container 8110dcffb1637783ae8f6fab1b1e1d894179b1340fa1eb4513b7685f3df97926: Status 404 returned error can't find the container with id 8110dcffb1637783ae8f6fab1b1e1d894179b1340fa1eb4513b7685f3df97926
Jul 28 20:25:19.185094 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:19.185056    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18736bc6_d100_45e8_b4f4_2e74fae960f6.slice/crio-ceff6f94482a1d26fb39b0e4f893103eac146bb9cc105aa1b1110a549d261ea4 WatchSource:0}: Error finding container ceff6f94482a1d26fb39b0e4f893103eac146bb9cc105aa1b1110a549d261ea4: Status 404 returned error can't find the container with id ceff6f94482a1d26fb39b0e4f893103eac146bb9cc105aa1b1110a549d261ea4
Jul 28 20:25:19.187485 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:19.187463    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2de8bfb7_7284_4efa_b9f5_226703b4bce6.slice/crio-4e774d3a7376f3faef7940b1d3cb140bcd9974f31aa7f1222ca2cc86f28b86f9 WatchSource:0}: Error finding container 4e774d3a7376f3faef7940b1d3cb140bcd9974f31aa7f1222ca2cc86f28b86f9: Status 404 returned error can't find the container with id 4e774d3a7376f3faef7940b1d3cb140bcd9974f31aa7f1222ca2cc86f28b86f9
Jul 28 20:25:19.188821 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:19.188738    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod428c633c_6652_4692_b11c_f7fd49dfef27.slice/crio-ac0899e6089162267410f41077514a080c3ec992290d221fccadbe13c176f8b2 WatchSource:0}: Error finding container ac0899e6089162267410f41077514a080c3ec992290d221fccadbe13c176f8b2: Status 404 returned error can't find the container with id ac0899e6089162267410f41077514a080c3ec992290d221fccadbe13c176f8b2
Jul 28 20:25:19.189392 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:19.189372    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5038e87e_8040_462d_b863_d61fefcd473b.slice/crio-245facf892b8b02d5ad3dc35c04e47cc2a9e2e301738792a25ee33b0fd85c687 WatchSource:0}: Error finding container 245facf892b8b02d5ad3dc35c04e47cc2a9e2e301738792a25ee33b0fd85c687: Status 404 returned error can't find the container with id 245facf892b8b02d5ad3dc35c04e47cc2a9e2e301738792a25ee33b0fd85c687
Jul 28 20:25:19.201082 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:19.201057    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad66e7ad_4244_460f_9d3c_d7477b63eb42.slice/crio-b287bab97488f139f578c0b92b1404eae66b442cc90e4a9f2efc23f79612ffc0 WatchSource:0}: Error finding container b287bab97488f139f578c0b92b1404eae66b442cc90e4a9f2efc23f79612ffc0: Status 404 returned error can't find the container with id b287bab97488f139f578c0b92b1404eae66b442cc90e4a9f2efc23f79612ffc0
Jul 28 20:25:19.202549 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:19.202407    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c198bb1_4a1e_4292_ab80_8d7a2560e1d0.slice/crio-6b18bda420ab9dba4275eedf9a9e100de6ece022dd2dffde943d69305cf65505 WatchSource:0}: Error finding container 6b18bda420ab9dba4275eedf9a9e100de6ece022dd2dffde943d69305cf65505: Status 404 returned error can't find the container with id 6b18bda420ab9dba4275eedf9a9e100de6ece022dd2dffde943d69305cf65505
Jul 28 20:25:19.203086 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:19.203064    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d7a6538_4785_41e2_a656_c38ff732f34f.slice/crio-df809cacffe302798738651a608072d1548f6c0b581dd7886610143a7e04eb4b WatchSource:0}: Error finding container df809cacffe302798738651a608072d1548f6c0b581dd7886610143a7e04eb4b: Status 404 returned error can't find the container with id df809cacffe302798738651a608072d1548f6c0b581dd7886610143a7e04eb4b
Jul 28 20:25:19.204324 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:19.204294    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa72c226_5d99_455b_a62e_5a6cb0082abc.slice/crio-512d6fd26dc26a79077b5472a3014965bbc23a0aa9de4ec65f4fa8444b39fdad WatchSource:0}: Error finding container 512d6fd26dc26a79077b5472a3014965bbc23a0aa9de4ec65f4fa8444b39fdad: Status 404 returned error can't find the container with id 512d6fd26dc26a79077b5472a3014965bbc23a0aa9de4ec65f4fa8444b39fdad
Jul 28 20:25:19.211562 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:19.211488    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 20:20:18 +0000 UTC" deadline="2028-02-19 12:46:40.125700247 +0000 UTC"
Jul 28 20:25:19.211562 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:19.211516    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13696h21m20.914188368s"
Jul 28 20:25:19.308069 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:19.307925    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:19.308196 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:19.308143    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfldd" podUID="93e5d919-86e5-4cf9-b433-12ec1ea8cd0f"
Jul 28 20:25:19.318972 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:19.318946    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v9cdq" event={"ID":"2de8bfb7-7284-4efa-b9f5-226703b4bce6","Type":"ContainerStarted","Data":"4e774d3a7376f3faef7940b1d3cb140bcd9974f31aa7f1222ca2cc86f28b86f9"}
Jul 28 20:25:19.320875 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:19.320854    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jnl9p" event={"ID":"18736bc6-d100-45e8-b4f4-2e74fae960f6","Type":"ContainerStarted","Data":"ceff6f94482a1d26fb39b0e4f893103eac146bb9cc105aa1b1110a549d261ea4"}
Jul 28 20:25:19.324487 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:19.324463    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6" event={"ID":"428c633c-6652-4692-b11c-f7fd49dfef27","Type":"ContainerStarted","Data":"ac0899e6089162267410f41077514a080c3ec992290d221fccadbe13c176f8b2"}
Jul 28 20:25:19.326470 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:19.326445    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bdgqd" event={"ID":"780efb8a-2479-40d2-84d3-ff6e99a90d36","Type":"ContainerStarted","Data":"8110dcffb1637783ae8f6fab1b1e1d894179b1340fa1eb4513b7685f3df97926"}
Jul 28 20:25:19.328163 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:19.328131    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g6f47" event={"ID":"fa72c226-5d99-455b-a62e-5a6cb0082abc","Type":"ContainerStarted","Data":"512d6fd26dc26a79077b5472a3014965bbc23a0aa9de4ec65f4fa8444b39fdad"}
Jul 28 20:25:19.329050 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:19.329026    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7" event={"ID":"ad66e7ad-4244-460f-9d3c-d7477b63eb42","Type":"ContainerStarted","Data":"b287bab97488f139f578c0b92b1404eae66b442cc90e4a9f2efc23f79612ffc0"}
Jul 28 20:25:19.330706 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:19.330686    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rks6q" event={"ID":"5038e87e-8040-462d-b863-d61fefcd473b","Type":"ContainerStarted","Data":"245facf892b8b02d5ad3dc35c04e47cc2a9e2e301738792a25ee33b0fd85c687"}
Jul 28 20:25:19.333528 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:19.333489    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-118.ec2.internal" event={"ID":"6f550312f83763fae04905f9587ee14d","Type":"ContainerStarted","Data":"b6f0a3fc03e05093d2b6669a7b58e329555886c2bda6f7057e9244fd18004f72"}
Jul 28 20:25:19.334574 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:19.334555    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbd9n" event={"ID":"1d7a6538-4785-41e2-a656-c38ff732f34f","Type":"ContainerStarted","Data":"df809cacffe302798738651a608072d1548f6c0b581dd7886610143a7e04eb4b"}
Jul 28 20:25:19.335445 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:19.335420    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nzzb2" event={"ID":"7c198bb1-4a1e-4292-ab80-8d7a2560e1d0","Type":"ContainerStarted","Data":"6b18bda420ab9dba4275eedf9a9e100de6ece022dd2dffde943d69305cf65505"}
Jul 28 20:25:19.348037 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:19.347992    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-118.ec2.internal" podStartSLOduration=2.347979351 podStartE2EDuration="2.347979351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:25:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:19.347457816 +0000 UTC m=+3.566846700" watchObservedRunningTime="2026-07-28 20:25:19.347979351 +0000 UTC m=+3.567368295"
Jul 28 20:25:19.769143 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:19.769107    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bd6b65c-2bb9-43c4-bde8-420e312202ce-metrics-certs\") pod \"network-metrics-daemon-q5clp\" (UID: \"1bd6b65c-2bb9-43c4-bde8-420e312202ce\") " pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:19.769331 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:19.769268    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:25:19.769412 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:19.769337    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bd6b65c-2bb9-43c4-bde8-420e312202ce-metrics-certs podName:1bd6b65c-2bb9-43c4-bde8-420e312202ce nodeName:}" failed. No retries permitted until 2026-07-28 20:25:21.769317228 +0000 UTC m=+5.988706104 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bd6b65c-2bb9-43c4-bde8-420e312202ce-metrics-certs") pod "network-metrics-daemon-q5clp" (UID: "1bd6b65c-2bb9-43c4-bde8-420e312202ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:25:19.870234 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:19.870197    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57cc3100-f7ce-4374-ae22-73b79eb8db6a-original-pull-secret\") pod \"global-pull-secret-syncer-vg2dj\" (UID: \"57cc3100-f7ce-4374-ae22-73b79eb8db6a\") " pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:19.870436 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:19.870383    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 20:25:19.870497 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:19.870448    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57cc3100-f7ce-4374-ae22-73b79eb8db6a-original-pull-secret podName:57cc3100-f7ce-4374-ae22-73b79eb8db6a nodeName:}" failed. No retries permitted until 2026-07-28 20:25:21.870430519 +0000 UTC m=+6.089819406 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57cc3100-f7ce-4374-ae22-73b79eb8db6a-original-pull-secret") pod "global-pull-secret-syncer-vg2dj" (UID: "57cc3100-f7ce-4374-ae22-73b79eb8db6a") : object "kube-system"/"original-pull-secret" not registered
Jul 28 20:25:19.971687 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:19.971301    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdv2q\" (UniqueName: \"kubernetes.io/projected/93e5d919-86e5-4cf9-b433-12ec1ea8cd0f-kube-api-access-pdv2q\") pod \"network-check-target-qfldd\" (UID: \"93e5d919-86e5-4cf9-b433-12ec1ea8cd0f\") " pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:19.971687 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:19.971512    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 20:25:19.971687 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:19.971532    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 20:25:19.971687 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:19.971545    2556 projected.go:196] Error preparing data for projected volume kube-api-access-pdv2q for pod openshift-network-diagnostics/network-check-target-qfldd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:25:19.971687 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:19.971639    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93e5d919-86e5-4cf9-b433-12ec1ea8cd0f-kube-api-access-pdv2q podName:93e5d919-86e5-4cf9-b433-12ec1ea8cd0f nodeName:}" failed. No retries permitted until 2026-07-28 20:25:21.971619956 +0000 UTC m=+6.191008835 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pdv2q" (UniqueName: "kubernetes.io/projected/93e5d919-86e5-4cf9-b433-12ec1ea8cd0f-kube-api-access-pdv2q") pod "network-check-target-qfldd" (UID: "93e5d919-86e5-4cf9-b433-12ec1ea8cd0f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:25:20.212256 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:20.212113    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 20:20:18 +0000 UTC" deadline="2028-04-17 12:53:17.986859072 +0000 UTC"
Jul 28 20:25:20.212256 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:20.212174    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15088h27m57.774689213s"
Jul 28 20:25:20.308265 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:20.308231    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:20.308469 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:20.308392    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vg2dj" podUID="57cc3100-f7ce-4374-ae22-73b79eb8db6a"
Jul 28 20:25:20.308880 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:20.308858    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:20.308988 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:20.308968    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5clp" podUID="1bd6b65c-2bb9-43c4-bde8-420e312202ce"
Jul 28 20:25:20.353924 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:20.352939    2556 generic.go:356] "Generic (PLEG): container finished" podID="86367fdd94c7d90921bcf24ee0684a91" containerID="240b4db75ba9b2c2b0fb1c8a1bb4f5cf20fc8fb960400d161061fe92ccee4578" exitCode=0
Jul 28 20:25:20.353924 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:20.353418    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal" event={"ID":"86367fdd94c7d90921bcf24ee0684a91","Type":"ContainerDied","Data":"240b4db75ba9b2c2b0fb1c8a1bb4f5cf20fc8fb960400d161061fe92ccee4578"}
Jul 28 20:25:21.308096 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:21.308069    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:21.308567 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:21.308195    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfldd" podUID="93e5d919-86e5-4cf9-b433-12ec1ea8cd0f"
Jul 28 20:25:21.376142 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:21.375485    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal" event={"ID":"86367fdd94c7d90921bcf24ee0684a91","Type":"ContainerStarted","Data":"ba1460906fffda1ba5f99fcc4cc2265a03fa3646615dc12cb716c2ad85c4fff8"}
Jul 28 20:25:21.794445 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:21.791471    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bd6b65c-2bb9-43c4-bde8-420e312202ce-metrics-certs\") pod \"network-metrics-daemon-q5clp\" (UID: \"1bd6b65c-2bb9-43c4-bde8-420e312202ce\") " pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:21.794445 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:21.791636    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:25:21.794445 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:21.791713    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bd6b65c-2bb9-43c4-bde8-420e312202ce-metrics-certs podName:1bd6b65c-2bb9-43c4-bde8-420e312202ce nodeName:}" failed. No retries permitted until 2026-07-28 20:25:25.791692634 +0000 UTC m=+10.011081515 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bd6b65c-2bb9-43c4-bde8-420e312202ce-metrics-certs") pod "network-metrics-daemon-q5clp" (UID: "1bd6b65c-2bb9-43c4-bde8-420e312202ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:25:21.892541 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:21.892505    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57cc3100-f7ce-4374-ae22-73b79eb8db6a-original-pull-secret\") pod \"global-pull-secret-syncer-vg2dj\" (UID: \"57cc3100-f7ce-4374-ae22-73b79eb8db6a\") " pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:21.892715 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:21.892657    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 20:25:21.892783 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:21.892744    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57cc3100-f7ce-4374-ae22-73b79eb8db6a-original-pull-secret podName:57cc3100-f7ce-4374-ae22-73b79eb8db6a nodeName:}" failed. No retries permitted until 2026-07-28 20:25:25.892722657 +0000 UTC m=+10.112111522 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57cc3100-f7ce-4374-ae22-73b79eb8db6a-original-pull-secret") pod "global-pull-secret-syncer-vg2dj" (UID: "57cc3100-f7ce-4374-ae22-73b79eb8db6a") : object "kube-system"/"original-pull-secret" not registered
Jul 28 20:25:21.993235 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:21.993150    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdv2q\" (UniqueName: \"kubernetes.io/projected/93e5d919-86e5-4cf9-b433-12ec1ea8cd0f-kube-api-access-pdv2q\") pod \"network-check-target-qfldd\" (UID: \"93e5d919-86e5-4cf9-b433-12ec1ea8cd0f\") " pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:21.993416 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:21.993338    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 20:25:21.993416 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:21.993379    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 20:25:21.993416 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:21.993393    2556 projected.go:196] Error preparing data for projected volume kube-api-access-pdv2q for pod openshift-network-diagnostics/network-check-target-qfldd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:25:21.993587 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:21.993457    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93e5d919-86e5-4cf9-b433-12ec1ea8cd0f-kube-api-access-pdv2q podName:93e5d919-86e5-4cf9-b433-12ec1ea8cd0f nodeName:}" failed. No retries permitted until 2026-07-28 20:25:25.993437298 +0000 UTC m=+10.212826179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pdv2q" (UniqueName: "kubernetes.io/projected/93e5d919-86e5-4cf9-b433-12ec1ea8cd0f-kube-api-access-pdv2q") pod "network-check-target-qfldd" (UID: "93e5d919-86e5-4cf9-b433-12ec1ea8cd0f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:25:22.308855 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:22.307893    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:22.308855 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:22.308196    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vg2dj" podUID="57cc3100-f7ce-4374-ae22-73b79eb8db6a"
Jul 28 20:25:22.308855 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:22.308655    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:22.308855 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:22.308816    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5clp" podUID="1bd6b65c-2bb9-43c4-bde8-420e312202ce"
Jul 28 20:25:23.308478 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:23.307946    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:23.308478 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:23.308076    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfldd" podUID="93e5d919-86e5-4cf9-b433-12ec1ea8cd0f"
Jul 28 20:25:24.308416 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:24.308377    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:24.308882 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:24.308521    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5clp" podUID="1bd6b65c-2bb9-43c4-bde8-420e312202ce"
Jul 28 20:25:24.308882 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:24.308392    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:24.308989 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:24.308964    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vg2dj" podUID="57cc3100-f7ce-4374-ae22-73b79eb8db6a"
Jul 28 20:25:25.307846 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:25.307432    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:25.307846 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:25.307555    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfldd" podUID="93e5d919-86e5-4cf9-b433-12ec1ea8cd0f"
Jul 28 20:25:25.827294 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:25.827202    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bd6b65c-2bb9-43c4-bde8-420e312202ce-metrics-certs\") pod \"network-metrics-daemon-q5clp\" (UID: \"1bd6b65c-2bb9-43c4-bde8-420e312202ce\") " pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:25.827794 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:25.827318    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:25:25.827794 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:25.827390    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bd6b65c-2bb9-43c4-bde8-420e312202ce-metrics-certs podName:1bd6b65c-2bb9-43c4-bde8-420e312202ce nodeName:}" failed. No retries permitted until 2026-07-28 20:25:33.82737446 +0000 UTC m=+18.046763324 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bd6b65c-2bb9-43c4-bde8-420e312202ce-metrics-certs") pod "network-metrics-daemon-q5clp" (UID: "1bd6b65c-2bb9-43c4-bde8-420e312202ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:25:25.928554 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:25.928002    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57cc3100-f7ce-4374-ae22-73b79eb8db6a-original-pull-secret\") pod \"global-pull-secret-syncer-vg2dj\" (UID: \"57cc3100-f7ce-4374-ae22-73b79eb8db6a\") " pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:25.928554 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:25.928172    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 20:25:25.928554 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:25.928230    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57cc3100-f7ce-4374-ae22-73b79eb8db6a-original-pull-secret podName:57cc3100-f7ce-4374-ae22-73b79eb8db6a nodeName:}" failed. No retries permitted until 2026-07-28 20:25:33.928212625 +0000 UTC m=+18.147601493 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57cc3100-f7ce-4374-ae22-73b79eb8db6a-original-pull-secret") pod "global-pull-secret-syncer-vg2dj" (UID: "57cc3100-f7ce-4374-ae22-73b79eb8db6a") : object "kube-system"/"original-pull-secret" not registered
Jul 28 20:25:26.028903 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:26.028751    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdv2q\" (UniqueName: \"kubernetes.io/projected/93e5d919-86e5-4cf9-b433-12ec1ea8cd0f-kube-api-access-pdv2q\") pod \"network-check-target-qfldd\" (UID: \"93e5d919-86e5-4cf9-b433-12ec1ea8cd0f\") " pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:26.029070 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:26.028913    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 20:25:26.029070 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:26.028932    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 20:25:26.029070 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:26.028944    2556 projected.go:196] Error preparing data for projected volume kube-api-access-pdv2q for pod openshift-network-diagnostics/network-check-target-qfldd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:25:26.029070 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:26.029003    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93e5d919-86e5-4cf9-b433-12ec1ea8cd0f-kube-api-access-pdv2q podName:93e5d919-86e5-4cf9-b433-12ec1ea8cd0f nodeName:}" failed. No retries permitted until 2026-07-28 20:25:34.028985094 +0000 UTC m=+18.248373959 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pdv2q" (UniqueName: "kubernetes.io/projected/93e5d919-86e5-4cf9-b433-12ec1ea8cd0f-kube-api-access-pdv2q") pod "network-check-target-qfldd" (UID: "93e5d919-86e5-4cf9-b433-12ec1ea8cd0f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:25:26.309580 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:26.308880    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:26.309580 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:26.308990    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vg2dj" podUID="57cc3100-f7ce-4374-ae22-73b79eb8db6a"
Jul 28 20:25:26.309580 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:26.309376    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:26.309580 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:26.309487    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5clp" podUID="1bd6b65c-2bb9-43c4-bde8-420e312202ce"
Jul 28 20:25:27.307682 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:27.307599    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:27.308119 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:27.307725    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfldd" podUID="93e5d919-86e5-4cf9-b433-12ec1ea8cd0f"
Jul 28 20:25:28.308073 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:28.308037    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:28.308564 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:28.308177    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vg2dj" podUID="57cc3100-f7ce-4374-ae22-73b79eb8db6a"
Jul 28 20:25:28.308675 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:28.308583    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:28.308755 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:28.308710    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5clp" podUID="1bd6b65c-2bb9-43c4-bde8-420e312202ce"
Jul 28 20:25:29.308100 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:29.308063    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:29.308545 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:29.308180    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfldd" podUID="93e5d919-86e5-4cf9-b433-12ec1ea8cd0f"
Jul 28 20:25:30.307838 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:30.307799    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:30.308012 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:30.307808    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:30.308012 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:30.307944    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5clp" podUID="1bd6b65c-2bb9-43c4-bde8-420e312202ce"
Jul 28 20:25:30.308137 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:30.308014    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vg2dj" podUID="57cc3100-f7ce-4374-ae22-73b79eb8db6a"
Jul 28 20:25:31.307559 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:31.307531    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:31.307751 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:31.307650    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfldd" podUID="93e5d919-86e5-4cf9-b433-12ec1ea8cd0f"
Jul 28 20:25:32.307983 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:32.307946    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:32.308455 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:32.307946    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:32.308455 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:32.308070    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vg2dj" podUID="57cc3100-f7ce-4374-ae22-73b79eb8db6a"
Jul 28 20:25:32.308455 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:32.308175    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5clp" podUID="1bd6b65c-2bb9-43c4-bde8-420e312202ce"
Jul 28 20:25:33.307857 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:33.307838    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:33.307983 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:33.307927    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfldd" podUID="93e5d919-86e5-4cf9-b433-12ec1ea8cd0f"
Jul 28 20:25:33.892436 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:33.892401    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bd6b65c-2bb9-43c4-bde8-420e312202ce-metrics-certs\") pod \"network-metrics-daemon-q5clp\" (UID: \"1bd6b65c-2bb9-43c4-bde8-420e312202ce\") " pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:33.892840 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:33.892519    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:25:33.892840 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:33.892578    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bd6b65c-2bb9-43c4-bde8-420e312202ce-metrics-certs podName:1bd6b65c-2bb9-43c4-bde8-420e312202ce nodeName:}" failed. No retries permitted until 2026-07-28 20:25:49.892563856 +0000 UTC m=+34.111952720 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bd6b65c-2bb9-43c4-bde8-420e312202ce-metrics-certs") pod "network-metrics-daemon-q5clp" (UID: "1bd6b65c-2bb9-43c4-bde8-420e312202ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:25:33.993668 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:33.993628    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57cc3100-f7ce-4374-ae22-73b79eb8db6a-original-pull-secret\") pod \"global-pull-secret-syncer-vg2dj\" (UID: \"57cc3100-f7ce-4374-ae22-73b79eb8db6a\") " pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:33.993843 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:33.993773    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 20:25:33.993843 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:33.993840    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57cc3100-f7ce-4374-ae22-73b79eb8db6a-original-pull-secret podName:57cc3100-f7ce-4374-ae22-73b79eb8db6a nodeName:}" failed. No retries permitted until 2026-07-28 20:25:49.993821124 +0000 UTC m=+34.213209991 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57cc3100-f7ce-4374-ae22-73b79eb8db6a-original-pull-secret") pod "global-pull-secret-syncer-vg2dj" (UID: "57cc3100-f7ce-4374-ae22-73b79eb8db6a") : object "kube-system"/"original-pull-secret" not registered
Jul 28 20:25:34.094320 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:34.094284    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdv2q\" (UniqueName: \"kubernetes.io/projected/93e5d919-86e5-4cf9-b433-12ec1ea8cd0f-kube-api-access-pdv2q\") pod \"network-check-target-qfldd\" (UID: \"93e5d919-86e5-4cf9-b433-12ec1ea8cd0f\") " pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:34.094500 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:34.094483    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 20:25:34.094562 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:34.094512    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 20:25:34.094562 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:34.094526    2556 projected.go:196] Error preparing data for projected volume kube-api-access-pdv2q for pod openshift-network-diagnostics/network-check-target-qfldd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:25:34.094687 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:34.094590    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93e5d919-86e5-4cf9-b433-12ec1ea8cd0f-kube-api-access-pdv2q podName:93e5d919-86e5-4cf9-b433-12ec1ea8cd0f nodeName:}" failed. No retries permitted until 2026-07-28 20:25:50.094570555 +0000 UTC m=+34.313959422 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pdv2q" (UniqueName: "kubernetes.io/projected/93e5d919-86e5-4cf9-b433-12ec1ea8cd0f-kube-api-access-pdv2q") pod "network-check-target-qfldd" (UID: "93e5d919-86e5-4cf9-b433-12ec1ea8cd0f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:25:34.307844 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:34.307761    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:34.308002 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:34.307893    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vg2dj" podUID="57cc3100-f7ce-4374-ae22-73b79eb8db6a"
Jul 28 20:25:34.308002 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:34.307945    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:34.308107 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:34.308070    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5clp" podUID="1bd6b65c-2bb9-43c4-bde8-420e312202ce"
Jul 28 20:25:35.307664 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:35.307630    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:35.308139 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:35.307759    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfldd" podUID="93e5d919-86e5-4cf9-b433-12ec1ea8cd0f"
Jul 28 20:25:36.308753 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:36.308719    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:36.309219 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:36.308806    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:36.309219 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:36.308832    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vg2dj" podUID="57cc3100-f7ce-4374-ae22-73b79eb8db6a"
Jul 28 20:25:36.309219 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:36.308921    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5clp" podUID="1bd6b65c-2bb9-43c4-bde8-420e312202ce"
Jul 28 20:25:37.307695 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:37.307662    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:37.307872 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:37.307778    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfldd" podUID="93e5d919-86e5-4cf9-b433-12ec1ea8cd0f"
Jul 28 20:25:38.308028 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:38.307593    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:38.308850 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:38.307654    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:38.308850 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:38.308104    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vg2dj" podUID="57cc3100-f7ce-4374-ae22-73b79eb8db6a"
Jul 28 20:25:38.308850 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:38.308204    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5clp" podUID="1bd6b65c-2bb9-43c4-bde8-420e312202ce"
Jul 28 20:25:38.414147 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:38.414114    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6" event={"ID":"428c633c-6652-4692-b11c-f7fd49dfef27","Type":"ContainerStarted","Data":"5b0da0b6af1b4afe4c0e1ad2e31bf617707be0abc2cca73aefcc72edeadfbeb9"}
Jul 28 20:25:38.414281 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:38.414190    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6" event={"ID":"428c633c-6652-4692-b11c-f7fd49dfef27","Type":"ContainerStarted","Data":"02a8d6dd3810e3b95cbdcb96ba32af3345629cbfb84895e2cf7ec75360bdd6b3"}
Jul 28 20:25:38.414281 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:38.414238    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6" event={"ID":"428c633c-6652-4692-b11c-f7fd49dfef27","Type":"ContainerStarted","Data":"2cb72e926926695b5fa4b31f11460ef2f91fe45bdcef038124409f857bd62157"}
Jul 28 20:25:38.414281 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:38.414278    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6" event={"ID":"428c633c-6652-4692-b11c-f7fd49dfef27","Type":"ContainerStarted","Data":"406c030ce19edab32d4f79d498d32471fccb6b400e34264abf92decd5bc29797"}
Jul 28 20:25:38.414457 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:38.414317    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6" event={"ID":"428c633c-6652-4692-b11c-f7fd49dfef27","Type":"ContainerStarted","Data":"06cfa77c19e04cab41ce4769873bce364ac675e786e01ec0297da7486dc9faff"}
Jul 28 20:25:38.414457 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:38.414378    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6" event={"ID":"428c633c-6652-4692-b11c-f7fd49dfef27","Type":"ContainerStarted","Data":"d93374f92633b193a30b19acdca81742c2ac79bcde01725dcba892e4990978c6"}
Jul 28 20:25:38.415746 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:38.415715    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bdgqd" event={"ID":"780efb8a-2479-40d2-84d3-ff6e99a90d36","Type":"ContainerStarted","Data":"515c95943296ee5c9168ac85abf5f81f267c0ab41f0a2fd5b5e8196b44d45d51"}
Jul 28 20:25:38.417284 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:38.417258    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g6f47" event={"ID":"fa72c226-5d99-455b-a62e-5a6cb0082abc","Type":"ContainerStarted","Data":"c42848dad398f3018230b7c4c5fdd999462269f5ac7ee45c430554cd6891ed00"}
Jul 28 20:25:38.418850 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:38.418829    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7" event={"ID":"ad66e7ad-4244-460f-9d3c-d7477b63eb42","Type":"ContainerStarted","Data":"a68e254ee77ef9ebd3509e8ee35256948f4b735c2f3a053f48498e9699e85f1d"}
Jul 28 20:25:38.420273 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:38.420242    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rks6q" event={"ID":"5038e87e-8040-462d-b863-d61fefcd473b","Type":"ContainerStarted","Data":"df6de4a2f0b0116768c8d01bb5f0d9d8d15212c13cca2627d233bef499a69187"}
Jul 28 20:25:38.422010 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:38.421990    2556 generic.go:356] "Generic (PLEG): container finished" podID="1d7a6538-4785-41e2-a656-c38ff732f34f" containerID="287c90e5a2f58a86197834578e9b530928ee7bc69062a8f6c1182dbb20306411" exitCode=0
Jul 28 20:25:38.422115 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:38.422054    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbd9n" event={"ID":"1d7a6538-4785-41e2-a656-c38ff732f34f","Type":"ContainerDied","Data":"287c90e5a2f58a86197834578e9b530928ee7bc69062a8f6c1182dbb20306411"}
Jul 28 20:25:38.424474 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:38.424450    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nzzb2" event={"ID":"7c198bb1-4a1e-4292-ab80-8d7a2560e1d0","Type":"ContainerStarted","Data":"f8d027cfb6e8a676e41b975012f00dd024c7e9d542669538683aec174c8b3fe0"}
Jul 28 20:25:38.425971 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:38.425951    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v9cdq" event={"ID":"2de8bfb7-7284-4efa-b9f5-226703b4bce6","Type":"ContainerStarted","Data":"ced3081ba33a3a0af3d6c651693f7a99dba7dd0b8a4a53897aff4e49825e52a3"}
Jul 28 20:25:38.437636 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:38.437591    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bdgqd" podStartSLOduration=4.243831711 podStartE2EDuration="22.437578323s" totalImagesPullingTime="18.193746612s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:38.43703546 +0000 UTC m=+22.656424345" watchObservedRunningTime="2026-07-28 20:25:38.437578323 +0000 UTC m=+22.656967208"
Jul 28 20:25:38.437741 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:38.437671    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-118.ec2.internal" podStartSLOduration=21.437664615 podStartE2EDuration="21.437664615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:25:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:21.392094509 +0000 UTC m=+5.611483407" watchObservedRunningTime="2026-07-28 20:25:38.437664615 +0000 UTC m=+22.657053501"
Jul 28 20:25:38.457560 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:38.457519    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nzzb2" podStartSLOduration=8.375325207 podStartE2EDuration="22.457506735s" totalImagesPullingTime="14.082181528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:38.457097493 +0000 UTC m=+22.676486377" watchObservedRunningTime="2026-07-28 20:25:38.457506735 +0000 UTC m=+22.676895620"
Jul 28 20:25:38.477207 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:38.477169    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-v9cdq" podStartSLOduration=4.296295439 podStartE2EDuration="22.477158367s" totalImagesPullingTime="18.180862928s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:38.47703731 +0000 UTC m=+22.696426243" watchObservedRunningTime="2026-07-28 20:25:38.477158367 +0000 UTC m=+22.696547251"
Jul 28 20:25:38.499164 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:38.499114    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rks6q" podStartSLOduration=4.256259348 podStartE2EDuration="22.499095042s" totalImagesPullingTime="18.242835694s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:38.498885165 +0000 UTC m=+22.718274071" watchObservedRunningTime="2026-07-28 20:25:38.499095042 +0000 UTC m=+22.718483929"
Jul 28 20:25:38.561609 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:38.561560    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-g6f47" podStartSLOduration=4.392333749 podStartE2EDuration="22.561545308s" totalImagesPullingTime="18.169211559s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:38.558063589 +0000 UTC m=+22.777452504" watchObservedRunningTime="2026-07-28 20:25:38.561545308 +0000 UTC m=+22.780934192"
Jul 28 20:25:39.150091 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:39.150051    2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 20:25:39.204393 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:39.204233    2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T20:25:39.150073989Z","UUID":"9638bd7f-db40-4ee0-bf60-2d1fd5e25af5","Handler":null,"Name":"","Endpoint":""}
Jul 28 20:25:39.205881 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:39.205858    2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 20:25:39.206002 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:39.205897    2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 20:25:39.307992 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:39.307922    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:39.308156 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:39.308043    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfldd" podUID="93e5d919-86e5-4cf9-b433-12ec1ea8cd0f"
Jul 28 20:25:39.430403 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:39.430340    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7" event={"ID":"ad66e7ad-4244-460f-9d3c-d7477b63eb42","Type":"ContainerStarted","Data":"d809df693ea84ee90129090f7dd6300aff2dc091186789cc626e3b4fe69549fa"}
Jul 28 20:25:39.431912 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:39.431881    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jnl9p" event={"ID":"18736bc6-d100-45e8-b4f4-2e74fae960f6","Type":"ContainerStarted","Data":"5a2d57243f97a71e8970933df3fcc5db1345c6b278e7170a25db8878e9827291"}
Jul 28 20:25:39.448704 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:39.448661    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jnl9p" podStartSLOduration=5.257216792 podStartE2EDuration="23.448649152s" totalImagesPullingTime="18.19143236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:39.448270264 +0000 UTC m=+23.667659150" watchObservedRunningTime="2026-07-28 20:25:39.448649152 +0000 UTC m=+23.668038056"
Jul 28 20:25:40.308155 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:40.308121    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:40.308611 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:40.308125    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:40.308611 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:40.308244    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vg2dj" podUID="57cc3100-f7ce-4374-ae22-73b79eb8db6a"
Jul 28 20:25:40.308611 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:40.308361    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5clp" podUID="1bd6b65c-2bb9-43c4-bde8-420e312202ce"
Jul 28 20:25:40.592317 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:40.592148    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nzzb2"
Jul 28 20:25:40.592914 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:40.592895    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nzzb2"
Jul 28 20:25:41.307812 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:41.307783    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:41.307990 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:41.307907    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfldd" podUID="93e5d919-86e5-4cf9-b433-12ec1ea8cd0f"
Jul 28 20:25:41.440745 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:41.440699    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6" event={"ID":"428c633c-6652-4692-b11c-f7fd49dfef27","Type":"ContainerStarted","Data":"a9d206584963760b81dc35c15d8a01ae3e5f839f38269a89213011f970cb4d37"}
Jul 28 20:25:41.446069 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:41.446036    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7" event={"ID":"ad66e7ad-4244-460f-9d3c-d7477b63eb42","Type":"ContainerStarted","Data":"f6af6b84d62dcf26c69e2e9db295153c3ac6549842d242ae5e663a6822e59f0a"}
Jul 28 20:25:41.446601 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:41.446364    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nzzb2"
Jul 28 20:25:41.446760 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:41.446745    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nzzb2"
Jul 28 20:25:41.466639 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:41.466596    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6ghd7" podStartSLOduration=4.551838699 podStartE2EDuration="25.466585582s" totalImagesPullingTime="20.914746883s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:25:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:41.466401131 +0000 UTC m=+25.685790016" watchObservedRunningTime="2026-07-28 20:25:41.466585582 +0000 UTC m=+25.685974465"
Jul 28 20:25:42.308087 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:42.307880    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:42.308266 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:42.308197    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5clp" podUID="1bd6b65c-2bb9-43c4-bde8-420e312202ce"
Jul 28 20:25:42.308266 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:42.307934    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:42.308431 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:42.308336    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vg2dj" podUID="57cc3100-f7ce-4374-ae22-73b79eb8db6a"
Jul 28 20:25:43.307655 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:43.307593    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:43.308284 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:43.307679    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfldd" podUID="93e5d919-86e5-4cf9-b433-12ec1ea8cd0f"
Jul 28 20:25:43.451815 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:43.451787    2556 generic.go:356] "Generic (PLEG): container finished" podID="1d7a6538-4785-41e2-a656-c38ff732f34f" containerID="21a8f665cfb149625479c73a2d84c36c31b782bf0e8c617b52f8d6d75fe65653" exitCode=0
Jul 28 20:25:43.451980 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:43.451877    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbd9n" event={"ID":"1d7a6538-4785-41e2-a656-c38ff732f34f","Type":"ContainerDied","Data":"21a8f665cfb149625479c73a2d84c36c31b782bf0e8c617b52f8d6d75fe65653"}
Jul 28 20:25:43.455570 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:43.455538    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6" event={"ID":"428c633c-6652-4692-b11c-f7fd49dfef27","Type":"ContainerStarted","Data":"02536ad56fcfccc0aa7fc610b9962573a8647159fb302eaed27028dc8519de29"}
Jul 28 20:25:43.455773 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:43.455760    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:43.470060 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:43.470042    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:43.506019 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:43.505979    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6" podStartSLOduration=9.25589691 podStartE2EDuration="27.505966628s" totalImagesPullingTime="18.250069718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:43.505631518 +0000 UTC m=+27.725020463" watchObservedRunningTime="2026-07-28 20:25:43.505966628 +0000 UTC m=+27.725355526"
Jul 28 20:25:44.308287 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:44.308253    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:44.308735 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:44.308381    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5clp" podUID="1bd6b65c-2bb9-43c4-bde8-420e312202ce"
Jul 28 20:25:44.308735 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:44.308443    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:44.308735 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:44.308535    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vg2dj" podUID="57cc3100-f7ce-4374-ae22-73b79eb8db6a"
Jul 28 20:25:44.459159 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:44.459082    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:44.459298 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:44.459188    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:44.473414 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:44.473388    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:25:45.307448 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:45.307424    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:45.307601 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:45.307511    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfldd" podUID="93e5d919-86e5-4cf9-b433-12ec1ea8cd0f"
Jul 28 20:25:45.463060 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:45.463030    2556 generic.go:356] "Generic (PLEG): container finished" podID="1d7a6538-4785-41e2-a656-c38ff732f34f" containerID="0cf3b3d87093c396c1e3f822f37f088bd546b39d37b74abb41c1a80bd46bc854" exitCode=0
Jul 28 20:25:45.463447 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:45.463116    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbd9n" event={"ID":"1d7a6538-4785-41e2-a656-c38ff732f34f","Type":"ContainerDied","Data":"0cf3b3d87093c396c1e3f822f37f088bd546b39d37b74abb41c1a80bd46bc854"}
Jul 28 20:25:46.308684 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:46.308518    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:46.308837 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:46.308743    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vg2dj" podUID="57cc3100-f7ce-4374-ae22-73b79eb8db6a"
Jul 28 20:25:46.308837 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:46.308614    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:46.308912 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:46.308834    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5clp" podUID="1bd6b65c-2bb9-43c4-bde8-420e312202ce"
Jul 28 20:25:47.308365 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:47.308314    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:47.308755 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:47.308416    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfldd" podUID="93e5d919-86e5-4cf9-b433-12ec1ea8cd0f"
Jul 28 20:25:47.469193 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:47.469164    2556 generic.go:356] "Generic (PLEG): container finished" podID="1d7a6538-4785-41e2-a656-c38ff732f34f" containerID="3580c32648b0d4f886c0dd9bcb8144caad3021e9aca176e6a5d7bf7391153fd3" exitCode=0
Jul 28 20:25:47.469371 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:47.469214    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbd9n" event={"ID":"1d7a6538-4785-41e2-a656-c38ff732f34f","Type":"ContainerDied","Data":"3580c32648b0d4f886c0dd9bcb8144caad3021e9aca176e6a5d7bf7391153fd3"}
Jul 28 20:25:48.307975 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:48.307935    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:48.308160 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:48.308091    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5clp" podUID="1bd6b65c-2bb9-43c4-bde8-420e312202ce"
Jul 28 20:25:48.308160 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:48.308103    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:48.308272 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:48.308209    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vg2dj" podUID="57cc3100-f7ce-4374-ae22-73b79eb8db6a"
Jul 28 20:25:49.308246 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:49.308215    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:49.308672 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:49.308361    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfldd" podUID="93e5d919-86e5-4cf9-b433-12ec1ea8cd0f"
Jul 28 20:25:49.918054 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:49.918016    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bd6b65c-2bb9-43c4-bde8-420e312202ce-metrics-certs\") pod \"network-metrics-daemon-q5clp\" (UID: \"1bd6b65c-2bb9-43c4-bde8-420e312202ce\") " pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:49.918255 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:49.918165    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:25:49.918255 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:49.918231    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bd6b65c-2bb9-43c4-bde8-420e312202ce-metrics-certs podName:1bd6b65c-2bb9-43c4-bde8-420e312202ce nodeName:}" failed. No retries permitted until 2026-07-28 20:26:21.918215321 +0000 UTC m=+66.137604184 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bd6b65c-2bb9-43c4-bde8-420e312202ce-metrics-certs") pod "network-metrics-daemon-q5clp" (UID: "1bd6b65c-2bb9-43c4-bde8-420e312202ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 20:25:50.019307 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:50.019272    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57cc3100-f7ce-4374-ae22-73b79eb8db6a-original-pull-secret\") pod \"global-pull-secret-syncer-vg2dj\" (UID: \"57cc3100-f7ce-4374-ae22-73b79eb8db6a\") " pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:50.019474 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:50.019430    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 20:25:50.019518 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:50.019503    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57cc3100-f7ce-4374-ae22-73b79eb8db6a-original-pull-secret podName:57cc3100-f7ce-4374-ae22-73b79eb8db6a nodeName:}" failed. No retries permitted until 2026-07-28 20:26:22.019484742 +0000 UTC m=+66.238873623 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57cc3100-f7ce-4374-ae22-73b79eb8db6a-original-pull-secret") pod "global-pull-secret-syncer-vg2dj" (UID: "57cc3100-f7ce-4374-ae22-73b79eb8db6a") : object "kube-system"/"original-pull-secret" not registered
Jul 28 20:25:50.120211 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:50.120176    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdv2q\" (UniqueName: \"kubernetes.io/projected/93e5d919-86e5-4cf9-b433-12ec1ea8cd0f-kube-api-access-pdv2q\") pod \"network-check-target-qfldd\" (UID: \"93e5d919-86e5-4cf9-b433-12ec1ea8cd0f\") " pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:50.120405 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:50.120386    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 20:25:50.120479 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:50.120413    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 20:25:50.120479 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:50.120426    2556 projected.go:196] Error preparing data for projected volume kube-api-access-pdv2q for pod openshift-network-diagnostics/network-check-target-qfldd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:25:50.120580 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:50.120490    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93e5d919-86e5-4cf9-b433-12ec1ea8cd0f-kube-api-access-pdv2q podName:93e5d919-86e5-4cf9-b433-12ec1ea8cd0f nodeName:}" failed. No retries permitted until 2026-07-28 20:26:22.120469837 +0000 UTC m=+66.339858716 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pdv2q" (UniqueName: "kubernetes.io/projected/93e5d919-86e5-4cf9-b433-12ec1ea8cd0f-kube-api-access-pdv2q") pod "network-check-target-qfldd" (UID: "93e5d919-86e5-4cf9-b433-12ec1ea8cd0f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 20:25:50.307957 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:50.307872    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:50.308109 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:50.307999    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vg2dj" podUID="57cc3100-f7ce-4374-ae22-73b79eb8db6a"
Jul 28 20:25:50.308109 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:50.308059    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:50.308228 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:50.308190    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5clp" podUID="1bd6b65c-2bb9-43c4-bde8-420e312202ce"
Jul 28 20:25:51.307596 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:51.307565    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:51.307991 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:51.307678    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfldd" podUID="93e5d919-86e5-4cf9-b433-12ec1ea8cd0f"
Jul 28 20:25:52.307533 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:52.307505    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:52.307533 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:52.307521    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:52.307973 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:52.307603    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5clp" podUID="1bd6b65c-2bb9-43c4-bde8-420e312202ce"
Jul 28 20:25:52.307973 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:52.307744    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vg2dj" podUID="57cc3100-f7ce-4374-ae22-73b79eb8db6a"
Jul 28 20:25:52.483793 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:52.483756    2556 generic.go:356] "Generic (PLEG): container finished" podID="1d7a6538-4785-41e2-a656-c38ff732f34f" containerID="fa721cc108f5e271680d1752fe35bcddeffcbfd61ad7de4b5b032fec22f13c9c" exitCode=0
Jul 28 20:25:52.483923 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:52.483801    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbd9n" event={"ID":"1d7a6538-4785-41e2-a656-c38ff732f34f","Type":"ContainerDied","Data":"fa721cc108f5e271680d1752fe35bcddeffcbfd61ad7de4b5b032fec22f13c9c"}
Jul 28 20:25:53.308236 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:53.308205    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:53.308630 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:53.308301    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfldd" podUID="93e5d919-86e5-4cf9-b433-12ec1ea8cd0f"
Jul 28 20:25:53.491576 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:53.491539    2556 generic.go:356] "Generic (PLEG): container finished" podID="1d7a6538-4785-41e2-a656-c38ff732f34f" containerID="086048514ed1763bacfefb59f4b54ed1023e679b5f81d987a453cabd74f4e85e" exitCode=0
Jul 28 20:25:53.491724 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:53.491617    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbd9n" event={"ID":"1d7a6538-4785-41e2-a656-c38ff732f34f","Type":"ContainerDied","Data":"086048514ed1763bacfefb59f4b54ed1023e679b5f81d987a453cabd74f4e85e"}
Jul 28 20:25:54.308183 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:54.308154    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:54.308392 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:54.308283    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5clp" podUID="1bd6b65c-2bb9-43c4-bde8-420e312202ce"
Jul 28 20:25:54.308392 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:54.308356    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:54.308741 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:54.308466    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vg2dj" podUID="57cc3100-f7ce-4374-ae22-73b79eb8db6a"
Jul 28 20:25:54.496648 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:54.496615    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kbd9n" event={"ID":"1d7a6538-4785-41e2-a656-c38ff732f34f","Type":"ContainerStarted","Data":"3776803a9c95ad998736105d4a54ae1c662ed2db4cad2b8865bf462585a9afd5"}
Jul 28 20:25:54.537232 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:54.537189    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kbd9n" podStartSLOduration=9.373141848 podStartE2EDuration="38.537176219s" totalImagesPullingTime="29.164034371s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:25:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:54.537099876 +0000 UTC m=+38.756488761" watchObservedRunningTime="2026-07-28 20:25:54.537176219 +0000 UTC m=+38.756565104"
Jul 28 20:25:55.307794 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:55.307765    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:55.307910 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:55.307871    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfldd" podUID="93e5d919-86e5-4cf9-b433-12ec1ea8cd0f"
Jul 28 20:25:55.449589 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:55.449556    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qfldd"]
Jul 28 20:25:55.457583 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:55.457558    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q5clp"]
Jul 28 20:25:55.457719 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:55.457690    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:55.457847 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:55.457823    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5clp" podUID="1bd6b65c-2bb9-43c4-bde8-420e312202ce"
Jul 28 20:25:55.458515 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:55.458382    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vg2dj"]
Jul 28 20:25:55.458515 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:55.458469    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:55.458655 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:55.458568    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vg2dj" podUID="57cc3100-f7ce-4374-ae22-73b79eb8db6a"
Jul 28 20:25:55.499017 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:55.498962    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:55.499100 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:55.499045    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfldd" podUID="93e5d919-86e5-4cf9-b433-12ec1ea8cd0f"
Jul 28 20:25:57.308371 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:57.308190    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:57.308739 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:57.308211    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:57.308739 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:57.308462    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5clp" podUID="1bd6b65c-2bb9-43c4-bde8-420e312202ce"
Jul 28 20:25:57.308739 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:57.308239    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:57.308739 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:57.308521    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfldd" podUID="93e5d919-86e5-4cf9-b433-12ec1ea8cd0f"
Jul 28 20:25:57.308739 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:25:57.308590    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vg2dj" podUID="57cc3100-f7ce-4374-ae22-73b79eb8db6a"
Jul 28 20:25:59.107221 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.107194    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-118.ec2.internal" event="NodeReady"
Jul 28 20:25:59.107579 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.107299    2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 20:25:59.148546 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.148487    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jfw94"]
Jul 28 20:25:59.168472 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.168448    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mcb5x"]
Jul 28 20:25:59.168594 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.168576    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jfw94"
Jul 28 20:25:59.171594 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.171574    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 20:25:59.171782 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.171767    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ntb9d\""
Jul 28 20:25:59.171893 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.171870    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 20:25:59.172030 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.172012    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 20:25:59.186293 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.186271    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4763f7ae-9a72-4b99-8cca-2560cb34a4ba-cert\") pod \"ingress-canary-jfw94\" (UID: \"4763f7ae-9a72-4b99-8cca-2560cb34a4ba\") " pod="openshift-ingress-canary/ingress-canary-jfw94"
Jul 28 20:25:59.186383 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.186297    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft6fl\" (UniqueName: \"kubernetes.io/projected/4763f7ae-9a72-4b99-8cca-2560cb34a4ba-kube-api-access-ft6fl\") pod \"ingress-canary-jfw94\" (UID: \"4763f7ae-9a72-4b99-8cca-2560cb34a4ba\") " pod="openshift-ingress-canary/ingress-canary-jfw94"
Jul 28 20:25:59.191783 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.191757    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jfw94"]
Jul 28 20:25:59.191783 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.191786    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mcb5x"]
Jul 28 20:25:59.191899 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.191811    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sqfxj"]
Jul 28 20:25:59.191899 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.191868    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mcb5x"
Jul 28 20:25:59.194463 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.194445    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 20:25:59.194569 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.194477    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-szcgk\""
Jul 28 20:25:59.194569 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.194503    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 20:25:59.194569 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.194452    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 20:25:59.194770 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.194694    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 20:25:59.215024 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.215007    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sqfxj"]
Jul 28 20:25:59.215106 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.215086    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sqfxj"
Jul 28 20:25:59.217773 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.217755    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 20:25:59.217875 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.217793    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 20:25:59.217875 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.217823    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8kqlj\""
Jul 28 20:25:59.286930 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.286905    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4763f7ae-9a72-4b99-8cca-2560cb34a4ba-cert\") pod \"ingress-canary-jfw94\" (UID: \"4763f7ae-9a72-4b99-8cca-2560cb34a4ba\") " pod="openshift-ingress-canary/ingress-canary-jfw94"
Jul 28 20:25:59.287038 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.286940    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft6fl\" (UniqueName: \"kubernetes.io/projected/4763f7ae-9a72-4b99-8cca-2560cb34a4ba-kube-api-access-ft6fl\") pod \"ingress-canary-jfw94\" (UID: \"4763f7ae-9a72-4b99-8cca-2560cb34a4ba\") " pod="openshift-ingress-canary/ingress-canary-jfw94"
Jul 28 20:25:59.287038 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.286966    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4bc5bd36-13ec-423b-aa68-678576b19935-config-volume\") pod \"dns-default-sqfxj\" (UID: \"4bc5bd36-13ec-423b-aa68-678576b19935\") " pod="openshift-dns/dns-default-sqfxj"
Jul 28 20:25:59.287038 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.286992    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc92053b-0c0e-42f3-988f-4e3b612e8d4a-data-volume\") pod \"insights-runtime-extractor-mcb5x\" (UID: \"cc92053b-0c0e-42f3-988f-4e3b612e8d4a\") " pod="openshift-insights/insights-runtime-extractor-mcb5x"
Jul 28 20:25:59.287038 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.287016    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jwj2\" (UniqueName: \"kubernetes.io/projected/4bc5bd36-13ec-423b-aa68-678576b19935-kube-api-access-2jwj2\") pod \"dns-default-sqfxj\" (UID: \"4bc5bd36-13ec-423b-aa68-678576b19935\") " pod="openshift-dns/dns-default-sqfxj"
Jul 28 20:25:59.287191 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.287064    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cc92053b-0c0e-42f3-988f-4e3b612e8d4a-crio-socket\") pod \"insights-runtime-extractor-mcb5x\" (UID: \"cc92053b-0c0e-42f3-988f-4e3b612e8d4a\") " pod="openshift-insights/insights-runtime-extractor-mcb5x"
Jul 28 20:25:59.287191 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.287120    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bc5bd36-13ec-423b-aa68-678576b19935-metrics-tls\") pod \"dns-default-sqfxj\" (UID: \"4bc5bd36-13ec-423b-aa68-678576b19935\") " pod="openshift-dns/dns-default-sqfxj"
Jul 28 20:25:59.287191 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.287144    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bc5bd36-13ec-423b-aa68-678576b19935-tmp-dir\") pod \"dns-default-sqfxj\" (UID: \"4bc5bd36-13ec-423b-aa68-678576b19935\") " pod="openshift-dns/dns-default-sqfxj"
Jul 28 20:25:59.287283 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.287214    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc92053b-0c0e-42f3-988f-4e3b612e8d4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mcb5x\" (UID: \"cc92053b-0c0e-42f3-988f-4e3b612e8d4a\") " pod="openshift-insights/insights-runtime-extractor-mcb5x"
Jul 28 20:25:59.287283 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.287245    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc92053b-0c0e-42f3-988f-4e3b612e8d4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mcb5x\" (UID: \"cc92053b-0c0e-42f3-988f-4e3b612e8d4a\") " pod="openshift-insights/insights-runtime-extractor-mcb5x"
Jul 28 20:25:59.287363 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.287287    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4swp\" (UniqueName: \"kubernetes.io/projected/cc92053b-0c0e-42f3-988f-4e3b612e8d4a-kube-api-access-k4swp\") pod \"insights-runtime-extractor-mcb5x\" (UID: \"cc92053b-0c0e-42f3-988f-4e3b612e8d4a\") " pod="openshift-insights/insights-runtime-extractor-mcb5x"
Jul 28 20:25:59.290970 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.290945    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4763f7ae-9a72-4b99-8cca-2560cb34a4ba-cert\") pod \"ingress-canary-jfw94\" (UID: \"4763f7ae-9a72-4b99-8cca-2560cb34a4ba\") " pod="openshift-ingress-canary/ingress-canary-jfw94"
Jul 28 20:25:59.296052 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.296032    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft6fl\" (UniqueName: \"kubernetes.io/projected/4763f7ae-9a72-4b99-8cca-2560cb34a4ba-kube-api-access-ft6fl\") pod \"ingress-canary-jfw94\" (UID: \"4763f7ae-9a72-4b99-8cca-2560cb34a4ba\") " pod="openshift-ingress-canary/ingress-canary-jfw94"
Jul 28 20:25:59.307929 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.307911    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:25:59.307929 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.307920    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:25:59.308029 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.307924    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:25:59.310607 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.310588    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 20:25:59.310737 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.310723    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 20:25:59.310737 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.310729    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9c5p9\""
Jul 28 20:25:59.310862 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.310846    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 20:25:59.310904 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.310850    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 20:25:59.310904 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.310854    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sn8zg\""
Jul 28 20:25:59.387970 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.387948    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bc5bd36-13ec-423b-aa68-678576b19935-metrics-tls\") pod \"dns-default-sqfxj\" (UID: \"4bc5bd36-13ec-423b-aa68-678576b19935\") " pod="openshift-dns/dns-default-sqfxj"
Jul 28 20:25:59.388053 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.387975    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bc5bd36-13ec-423b-aa68-678576b19935-tmp-dir\") pod \"dns-default-sqfxj\" (UID: \"4bc5bd36-13ec-423b-aa68-678576b19935\") " pod="openshift-dns/dns-default-sqfxj"
Jul 28 20:25:59.388053 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.388018    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc92053b-0c0e-42f3-988f-4e3b612e8d4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mcb5x\" (UID: \"cc92053b-0c0e-42f3-988f-4e3b612e8d4a\") " pod="openshift-insights/insights-runtime-extractor-mcb5x"
Jul 28 20:25:59.388053 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.388041    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc92053b-0c0e-42f3-988f-4e3b612e8d4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mcb5x\" (UID: \"cc92053b-0c0e-42f3-988f-4e3b612e8d4a\") " pod="openshift-insights/insights-runtime-extractor-mcb5x"
Jul 28 20:25:59.388170 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.388056    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4swp\" (UniqueName: \"kubernetes.io/projected/cc92053b-0c0e-42f3-988f-4e3b612e8d4a-kube-api-access-k4swp\") pod \"insights-runtime-extractor-mcb5x\" (UID: \"cc92053b-0c0e-42f3-988f-4e3b612e8d4a\") " pod="openshift-insights/insights-runtime-extractor-mcb5x"
Jul 28 20:25:59.388170 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.388083    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4bc5bd36-13ec-423b-aa68-678576b19935-config-volume\") pod \"dns-default-sqfxj\" (UID: \"4bc5bd36-13ec-423b-aa68-678576b19935\") " pod="openshift-dns/dns-default-sqfxj"
Jul 28 20:25:59.388170 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.388101    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc92053b-0c0e-42f3-988f-4e3b612e8d4a-data-volume\") pod \"insights-runtime-extractor-mcb5x\" (UID: \"cc92053b-0c0e-42f3-988f-4e3b612e8d4a\") " pod="openshift-insights/insights-runtime-extractor-mcb5x"
Jul 28 20:25:59.388267 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.388115    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jwj2\" (UniqueName: \"kubernetes.io/projected/4bc5bd36-13ec-423b-aa68-678576b19935-kube-api-access-2jwj2\") pod \"dns-default-sqfxj\" (UID: \"4bc5bd36-13ec-423b-aa68-678576b19935\") " pod="openshift-dns/dns-default-sqfxj"
Jul 28 20:25:59.390723 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.388602    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cc92053b-0c0e-42f3-988f-4e3b612e8d4a-crio-socket\") pod \"insights-runtime-extractor-mcb5x\" (UID: \"cc92053b-0c0e-42f3-988f-4e3b612e8d4a\") " pod="openshift-insights/insights-runtime-extractor-mcb5x"
Jul 28 20:25:59.390723 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.388742    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bc5bd36-13ec-423b-aa68-678576b19935-tmp-dir\") pod \"dns-default-sqfxj\" (UID: \"4bc5bd36-13ec-423b-aa68-678576b19935\") " pod="openshift-dns/dns-default-sqfxj"
Jul 28 20:25:59.390723 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.388829    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cc92053b-0c0e-42f3-988f-4e3b612e8d4a-crio-socket\") pod \"insights-runtime-extractor-mcb5x\" (UID: \"cc92053b-0c0e-42f3-988f-4e3b612e8d4a\") " pod="openshift-insights/insights-runtime-extractor-mcb5x"
Jul 28 20:25:59.390723 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.388876    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc92053b-0c0e-42f3-988f-4e3b612e8d4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mcb5x\" (UID: \"cc92053b-0c0e-42f3-988f-4e3b612e8d4a\") " pod="openshift-insights/insights-runtime-extractor-mcb5x"
Jul 28 20:25:59.390723 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.389054    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4bc5bd36-13ec-423b-aa68-678576b19935-config-volume\") pod \"dns-default-sqfxj\" (UID: \"4bc5bd36-13ec-423b-aa68-678576b19935\") " pod="openshift-dns/dns-default-sqfxj"
Jul 28 20:25:59.390723 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.389728    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc92053b-0c0e-42f3-988f-4e3b612e8d4a-data-volume\") pod \"insights-runtime-extractor-mcb5x\" (UID: \"cc92053b-0c0e-42f3-988f-4e3b612e8d4a\") " pod="openshift-insights/insights-runtime-extractor-mcb5x"
Jul 28 20:25:59.391030 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.391012    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc92053b-0c0e-42f3-988f-4e3b612e8d4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mcb5x\" (UID: \"cc92053b-0c0e-42f3-988f-4e3b612e8d4a\") " pod="openshift-insights/insights-runtime-extractor-mcb5x"
Jul 28 20:25:59.391491 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.391463    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bc5bd36-13ec-423b-aa68-678576b19935-metrics-tls\") pod \"dns-default-sqfxj\" (UID: \"4bc5bd36-13ec-423b-aa68-678576b19935\") " pod="openshift-dns/dns-default-sqfxj"
Jul 28 20:25:59.397393 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.397368    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jwj2\" (UniqueName: \"kubernetes.io/projected/4bc5bd36-13ec-423b-aa68-678576b19935-kube-api-access-2jwj2\") pod \"dns-default-sqfxj\" (UID: \"4bc5bd36-13ec-423b-aa68-678576b19935\") " pod="openshift-dns/dns-default-sqfxj"
Jul 28 20:25:59.397627 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.397610    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4swp\" (UniqueName: \"kubernetes.io/projected/cc92053b-0c0e-42f3-988f-4e3b612e8d4a-kube-api-access-k4swp\") pod \"insights-runtime-extractor-mcb5x\" (UID: \"cc92053b-0c0e-42f3-988f-4e3b612e8d4a\") " pod="openshift-insights/insights-runtime-extractor-mcb5x"
Jul 28 20:25:59.477598 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.477540    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jfw94"
Jul 28 20:25:59.499931 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.499912    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mcb5x"
Jul 28 20:25:59.522624 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.522598    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sqfxj"
Jul 28 20:25:59.698339 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.698307    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sqfxj"]
Jul 28 20:25:59.699719 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.699695    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jfw94"]
Jul 28 20:25:59.702447 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:59.702421    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bc5bd36_13ec_423b_aa68_678576b19935.slice/crio-b239de1530fa1c438bf372017d18f0480ebefc4351f7c5d3bcfb65265ee54dfa WatchSource:0}: Error finding container b239de1530fa1c438bf372017d18f0480ebefc4351f7c5d3bcfb65265ee54dfa: Status 404 returned error can't find the container with id b239de1530fa1c438bf372017d18f0480ebefc4351f7c5d3bcfb65265ee54dfa
Jul 28 20:25:59.702636 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:59.702625    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4763f7ae_9a72_4b99_8cca_2560cb34a4ba.slice/crio-947435db23619307bd098c71289498551a82bab825d5c54eab7cb4568f5d320a WatchSource:0}: Error finding container 947435db23619307bd098c71289498551a82bab825d5c54eab7cb4568f5d320a: Status 404 returned error can't find the container with id 947435db23619307bd098c71289498551a82bab825d5c54eab7cb4568f5d320a
Jul 28 20:25:59.706890 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:25:59.706868    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mcb5x"]
Jul 28 20:25:59.709553 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:25:59.709533    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc92053b_0c0e_42f3_988f_4e3b612e8d4a.slice/crio-3993b67c9a5791aaeb39f6b4653e203998673cb5a7e4e47fd875296ff4572b51 WatchSource:0}: Error finding container 3993b67c9a5791aaeb39f6b4653e203998673cb5a7e4e47fd875296ff4572b51: Status 404 returned error can't find the container with id 3993b67c9a5791aaeb39f6b4653e203998673cb5a7e4e47fd875296ff4572b51
Jul 28 20:26:00.515361 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:00.515001    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sqfxj" event={"ID":"4bc5bd36-13ec-423b-aa68-678576b19935","Type":"ContainerStarted","Data":"b239de1530fa1c438bf372017d18f0480ebefc4351f7c5d3bcfb65265ee54dfa"}
Jul 28 20:26:00.517273 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:00.517188    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jfw94" event={"ID":"4763f7ae-9a72-4b99-8cca-2560cb34a4ba","Type":"ContainerStarted","Data":"947435db23619307bd098c71289498551a82bab825d5c54eab7cb4568f5d320a"}
Jul 28 20:26:00.520819 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:00.520790    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mcb5x" event={"ID":"cc92053b-0c0e-42f3-988f-4e3b612e8d4a","Type":"ContainerStarted","Data":"3993b67c9a5791aaeb39f6b4653e203998673cb5a7e4e47fd875296ff4572b51"}
Jul 28 20:26:06.537424 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:06.537231    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mcb5x" event={"ID":"cc92053b-0c0e-42f3-988f-4e3b612e8d4a","Type":"ContainerStarted","Data":"e9bcf1a77a235181cd4c91a1eafeeb220c69c712976b529896f84138033451f0"}
Jul 28 20:26:06.538931 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:06.538908    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sqfxj" event={"ID":"4bc5bd36-13ec-423b-aa68-678576b19935","Type":"ContainerStarted","Data":"fb01f8d726e1b18d5cf5974e3c5d60bbd5b7dac4a07f32fb37b79f38390acdbd"}
Jul 28 20:26:06.539025 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:06.538949    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sqfxj" event={"ID":"4bc5bd36-13ec-423b-aa68-678576b19935","Type":"ContainerStarted","Data":"7054571b0bbac9efd673f1ed2644472b57fc344c1be41748a922bff1c606da12"}
Jul 28 20:26:06.539086 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:06.539028    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sqfxj"
Jul 28 20:26:06.540457 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:06.540437    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jfw94" event={"ID":"4763f7ae-9a72-4b99-8cca-2560cb34a4ba","Type":"ContainerStarted","Data":"177d2c2d6dc52afa3408e6260b722f74f518f222e63218249a92e349d1ce250f"}
Jul 28 20:26:06.557367 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:06.557299    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sqfxj" podStartSLOduration=5.152368621 podStartE2EDuration="7.557284s" totalImagesPullingTime="2.404915379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:06.556881501 +0000 UTC m=+50.776270380" watchObservedRunningTime="2026-07-28 20:26:06.557284 +0000 UTC m=+50.776672885"
Jul 28 20:26:06.574038 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:06.574002    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jfw94" podStartSLOduration=1.102615052 podStartE2EDuration="7.573990443s" totalImagesPullingTime="6.471375391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:06.573119654 +0000 UTC m=+50.792508538" watchObservedRunningTime="2026-07-28 20:26:06.573990443 +0000 UTC m=+50.793379305"
Jul 28 20:26:09.042137 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:09.042107    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tdc8t"]
Jul 28 20:26:09.123454 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:09.123425    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tdc8t"]
Jul 28 20:26:09.123617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:09.123513    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tdc8t"
Jul 28 20:26:09.129050 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:09.127521    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 28 20:26:09.129050 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:09.127778    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-67grv\""
Jul 28 20:26:09.165184 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:09.165151    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9bce3dda-9996-47be-b976-f1e5e91d5e00-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-tdc8t\" (UID: \"9bce3dda-9996-47be-b976-f1e5e91d5e00\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tdc8t"
Jul 28 20:26:09.265921 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:09.265890    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9bce3dda-9996-47be-b976-f1e5e91d5e00-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-tdc8t\" (UID: \"9bce3dda-9996-47be-b976-f1e5e91d5e00\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tdc8t"
Jul 28 20:26:09.270630 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:09.270587    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9bce3dda-9996-47be-b976-f1e5e91d5e00-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-tdc8t\" (UID: \"9bce3dda-9996-47be-b976-f1e5e91d5e00\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tdc8t"
Jul 28 20:26:09.436739 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:09.436666    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tdc8t"
Jul 28 20:26:10.405318 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:10.405170    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tdc8t"]
Jul 28 20:26:10.416369 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:26:10.416334    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bce3dda_9996_47be_b976_f1e5e91d5e00.slice/crio-8bde34c413017632ddb5e7d3afe1f5061a50f95c45418e3fa68287cc6bf15ffb WatchSource:0}: Error finding container 8bde34c413017632ddb5e7d3afe1f5061a50f95c45418e3fa68287cc6bf15ffb: Status 404 returned error can't find the container with id 8bde34c413017632ddb5e7d3afe1f5061a50f95c45418e3fa68287cc6bf15ffb
Jul 28 20:26:10.551998 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:10.551882    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mcb5x" event={"ID":"cc92053b-0c0e-42f3-988f-4e3b612e8d4a","Type":"ContainerStarted","Data":"15aa370ef507e87be3048cea0aff7e8f310c2a235daf52bf31de7e42be325da5"}
Jul 28 20:26:10.552961 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:10.552933    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tdc8t" event={"ID":"9bce3dda-9996-47be-b976-f1e5e91d5e00","Type":"ContainerStarted","Data":"8bde34c413017632ddb5e7d3afe1f5061a50f95c45418e3fa68287cc6bf15ffb"}
Jul 28 20:26:11.558683 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:11.558658    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tdc8t" event={"ID":"9bce3dda-9996-47be-b976-f1e5e91d5e00","Type":"ContainerStarted","Data":"07d85b919ccd8eb73507932d469d2dd34529b5d3f4922b130e8e0e8dbeb1d70c"}
Jul 28 20:26:12.562030 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:12.561999    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tdc8t"
Jul 28 20:26:12.567382 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:12.567336    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tdc8t"
Jul 28 20:26:12.581322 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:12.581270    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tdc8t" podStartSLOduration=2.508907675 podStartE2EDuration="3.581250839s" totalImagesPullingTime="1.072343164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:26:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:12.581010564 +0000 UTC m=+56.800399452" watchObservedRunningTime="2026-07-28 20:26:12.581250839 +0000 UTC m=+56.800639723"
Jul 28 20:26:13.099819 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:13.099790    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-lgrjh"]
Jul 28 20:26:13.109307 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:13.109284    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-lgrjh"
Jul 28 20:26:13.113627 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:13.113548    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 28 20:26:13.113627 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:13.113619    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 20:26:13.113830 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:13.113705    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 20:26:13.113946 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:13.113927    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 20:26:13.113982 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:13.113955    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pz6cd\""
Jul 28 20:26:13.114017 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:13.113932    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 28 20:26:13.114802 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:13.114782    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-lgrjh"]
Jul 28 20:26:13.196647 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:13.196607    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm4vp\" (UniqueName: \"kubernetes.io/projected/94fe3867-767d-4ec5-884d-4ec1a95ed009-kube-api-access-tm4vp\") pod \"prometheus-operator-84d69f794d-lgrjh\" (UID: \"94fe3867-767d-4ec5-884d-4ec1a95ed009\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lgrjh"
Jul 28 20:26:13.196647 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:13.196653    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94fe3867-767d-4ec5-884d-4ec1a95ed009-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-lgrjh\" (UID: \"94fe3867-767d-4ec5-884d-4ec1a95ed009\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lgrjh"
Jul 28 20:26:13.196836 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:13.196679    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/94fe3867-767d-4ec5-884d-4ec1a95ed009-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-lgrjh\" (UID: \"94fe3867-767d-4ec5-884d-4ec1a95ed009\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lgrjh"
Jul 28 20:26:13.196836 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:13.196800    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94fe3867-767d-4ec5-884d-4ec1a95ed009-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-lgrjh\" (UID: \"94fe3867-767d-4ec5-884d-4ec1a95ed009\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lgrjh"
Jul 28 20:26:13.297121 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:13.297090    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm4vp\" (UniqueName: \"kubernetes.io/projected/94fe3867-767d-4ec5-884d-4ec1a95ed009-kube-api-access-tm4vp\") pod \"prometheus-operator-84d69f794d-lgrjh\" (UID: \"94fe3867-767d-4ec5-884d-4ec1a95ed009\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lgrjh"
Jul 28 20:26:13.297121 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:13.297127    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94fe3867-767d-4ec5-884d-4ec1a95ed009-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-lgrjh\" (UID: \"94fe3867-767d-4ec5-884d-4ec1a95ed009\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lgrjh"
Jul 28 20:26:13.297358 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:13.297157    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/94fe3867-767d-4ec5-884d-4ec1a95ed009-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-lgrjh\" (UID: \"94fe3867-767d-4ec5-884d-4ec1a95ed009\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lgrjh"
Jul 28 20:26:13.297358 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:13.297229    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94fe3867-767d-4ec5-884d-4ec1a95ed009-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-lgrjh\" (UID: \"94fe3867-767d-4ec5-884d-4ec1a95ed009\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lgrjh"
Jul 28 20:26:13.297863 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:13.297835    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94fe3867-767d-4ec5-884d-4ec1a95ed009-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-lgrjh\" (UID: \"94fe3867-767d-4ec5-884d-4ec1a95ed009\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lgrjh"
Jul 28 20:26:13.301059 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:13.301035    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94fe3867-767d-4ec5-884d-4ec1a95ed009-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-lgrjh\" (UID: \"94fe3867-767d-4ec5-884d-4ec1a95ed009\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lgrjh"
Jul 28 20:26:13.301059 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:13.301050    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/94fe3867-767d-4ec5-884d-4ec1a95ed009-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-lgrjh\" (UID: \"94fe3867-767d-4ec5-884d-4ec1a95ed009\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lgrjh"
Jul 28 20:26:13.306248 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:13.306227    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm4vp\" (UniqueName: \"kubernetes.io/projected/94fe3867-767d-4ec5-884d-4ec1a95ed009-kube-api-access-tm4vp\") pod \"prometheus-operator-84d69f794d-lgrjh\" (UID: \"94fe3867-767d-4ec5-884d-4ec1a95ed009\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-lgrjh"
Jul 28 20:26:13.423711 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:13.423636    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-lgrjh"
Jul 28 20:26:13.996953 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:13.996927    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-lgrjh"]
Jul 28 20:26:14.000075 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:26:14.000051    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94fe3867_767d_4ec5_884d_4ec1a95ed009.slice/crio-134fc6f5cbfd5508786d37d76726a06e198960aeb84f9e733473447c2b05abc4 WatchSource:0}: Error finding container 134fc6f5cbfd5508786d37d76726a06e198960aeb84f9e733473447c2b05abc4: Status 404 returned error can't find the container with id 134fc6f5cbfd5508786d37d76726a06e198960aeb84f9e733473447c2b05abc4
Jul 28 20:26:14.573222 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:14.573192    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mcb5x" event={"ID":"cc92053b-0c0e-42f3-988f-4e3b612e8d4a","Type":"ContainerStarted","Data":"11dbe80557fea8d601607b2abf768c2633a70cb03b168e2698b99f761e722ce5"}
Jul 28 20:26:14.574220 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:14.574197    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-lgrjh" event={"ID":"94fe3867-767d-4ec5-884d-4ec1a95ed009","Type":"ContainerStarted","Data":"134fc6f5cbfd5508786d37d76726a06e198960aeb84f9e733473447c2b05abc4"}
Jul 28 20:26:14.589938 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:14.589898    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mcb5x" podStartSLOduration=1.556367999 podStartE2EDuration="15.589886463s" totalImagesPullingTime="14.033518464s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:25:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:14.589538548 +0000 UTC m=+58.808927434" watchObservedRunningTime="2026-07-28 20:26:14.589886463 +0000 UTC m=+58.809275350"
Jul 28 20:26:15.580905 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:15.580826    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-lgrjh" event={"ID":"94fe3867-767d-4ec5-884d-4ec1a95ed009","Type":"ContainerStarted","Data":"1e4e5c6f8baf41b269a68f69312e6e34de19b03568a5ba5bc8bf97aa266b32ad"}
Jul 28 20:26:15.580905 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:15.580877    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-lgrjh" event={"ID":"94fe3867-767d-4ec5-884d-4ec1a95ed009","Type":"ContainerStarted","Data":"02493c452c2490923f675b41acddcd9fc8c64b11dcbe104aeeea8ecb5501d64c"}
Jul 28 20:26:15.601456 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:15.601376    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-lgrjh" podStartSLOduration=1.302121436 podStartE2EDuration="2.601335061s" totalImagesPullingTime="1.299213625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:26:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:15.601127729 +0000 UTC m=+59.820516613" watchObservedRunningTime="2026-07-28 20:26:15.601335061 +0000 UTC m=+59.820723946"
Jul 28 20:26:16.483397 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:16.483369    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gt2x6"
Jul 28 20:26:16.545392 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:16.545365    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sqfxj"
Jul 28 20:26:17.483619 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.483583    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-f6grl"]
Jul 28 20:26:17.486709 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.486686    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f6grl"
Jul 28 20:26:17.489242 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.489213    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 28 20:26:17.489387 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.489273    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-msjs6\""
Jul 28 20:26:17.489445 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.489416    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 28 20:26:17.504726 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.504693    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-f6grl"]
Jul 28 20:26:17.523656 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.523625    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2nn72"]
Jul 28 20:26:17.527242 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.526628    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:17.530468 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.530445    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa1dc898-d392-4ddc-bd75-99a262d99768-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-f6grl\" (UID: \"aa1dc898-d392-4ddc-bd75-99a262d99768\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f6grl"
Jul 28 20:26:17.530592 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.530478    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rzq2\" (UniqueName: \"kubernetes.io/projected/aa1dc898-d392-4ddc-bd75-99a262d99768-kube-api-access-5rzq2\") pod \"openshift-state-metrics-b8f49f5c6-f6grl\" (UID: \"aa1dc898-d392-4ddc-bd75-99a262d99768\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f6grl"
Jul 28 20:26:17.530592 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.530531    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa1dc898-d392-4ddc-bd75-99a262d99768-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-f6grl\" (UID: \"aa1dc898-d392-4ddc-bd75-99a262d99768\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f6grl"
Jul 28 20:26:17.530685 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.530645    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa1dc898-d392-4ddc-bd75-99a262d99768-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-f6grl\" (UID: \"aa1dc898-d392-4ddc-bd75-99a262d99768\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f6grl"
Jul 28 20:26:17.531212 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.531191    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 20:26:17.531297 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.531255    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 20:26:17.531582 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.531534    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 20:26:17.533447 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.533420    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ml6l9\""
Jul 28 20:26:17.631445 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.631403    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkm8c\" (UniqueName: \"kubernetes.io/projected/0b969541-d385-4066-8ee1-828c8d0061a9-kube-api-access-jkm8c\") pod \"node-exporter-2nn72\" (UID: \"0b969541-d385-4066-8ee1-828c8d0061a9\") " pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:17.631445 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.631449    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0b969541-d385-4066-8ee1-828c8d0061a9-node-exporter-accelerators-collector-config\") pod \"node-exporter-2nn72\" (UID: \"0b969541-d385-4066-8ee1-828c8d0061a9\") " pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:17.631677 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.631475    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa1dc898-d392-4ddc-bd75-99a262d99768-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-f6grl\" (UID: \"aa1dc898-d392-4ddc-bd75-99a262d99768\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f6grl"
Jul 28 20:26:17.631677 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.631495    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b969541-d385-4066-8ee1-828c8d0061a9-sys\") pod \"node-exporter-2nn72\" (UID: \"0b969541-d385-4066-8ee1-828c8d0061a9\") " pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:17.631677 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.631560    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0b969541-d385-4066-8ee1-828c8d0061a9-node-exporter-textfile\") pod \"node-exporter-2nn72\" (UID: \"0b969541-d385-4066-8ee1-828c8d0061a9\") " pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:17.631677 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:26:17.631611    2556 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 28 20:26:17.631677 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.631625    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rzq2\" (UniqueName: \"kubernetes.io/projected/aa1dc898-d392-4ddc-bd75-99a262d99768-kube-api-access-5rzq2\") pod \"openshift-state-metrics-b8f49f5c6-f6grl\" (UID: \"aa1dc898-d392-4ddc-bd75-99a262d99768\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f6grl"
Jul 28 20:26:17.631677 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.631660    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa1dc898-d392-4ddc-bd75-99a262d99768-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-f6grl\" (UID: \"aa1dc898-d392-4ddc-bd75-99a262d99768\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f6grl"
Jul 28 20:26:17.631677 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:26:17.631672    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa1dc898-d392-4ddc-bd75-99a262d99768-openshift-state-metrics-tls podName:aa1dc898-d392-4ddc-bd75-99a262d99768 nodeName:}" failed. No retries permitted until 2026-07-28 20:26:18.131655969 +0000 UTC m=+62.351044833 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/aa1dc898-d392-4ddc-bd75-99a262d99768-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-f6grl" (UID: "aa1dc898-d392-4ddc-bd75-99a262d99768") : secret "openshift-state-metrics-tls" not found
Jul 28 20:26:17.631978 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.631702    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0b969541-d385-4066-8ee1-828c8d0061a9-node-exporter-wtmp\") pod \"node-exporter-2nn72\" (UID: \"0b969541-d385-4066-8ee1-828c8d0061a9\") " pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:17.631978 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.631725    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa1dc898-d392-4ddc-bd75-99a262d99768-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-f6grl\" (UID: \"aa1dc898-d392-4ddc-bd75-99a262d99768\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f6grl"
Jul 28 20:26:17.631978 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.631770    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b969541-d385-4066-8ee1-828c8d0061a9-metrics-client-ca\") pod \"node-exporter-2nn72\" (UID: \"0b969541-d385-4066-8ee1-828c8d0061a9\") " pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:17.631978 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.631787    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b969541-d385-4066-8ee1-828c8d0061a9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2nn72\" (UID: \"0b969541-d385-4066-8ee1-828c8d0061a9\") " pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:17.631978 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.631805    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0b969541-d385-4066-8ee1-828c8d0061a9-node-exporter-tls\") pod \"node-exporter-2nn72\" (UID: \"0b969541-d385-4066-8ee1-828c8d0061a9\") " pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:17.631978 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.631912    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0b969541-d385-4066-8ee1-828c8d0061a9-root\") pod \"node-exporter-2nn72\" (UID: \"0b969541-d385-4066-8ee1-828c8d0061a9\") " pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:17.632407 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.632390    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa1dc898-d392-4ddc-bd75-99a262d99768-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-f6grl\" (UID: \"aa1dc898-d392-4ddc-bd75-99a262d99768\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f6grl"
Jul 28 20:26:17.633985 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.633963    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa1dc898-d392-4ddc-bd75-99a262d99768-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-f6grl\" (UID: \"aa1dc898-d392-4ddc-bd75-99a262d99768\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f6grl"
Jul 28 20:26:17.644672 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.644644    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rzq2\" (UniqueName: \"kubernetes.io/projected/aa1dc898-d392-4ddc-bd75-99a262d99768-kube-api-access-5rzq2\") pod \"openshift-state-metrics-b8f49f5c6-f6grl\" (UID: \"aa1dc898-d392-4ddc-bd75-99a262d99768\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f6grl"
Jul 28 20:26:17.732942 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.732909    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0b969541-d385-4066-8ee1-828c8d0061a9-node-exporter-wtmp\") pod \"node-exporter-2nn72\" (UID: \"0b969541-d385-4066-8ee1-828c8d0061a9\") " pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:17.732942 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.732944    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b969541-d385-4066-8ee1-828c8d0061a9-metrics-client-ca\") pod \"node-exporter-2nn72\" (UID: \"0b969541-d385-4066-8ee1-828c8d0061a9\") " pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:17.733172 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.732960    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b969541-d385-4066-8ee1-828c8d0061a9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2nn72\" (UID: \"0b969541-d385-4066-8ee1-828c8d0061a9\") " pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:17.733172 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.732986    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0b969541-d385-4066-8ee1-828c8d0061a9-node-exporter-tls\") pod \"node-exporter-2nn72\" (UID: \"0b969541-d385-4066-8ee1-828c8d0061a9\") " pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:17.733172 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.733024    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0b969541-d385-4066-8ee1-828c8d0061a9-root\") pod \"node-exporter-2nn72\" (UID: \"0b969541-d385-4066-8ee1-828c8d0061a9\") " pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:17.733172 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.733049    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkm8c\" (UniqueName: \"kubernetes.io/projected/0b969541-d385-4066-8ee1-828c8d0061a9-kube-api-access-jkm8c\") pod \"node-exporter-2nn72\" (UID: \"0b969541-d385-4066-8ee1-828c8d0061a9\") " pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:17.733172 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.733076    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0b969541-d385-4066-8ee1-828c8d0061a9-node-exporter-wtmp\") pod \"node-exporter-2nn72\" (UID: \"0b969541-d385-4066-8ee1-828c8d0061a9\") " pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:17.733172 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.733079    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0b969541-d385-4066-8ee1-828c8d0061a9-node-exporter-accelerators-collector-config\") pod \"node-exporter-2nn72\" (UID: \"0b969541-d385-4066-8ee1-828c8d0061a9\") " pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:17.733172 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.733128    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0b969541-d385-4066-8ee1-828c8d0061a9-root\") pod \"node-exporter-2nn72\" (UID: \"0b969541-d385-4066-8ee1-828c8d0061a9\") " pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:17.733172 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:26:17.733144    2556 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 28 20:26:17.733172 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.733156    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b969541-d385-4066-8ee1-828c8d0061a9-sys\") pod \"node-exporter-2nn72\" (UID: \"0b969541-d385-4066-8ee1-828c8d0061a9\") " pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:17.733655 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.733214    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b969541-d385-4066-8ee1-828c8d0061a9-sys\") pod \"node-exporter-2nn72\" (UID: \"0b969541-d385-4066-8ee1-828c8d0061a9\") " pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:17.733655 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:26:17.733226    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b969541-d385-4066-8ee1-828c8d0061a9-node-exporter-tls podName:0b969541-d385-4066-8ee1-828c8d0061a9 nodeName:}" failed. No retries permitted until 2026-07-28 20:26:18.233186779 +0000 UTC m=+62.452575660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0b969541-d385-4066-8ee1-828c8d0061a9-node-exporter-tls") pod "node-exporter-2nn72" (UID: "0b969541-d385-4066-8ee1-828c8d0061a9") : secret "node-exporter-tls" not found
Jul 28 20:26:17.733655 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.733256    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0b969541-d385-4066-8ee1-828c8d0061a9-node-exporter-textfile\") pod \"node-exporter-2nn72\" (UID: \"0b969541-d385-4066-8ee1-828c8d0061a9\") " pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:17.733655 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.733542    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0b969541-d385-4066-8ee1-828c8d0061a9-node-exporter-textfile\") pod \"node-exporter-2nn72\" (UID: \"0b969541-d385-4066-8ee1-828c8d0061a9\") " pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:17.733655 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.733607    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b969541-d385-4066-8ee1-828c8d0061a9-metrics-client-ca\") pod \"node-exporter-2nn72\" (UID: \"0b969541-d385-4066-8ee1-828c8d0061a9\") " pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:17.733655 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.733621    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0b969541-d385-4066-8ee1-828c8d0061a9-node-exporter-accelerators-collector-config\") pod \"node-exporter-2nn72\" (UID: \"0b969541-d385-4066-8ee1-828c8d0061a9\") " pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:17.735410 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.735393    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b969541-d385-4066-8ee1-828c8d0061a9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2nn72\" (UID: \"0b969541-d385-4066-8ee1-828c8d0061a9\") " pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:17.749062 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:17.749029    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkm8c\" (UniqueName: \"kubernetes.io/projected/0b969541-d385-4066-8ee1-828c8d0061a9-kube-api-access-jkm8c\") pod \"node-exporter-2nn72\" (UID: \"0b969541-d385-4066-8ee1-828c8d0061a9\") " pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:18.136367 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.136313    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa1dc898-d392-4ddc-bd75-99a262d99768-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-f6grl\" (UID: \"aa1dc898-d392-4ddc-bd75-99a262d99768\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f6grl"
Jul 28 20:26:18.138637 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.138612    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa1dc898-d392-4ddc-bd75-99a262d99768-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-f6grl\" (UID: \"aa1dc898-d392-4ddc-bd75-99a262d99768\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f6grl"
Jul 28 20:26:18.237598 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.237561    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0b969541-d385-4066-8ee1-828c8d0061a9-node-exporter-tls\") pod \"node-exporter-2nn72\" (UID: \"0b969541-d385-4066-8ee1-828c8d0061a9\") " pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:18.239796 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.239778    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0b969541-d385-4066-8ee1-828c8d0061a9-node-exporter-tls\") pod \"node-exporter-2nn72\" (UID: \"0b969541-d385-4066-8ee1-828c8d0061a9\") " pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:18.395396 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.395298    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f6grl"
Jul 28 20:26:18.436749 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.436709    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2nn72"
Jul 28 20:26:18.447575 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:26:18.447535    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b969541_d385_4066_8ee1_828c8d0061a9.slice/crio-45efb51767f25674b9df11f3446395096bc9e5829093bdcc52a4dfdfc4ac828e WatchSource:0}: Error finding container 45efb51767f25674b9df11f3446395096bc9e5829093bdcc52a4dfdfc4ac828e: Status 404 returned error can't find the container with id 45efb51767f25674b9df11f3446395096bc9e5829093bdcc52a4dfdfc4ac828e
Jul 28 20:26:18.526708 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.526677    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-f6grl"]
Jul 28 20:26:18.529537 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:26:18.529507    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa1dc898_d392_4ddc_bd75_99a262d99768.slice/crio-374a928ea9a21d8d0da5af38c95354461182b4ca1af594dd36d92ff276f15ed4 WatchSource:0}: Error finding container 374a928ea9a21d8d0da5af38c95354461182b4ca1af594dd36d92ff276f15ed4: Status 404 returned error can't find the container with id 374a928ea9a21d8d0da5af38c95354461182b4ca1af594dd36d92ff276f15ed4
Jul 28 20:26:18.541426 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.541403    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 20:26:18.544443 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.544413    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.547112 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.547084    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 28 20:26:18.547223 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.547109    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 28 20:26:18.547223 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.547109    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 28 20:26:18.547518 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.547495    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 28 20:26:18.547635 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.547522    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 28 20:26:18.547635 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.547572    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 28 20:26:18.547635 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.547581    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 28 20:26:18.547857 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.547526    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tr4kz\""
Jul 28 20:26:18.547857 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.547572    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 28 20:26:18.548324 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.548304    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 28 20:26:18.562997 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.562975    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 20:26:18.593439 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.593408    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f6grl" event={"ID":"aa1dc898-d392-4ddc-bd75-99a262d99768","Type":"ContainerStarted","Data":"374a928ea9a21d8d0da5af38c95354461182b4ca1af594dd36d92ff276f15ed4"}
Jul 28 20:26:18.594617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.594591    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2nn72" event={"ID":"0b969541-d385-4066-8ee1-828c8d0061a9","Type":"ContainerStarted","Data":"45efb51767f25674b9df11f3446395096bc9e5829093bdcc52a4dfdfc4ac828e"}
Jul 28 20:26:18.639997 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.639964    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba3b98f6-76d6-45ea-9f20-477d846b277a-config-out\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.640153 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.640046    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ba3b98f6-76d6-45ea-9f20-477d846b277a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.640153 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.640093    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba3b98f6-76d6-45ea-9f20-477d846b277a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.640265 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.640158    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba3b98f6-76d6-45ea-9f20-477d846b277a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.640265 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.640175    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba3b98f6-76d6-45ea-9f20-477d846b277a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.640265 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.640197    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smnb8\" (UniqueName: \"kubernetes.io/projected/ba3b98f6-76d6-45ea-9f20-477d846b277a-kube-api-access-smnb8\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.640265 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.640216    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba3b98f6-76d6-45ea-9f20-477d846b277a-web-config\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.640504 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.640277    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ba3b98f6-76d6-45ea-9f20-477d846b277a-config-volume\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.640504 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.640330    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ba3b98f6-76d6-45ea-9f20-477d846b277a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.640504 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.640367    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba3b98f6-76d6-45ea-9f20-477d846b277a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.640504 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.640390    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ba3b98f6-76d6-45ea-9f20-477d846b277a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.640504 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.640419    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba3b98f6-76d6-45ea-9f20-477d846b277a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.640504 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.640436    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ba3b98f6-76d6-45ea-9f20-477d846b277a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.741357 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.741322    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ba3b98f6-76d6-45ea-9f20-477d846b277a-config-volume\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.741510 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.741366    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ba3b98f6-76d6-45ea-9f20-477d846b277a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.741510 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.741386    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba3b98f6-76d6-45ea-9f20-477d846b277a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.741510 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.741407    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ba3b98f6-76d6-45ea-9f20-477d846b277a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.741510 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.741441    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba3b98f6-76d6-45ea-9f20-477d846b277a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.741510 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.741463    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ba3b98f6-76d6-45ea-9f20-477d846b277a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.741510 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.741497    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba3b98f6-76d6-45ea-9f20-477d846b277a-config-out\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.741804 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.741558    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ba3b98f6-76d6-45ea-9f20-477d846b277a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.741804 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.741594    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba3b98f6-76d6-45ea-9f20-477d846b277a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.741804 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.741662    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba3b98f6-76d6-45ea-9f20-477d846b277a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.741804 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.741689    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba3b98f6-76d6-45ea-9f20-477d846b277a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.741804 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.741717    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smnb8\" (UniqueName: \"kubernetes.io/projected/ba3b98f6-76d6-45ea-9f20-477d846b277a-kube-api-access-smnb8\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.741804 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.741746    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba3b98f6-76d6-45ea-9f20-477d846b277a-web-config\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.742085 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.741970    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ba3b98f6-76d6-45ea-9f20-477d846b277a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.742662 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.742245    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba3b98f6-76d6-45ea-9f20-477d846b277a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.743602 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.743571    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba3b98f6-76d6-45ea-9f20-477d846b277a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.744479 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.744457    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba3b98f6-76d6-45ea-9f20-477d846b277a-config-out\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.744885 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.744863    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba3b98f6-76d6-45ea-9f20-477d846b277a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.745100 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.745079    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba3b98f6-76d6-45ea-9f20-477d846b277a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.745286 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.745264    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ba3b98f6-76d6-45ea-9f20-477d846b277a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.745380 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.745323    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba3b98f6-76d6-45ea-9f20-477d846b277a-web-config\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.745453 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.745434    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ba3b98f6-76d6-45ea-9f20-477d846b277a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.745702 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.745680    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ba3b98f6-76d6-45ea-9f20-477d846b277a-config-volume\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.745903 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.745886    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba3b98f6-76d6-45ea-9f20-477d846b277a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.747280 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.747261    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ba3b98f6-76d6-45ea-9f20-477d846b277a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.751719 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.751699    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smnb8\" (UniqueName: \"kubernetes.io/projected/ba3b98f6-76d6-45ea-9f20-477d846b277a-kube-api-access-smnb8\") pod \"alertmanager-main-0\" (UID: \"ba3b98f6-76d6-45ea-9f20-477d846b277a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:18.869257 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:18.869222    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 20:26:19.022448 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:19.022410    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 20:26:19.025760 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:26:19.025726    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba3b98f6_76d6_45ea_9f20_477d846b277a.slice/crio-da84f096995cd3af5472b6be4efb5ce4c4fb15237673ff4f8ddc7791b276e796 WatchSource:0}: Error finding container da84f096995cd3af5472b6be4efb5ce4c4fb15237673ff4f8ddc7791b276e796: Status 404 returned error can't find the container with id da84f096995cd3af5472b6be4efb5ce4c4fb15237673ff4f8ddc7791b276e796
Jul 28 20:26:19.599819 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:19.599743    2556 generic.go:356] "Generic (PLEG): container finished" podID="0b969541-d385-4066-8ee1-828c8d0061a9" containerID="0e4a58e9ffd3e7db0501974fe135463242d26714f54396c801f3eb539c990921" exitCode=0
Jul 28 20:26:19.600218 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:19.599826    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2nn72" event={"ID":"0b969541-d385-4066-8ee1-828c8d0061a9","Type":"ContainerDied","Data":"0e4a58e9ffd3e7db0501974fe135463242d26714f54396c801f3eb539c990921"}
Jul 28 20:26:19.601117 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:19.601097    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba3b98f6-76d6-45ea-9f20-477d846b277a","Type":"ContainerStarted","Data":"da84f096995cd3af5472b6be4efb5ce4c4fb15237673ff4f8ddc7791b276e796"}
Jul 28 20:26:19.602635 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:19.602617    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f6grl" event={"ID":"aa1dc898-d392-4ddc-bd75-99a262d99768","Type":"ContainerStarted","Data":"a108c720a49b3fb90a27c30ae9ddc2e37531d3344e7c327b6bbc2bb1baa7e75f"}
Jul 28 20:26:19.602724 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:19.602664    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f6grl" event={"ID":"aa1dc898-d392-4ddc-bd75-99a262d99768","Type":"ContainerStarted","Data":"30cf1f91870e29e3b12ca58b9e08e5aeba8f7facebdf5afbf77f43384d6e9249"}
Jul 28 20:26:20.562065 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.562029    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-668d64b687-bvpl9"]
Jul 28 20:26:20.566003 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.565979    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9"
Jul 28 20:26:20.568540 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.568473    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8dpe14jaa05oj\""
Jul 28 20:26:20.568697 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.568670    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 28 20:26:20.568697 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.568679    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7dj79\""
Jul 28 20:26:20.568944 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.568913    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 28 20:26:20.568944 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.568940    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 28 20:26:20.569049 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.569024    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 28 20:26:20.569417 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.569402    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 28 20:26:20.580776 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.580743    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-668d64b687-bvpl9"]
Jul 28 20:26:20.609264 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.609223    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2nn72" event={"ID":"0b969541-d385-4066-8ee1-828c8d0061a9","Type":"ContainerStarted","Data":"7f1820b2427ac960c2db40fed0d0d1fa2000ccc99d58fbc1756c4d92b12f581d"}
Jul 28 20:26:20.609746 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.609286    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2nn72" event={"ID":"0b969541-d385-4066-8ee1-828c8d0061a9","Type":"ContainerStarted","Data":"dfc3fe8ba615697e68adb79901425c91306c9c5871c6cebcf1ff2c9855bd5c37"}
Jul 28 20:26:20.611591 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.611566    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f6grl" event={"ID":"aa1dc898-d392-4ddc-bd75-99a262d99768","Type":"ContainerStarted","Data":"8ef9ae6a6e626a9f58bd9cc191114be4633ccc5e65ca7c61188b4e8efdc54fcf"}
Jul 28 20:26:20.630069 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.630012    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2nn72" podStartSLOduration=2.716600314 podStartE2EDuration="3.629995393s" totalImagesPullingTime="841.655814ms" totalInitContainerRuntime="71.739265ms" isStatefulPod=true podCreationTimestamp="2026-07-28 20:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:20.628746737 +0000 UTC m=+64.848135691" watchObservedRunningTime="2026-07-28 20:26:20.629995393 +0000 UTC m=+64.849384277"
Jul 28 20:26:20.647298 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.647248    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-f6grl" podStartSLOduration=2.6900533920000003 podStartE2EDuration="3.647228423s" totalImagesPullingTime="957.175031ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:20.645844408 +0000 UTC m=+64.865233293" watchObservedRunningTime="2026-07-28 20:26:20.647228423 +0000 UTC m=+64.866617308"
Jul 28 20:26:20.659364 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.659298    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cdac1ff8-87d8-4d02-97e1-fbf74ea2e163-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-668d64b687-bvpl9\" (UID: \"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163\") " pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9"
Jul 28 20:26:20.659538 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.659494    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cdac1ff8-87d8-4d02-97e1-fbf74ea2e163-secret-thanos-querier-tls\") pod \"thanos-querier-668d64b687-bvpl9\" (UID: \"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163\") " pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9"
Jul 28 20:26:20.659600 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.659533    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cdac1ff8-87d8-4d02-97e1-fbf74ea2e163-secret-grpc-tls\") pod \"thanos-querier-668d64b687-bvpl9\" (UID: \"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163\") " pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9"
Jul 28 20:26:20.659652 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.659604    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7c94\" (UniqueName: \"kubernetes.io/projected/cdac1ff8-87d8-4d02-97e1-fbf74ea2e163-kube-api-access-p7c94\") pod \"thanos-querier-668d64b687-bvpl9\" (UID: \"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163\") " pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9"
Jul 28 20:26:20.659845 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.659816    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cdac1ff8-87d8-4d02-97e1-fbf74ea2e163-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-668d64b687-bvpl9\" (UID: \"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163\") " pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9"
Jul 28 20:26:20.659956 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.659878    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cdac1ff8-87d8-4d02-97e1-fbf74ea2e163-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-668d64b687-bvpl9\" (UID: \"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163\") " pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9"
Jul 28 20:26:20.660013 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.659983    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdac1ff8-87d8-4d02-97e1-fbf74ea2e163-metrics-client-ca\") pod \"thanos-querier-668d64b687-bvpl9\" (UID: \"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163\") " pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9"
Jul 28 20:26:20.660130 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.660110    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cdac1ff8-87d8-4d02-97e1-fbf74ea2e163-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-668d64b687-bvpl9\" (UID: \"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163\") " pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9"
Jul 28 20:26:20.761087 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.761054    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7c94\" (UniqueName: \"kubernetes.io/projected/cdac1ff8-87d8-4d02-97e1-fbf74ea2e163-kube-api-access-p7c94\") pod \"thanos-querier-668d64b687-bvpl9\" (UID: \"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163\") " pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9"
Jul 28 20:26:20.761087 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.761091    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cdac1ff8-87d8-4d02-97e1-fbf74ea2e163-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-668d64b687-bvpl9\" (UID: \"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163\") " pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9"
Jul 28 20:26:20.761520 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.761112    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cdac1ff8-87d8-4d02-97e1-fbf74ea2e163-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-668d64b687-bvpl9\" (UID: \"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163\") " pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9"
Jul 28 20:26:20.761520 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.761154    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdac1ff8-87d8-4d02-97e1-fbf74ea2e163-metrics-client-ca\") pod \"thanos-querier-668d64b687-bvpl9\" (UID: \"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163\") " pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9"
Jul 28 20:26:20.761520 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.761186    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cdac1ff8-87d8-4d02-97e1-fbf74ea2e163-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-668d64b687-bvpl9\" (UID: \"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163\") " pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9"
Jul 28 20:26:20.761520 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.761207    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cdac1ff8-87d8-4d02-97e1-fbf74ea2e163-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-668d64b687-bvpl9\" (UID: \"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163\") " pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9"
Jul 28 20:26:20.761520 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.761237    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cdac1ff8-87d8-4d02-97e1-fbf74ea2e163-secret-thanos-querier-tls\") pod \"thanos-querier-668d64b687-bvpl9\" (UID: \"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163\") " pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9"
Jul 28 20:26:20.761520 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.761371    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cdac1ff8-87d8-4d02-97e1-fbf74ea2e163-secret-grpc-tls\") pod \"thanos-querier-668d64b687-bvpl9\" (UID: \"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163\") " pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9"
Jul 28 20:26:20.761969 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.761938    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdac1ff8-87d8-4d02-97e1-fbf74ea2e163-metrics-client-ca\") pod \"thanos-querier-668d64b687-bvpl9\" (UID: \"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163\") " pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9"
Jul 28 20:26:20.764010 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.763984    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cdac1ff8-87d8-4d02-97e1-fbf74ea2e163-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-668d64b687-bvpl9\" (UID: \"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163\") " pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9"
Jul 28 20:26:20.764230 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.764210    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cdac1ff8-87d8-4d02-97e1-fbf74ea2e163-secret-thanos-querier-tls\") pod \"thanos-querier-668d64b687-bvpl9\" (UID: \"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163\") " pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9"
Jul 28 20:26:20.764230 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.764219    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cdac1ff8-87d8-4d02-97e1-fbf74ea2e163-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-668d64b687-bvpl9\" (UID: \"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163\") " pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9"
Jul 28 20:26:20.764384 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.764244    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cdac1ff8-87d8-4d02-97e1-fbf74ea2e163-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-668d64b687-bvpl9\" (UID: \"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163\") " pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9"
Jul 28 20:26:20.764384 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.764276    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cdac1ff8-87d8-4d02-97e1-fbf74ea2e163-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-668d64b687-bvpl9\" (UID: \"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163\") " pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9"
Jul 28 20:26:20.764640 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.764618    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cdac1ff8-87d8-4d02-97e1-fbf74ea2e163-secret-grpc-tls\") pod \"thanos-querier-668d64b687-bvpl9\" (UID: \"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163\") " pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9"
Jul 28 20:26:20.769090 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.769072    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7c94\" (UniqueName: \"kubernetes.io/projected/cdac1ff8-87d8-4d02-97e1-fbf74ea2e163-kube-api-access-p7c94\") pod \"thanos-querier-668d64b687-bvpl9\" (UID: \"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163\") " pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9"
Jul 28 20:26:20.877508 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:20.877470    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9"
Jul 28 20:26:21.009559 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:21.009529    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-668d64b687-bvpl9"]
Jul 28 20:26:21.012564 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:26:21.012541    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdac1ff8_87d8_4d02_97e1_fbf74ea2e163.slice/crio-cc7a63d5071e212602d623dece6853f3074c03382777864eea79d8700b6efb3e WatchSource:0}: Error finding container cc7a63d5071e212602d623dece6853f3074c03382777864eea79d8700b6efb3e: Status 404 returned error can't find the container with id cc7a63d5071e212602d623dece6853f3074c03382777864eea79d8700b6efb3e
Jul 28 20:26:21.616014 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:21.615977    2556 generic.go:356] "Generic (PLEG): container finished" podID="ba3b98f6-76d6-45ea-9f20-477d846b277a" containerID="864d6db00890ab7fb5d4d2aee97ee6f2bf0a984671d04c903e8715d681d799a6" exitCode=0
Jul 28 20:26:21.616455 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:21.616071    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba3b98f6-76d6-45ea-9f20-477d846b277a","Type":"ContainerDied","Data":"864d6db00890ab7fb5d4d2aee97ee6f2bf0a984671d04c903e8715d681d799a6"}
Jul 28 20:26:21.617393 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:21.617340    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9" event={"ID":"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163","Type":"ContainerStarted","Data":"cc7a63d5071e212602d623dece6853f3074c03382777864eea79d8700b6efb3e"}
Jul 28 20:26:21.973984 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:21.973896    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bd6b65c-2bb9-43c4-bde8-420e312202ce-metrics-certs\") pod \"network-metrics-daemon-q5clp\" (UID: \"1bd6b65c-2bb9-43c4-bde8-420e312202ce\") " pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:26:21.976976 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:21.976952    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 20:26:21.986835 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:21.986810    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bd6b65c-2bb9-43c4-bde8-420e312202ce-metrics-certs\") pod \"network-metrics-daemon-q5clp\" (UID: \"1bd6b65c-2bb9-43c4-bde8-420e312202ce\") " pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:26:22.075158 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:22.075121    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57cc3100-f7ce-4374-ae22-73b79eb8db6a-original-pull-secret\") pod \"global-pull-secret-syncer-vg2dj\" (UID: \"57cc3100-f7ce-4374-ae22-73b79eb8db6a\") " pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:26:22.080227 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:22.080202    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 20:26:22.087880 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:22.087857    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57cc3100-f7ce-4374-ae22-73b79eb8db6a-original-pull-secret\") pod \"global-pull-secret-syncer-vg2dj\" (UID: \"57cc3100-f7ce-4374-ae22-73b79eb8db6a\") " pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:26:22.117480 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:22.117448    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vg2dj"
Jul 28 20:26:22.129495 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:22.129475    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sn8zg\""
Jul 28 20:26:22.137622 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:22.137591    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5clp"
Jul 28 20:26:22.177317 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:22.176800    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdv2q\" (UniqueName: \"kubernetes.io/projected/93e5d919-86e5-4cf9-b433-12ec1ea8cd0f-kube-api-access-pdv2q\") pod \"network-check-target-qfldd\" (UID: \"93e5d919-86e5-4cf9-b433-12ec1ea8cd0f\") " pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:26:22.179765 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:22.179579    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 20:26:22.191685 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:22.191443    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 20:26:22.201696 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:22.201664    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdv2q\" (UniqueName: \"kubernetes.io/projected/93e5d919-86e5-4cf9-b433-12ec1ea8cd0f-kube-api-access-pdv2q\") pod \"network-check-target-qfldd\" (UID: \"93e5d919-86e5-4cf9-b433-12ec1ea8cd0f\") " pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:26:22.275834 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:22.275803    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vg2dj"]
Jul 28 20:26:22.280849 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:22.280816    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-x6kqb"]
Jul 28 20:26:22.285097 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:22.284598    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x6kqb"
Jul 28 20:26:22.287580 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:22.287557    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 28 20:26:22.287725 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:22.287661    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-qjthx\""
Jul 28 20:26:22.296687 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:22.296626    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-x6kqb"]
Jul 28 20:26:22.317166 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:22.317133    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q5clp"]
Jul 28 20:26:22.321465 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:26:22.321438    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bd6b65c_2bb9_43c4_bde8_420e312202ce.slice/crio-25af86154313f7766bb96663b93605baf7de414f792a5f64ef011da142b2b72b WatchSource:0}: Error finding container 25af86154313f7766bb96663b93605baf7de414f792a5f64ef011da142b2b72b: Status 404 returned error can't find the container with id 25af86154313f7766bb96663b93605baf7de414f792a5f64ef011da142b2b72b
Jul 28 20:26:22.378784 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:22.378643    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b2m6\" (UniqueName: \"kubernetes.io/projected/38317c49-b1d3-4f74-a662-f2844ed25d02-kube-api-access-7b2m6\") pod \"monitoring-plugin-68b7fc9574-x6kqb\" (UID: \"38317c49-b1d3-4f74-a662-f2844ed25d02\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x6kqb"
Jul 28 20:26:22.378784 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:22.378713    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/38317c49-b1d3-4f74-a662-f2844ed25d02-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-x6kqb\" (UID: \"38317c49-b1d3-4f74-a662-f2844ed25d02\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x6kqb"
Jul 28 20:26:22.425001 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:22.424917    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9c5p9\""
Jul 28 20:26:22.433118 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:22.433085    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:26:22.479543 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:22.479510    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/38317c49-b1d3-4f74-a662-f2844ed25d02-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-x6kqb\" (UID: \"38317c49-b1d3-4f74-a662-f2844ed25d02\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x6kqb"
Jul 28 20:26:22.479705 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:22.479606    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b2m6\" (UniqueName: \"kubernetes.io/projected/38317c49-b1d3-4f74-a662-f2844ed25d02-kube-api-access-7b2m6\") pod \"monitoring-plugin-68b7fc9574-x6kqb\" (UID: \"38317c49-b1d3-4f74-a662-f2844ed25d02\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x6kqb"
Jul 28 20:26:22.482554 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:22.482528    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/38317c49-b1d3-4f74-a662-f2844ed25d02-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-x6kqb\" (UID: \"38317c49-b1d3-4f74-a662-f2844ed25d02\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x6kqb"
Jul 28 20:26:22.489979 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:22.489957    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b2m6\" (UniqueName: \"kubernetes.io/projected/38317c49-b1d3-4f74-a662-f2844ed25d02-kube-api-access-7b2m6\") pod \"monitoring-plugin-68b7fc9574-x6kqb\" (UID: \"38317c49-b1d3-4f74-a662-f2844ed25d02\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x6kqb"
Jul 28 20:26:22.599120 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:22.599085    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x6kqb"
Jul 28 20:26:22.624097 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:22.624046    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q5clp" event={"ID":"1bd6b65c-2bb9-43c4-bde8-420e312202ce","Type":"ContainerStarted","Data":"25af86154313f7766bb96663b93605baf7de414f792a5f64ef011da142b2b72b"}
Jul 28 20:26:22.625681 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:22.625646    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vg2dj" event={"ID":"57cc3100-f7ce-4374-ae22-73b79eb8db6a","Type":"ContainerStarted","Data":"9e0a6a67035a988b412b0ae3427a499adf5ec422c519f6d5962491a5f6df89bb"}
Jul 28 20:26:23.726552 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.726518    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 20:26:23.761775 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.761736    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 20:26:23.761931 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.761876    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.766221 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.765128    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 28 20:26:23.766221 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.765335    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 28 20:26:23.766221 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.765534    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 28 20:26:23.766221 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.765721    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 28 20:26:23.766221 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.765901    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 28 20:26:23.767076 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.766614    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 28 20:26:23.767076 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.766784    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 28 20:26:23.767076 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.766972    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-eej33f7eodb5j\""
Jul 28 20:26:23.771253 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.771228    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 28 20:26:23.771479 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.771465    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 28 20:26:23.771955 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.771589    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 28 20:26:23.771955 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.771784    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 28 20:26:23.772245 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.772227    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sbkwk\""
Jul 28 20:26:23.777257 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.772998    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 28 20:26:23.777257 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.776895    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 28 20:26:23.790993 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.790963    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 28 20:26:23.793223 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.793199    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qfldd"]
Jul 28 20:26:23.795823 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.795801    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 28 20:26:23.821390 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:26:23.821334    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93e5d919_86e5_4cf9_b433_12ec1ea8cd0f.slice/crio-a0ddc33465cd0cd77a4c046a5add487e915dd039ebba08df20182f8bc7a833eb WatchSource:0}: Error finding container a0ddc33465cd0cd77a4c046a5add487e915dd039ebba08df20182f8bc7a833eb: Status 404 returned error can't find the container with id a0ddc33465cd0cd77a4c046a5add487e915dd039ebba08df20182f8bc7a833eb
Jul 28 20:26:23.893019 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.892987    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.893156 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.893034    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-config\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.893156 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.893086    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.893156 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.893124    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.893321 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.893166    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.893321 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.893193    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.893938 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.893890    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.894049 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.893966    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.894049 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.894032    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.894177 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.894072    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.894177 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.894107    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.894177 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.894140    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.894177 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.894169    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-config-out\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.894404 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.894190    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.894404 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.894211    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-web-config\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.894404 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.894233    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.894404 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.894282    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.894404 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.894325    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.894650 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.894448    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.894650 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.894480    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pprt\" (UniqueName: \"kubernetes.io/projected/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-kube-api-access-5pprt\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.995632 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.995590    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.995813 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.995643    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.995813 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.995675    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.995813 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.995699    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-config-out\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.995813 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.995721    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.995813 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.995743    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-web-config\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.995813 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.995765    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.995813 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.995797    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.996155 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.995831    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.996155 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.995854    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.996155 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.995884    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pprt\" (UniqueName: \"kubernetes.io/projected/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-kube-api-access-5pprt\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.996155 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.995930    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.996155 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.995960    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-config\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.996155 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.995983    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.996155 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.996006    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.996155 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.996043    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.996155 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.996071    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.996155 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.996101    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.996155 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.996141    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.996700 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.996181    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.996700 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.996339    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.996700 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.996647    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.998825 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.996901    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.998825 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.997704    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.998825 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.997891    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:23.998825 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:23.998726    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:24.002778 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:24.000477    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:24.002778 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:24.001497    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-x6kqb"]
Jul 28 20:26:24.002778 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:24.001900    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:24.002778 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:24.002710    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:24.005745 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:24.005686    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-config-out\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:24.005996 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:24.005896    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:24.006941 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:24.006896    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:24.007043 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:24.007013    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-config\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:24.007610 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:24.007565    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:24.008037 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:24.007950    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pprt\" (UniqueName: \"kubernetes.io/projected/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-kube-api-access-5pprt\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:24.008259 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:24.008229    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-web-config\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:24.008580 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:24.008555    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:24.009157 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:24.009092    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:24.009583 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:24.009556    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:24.009838 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:24.009818    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:24.081948 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:24.081901    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:26:24.247577 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:26:24.247495    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38317c49_b1d3_4f74_a662_f2844ed25d02.slice/crio-28242d890d5fd4e13ae60c74e3f1b3076011472ae2b0d7de1bb7b275bca564ee WatchSource:0}: Error finding container 28242d890d5fd4e13ae60c74e3f1b3076011472ae2b0d7de1bb7b275bca564ee: Status 404 returned error can't find the container with id 28242d890d5fd4e13ae60c74e3f1b3076011472ae2b0d7de1bb7b275bca564ee
Jul 28 20:26:24.432526 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:24.432496    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 20:26:24.589423 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:26:24.589384    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ed0f2d0_7bf7_4a7e_936d_9968dea6f6ca.slice/crio-f1ea85bf5c81a73be0a6259fd22e4d3d106167d1945edbd1d8a322feba3a55ec WatchSource:0}: Error finding container f1ea85bf5c81a73be0a6259fd22e4d3d106167d1945edbd1d8a322feba3a55ec: Status 404 returned error can't find the container with id f1ea85bf5c81a73be0a6259fd22e4d3d106167d1945edbd1d8a322feba3a55ec
Jul 28 20:26:24.641926 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:24.641468    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca","Type":"ContainerStarted","Data":"f1ea85bf5c81a73be0a6259fd22e4d3d106167d1945edbd1d8a322feba3a55ec"}
Jul 28 20:26:24.645705 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:24.644366    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x6kqb" event={"ID":"38317c49-b1d3-4f74-a662-f2844ed25d02","Type":"ContainerStarted","Data":"28242d890d5fd4e13ae60c74e3f1b3076011472ae2b0d7de1bb7b275bca564ee"}
Jul 28 20:26:24.649426 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:24.649121    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba3b98f6-76d6-45ea-9f20-477d846b277a","Type":"ContainerStarted","Data":"3dbb1d2120b8fece8b60c32d481aae455cf3083b03acee27a110d245dad5f5e9"}
Jul 28 20:26:24.655281 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:24.655132    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9" event={"ID":"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163","Type":"ContainerStarted","Data":"4c288ccbd14049466a15cbd6540cdfee98e4f5ebb87d7e30610bc1ec1e0a958a"}
Jul 28 20:26:24.655281 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:24.655207    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9" event={"ID":"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163","Type":"ContainerStarted","Data":"eb1d731a258f71a2a8a11284c50522e95aca6cb7d2a456706f42dd026ece1806"}
Jul 28 20:26:24.659221 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:24.659160    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qfldd" event={"ID":"93e5d919-86e5-4cf9-b433-12ec1ea8cd0f","Type":"ContainerStarted","Data":"a0ddc33465cd0cd77a4c046a5add487e915dd039ebba08df20182f8bc7a833eb"}
Jul 28 20:26:25.666263 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:25.666007    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q5clp" event={"ID":"1bd6b65c-2bb9-43c4-bde8-420e312202ce","Type":"ContainerStarted","Data":"60ad61b643ce0630077fef12f3607aec8df497caaf5ec92a1076c6176c660c3c"}
Jul 28 20:26:25.666263 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:25.666105    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q5clp" event={"ID":"1bd6b65c-2bb9-43c4-bde8-420e312202ce","Type":"ContainerStarted","Data":"5640a9a242820da81dc3480873dd2d7d8a9c75ed0f371767185443644631d4f5"}
Jul 28 20:26:25.668630 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:25.668508    2556 generic.go:356] "Generic (PLEG): container finished" podID="3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca" containerID="192a34462ee23e73023c9609f53daaaf4c858e5a2e45e7bf6cda5f2a496c91d1" exitCode=0
Jul 28 20:26:25.668630 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:25.668594    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca","Type":"ContainerDied","Data":"192a34462ee23e73023c9609f53daaaf4c858e5a2e45e7bf6cda5f2a496c91d1"}
Jul 28 20:26:25.672999 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:25.672842    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba3b98f6-76d6-45ea-9f20-477d846b277a","Type":"ContainerStarted","Data":"4332cb5b8584a723e0c609dd77b946f7012e49acca84cd2fcf39564a3cb4e988"}
Jul 28 20:26:25.672999 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:25.672912    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba3b98f6-76d6-45ea-9f20-477d846b277a","Type":"ContainerStarted","Data":"02b3d6d751de580dc2f3ee23b484f69c47896b39854a863b355fb84dfdc6d4ba"}
Jul 28 20:26:25.672999 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:25.672999    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba3b98f6-76d6-45ea-9f20-477d846b277a","Type":"ContainerStarted","Data":"2e6604dd9e200e92a0d26543a771896899061e24cdbb0dc8786e72f3956c3bb3"}
Jul 28 20:26:25.673216 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:25.673041    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba3b98f6-76d6-45ea-9f20-477d846b277a","Type":"ContainerStarted","Data":"bccc4cdd28655f9ff1e6540f4bcc3a546231f8adf062e3189f7683b1cb1703b3"}
Jul 28 20:26:25.676718 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:25.676689    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9" event={"ID":"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163","Type":"ContainerStarted","Data":"424e9909e66cfe220721827fd916b2f4272767258018a029d95a435c6e778c8b"}
Jul 28 20:26:25.684654 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:25.684472    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-q5clp" podStartSLOduration=67.391909381 podStartE2EDuration="1m9.684451796s" totalImagesPullingTime="2.292542415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:25.682777194 +0000 UTC m=+69.902166079" watchObservedRunningTime="2026-07-28 20:26:25.684451796 +0000 UTC m=+69.903840680"
Jul 28 20:26:26.688245 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:26.688209    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba3b98f6-76d6-45ea-9f20-477d846b277a","Type":"ContainerStarted","Data":"075cf9feddb75bd91b4c4f5eb0c8258e6bb4b1d7b6109fce021985ade065a860"}
Jul 28 20:26:26.690935 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:26.690905    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9" event={"ID":"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163","Type":"ContainerStarted","Data":"90f8da62aeb14301ea6875eca16124b6a1887862b3c03bccbb22afa9851bb6b5"}
Jul 28 20:26:26.718032 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:26.717959    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.912321456 podStartE2EDuration="8.717913068s" totalImagesPullingTime="4.790008867s" totalInitContainerRuntime="15.582745ms" isStatefulPod=false podCreationTimestamp="2026-07-28 20:26:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:26.716865736 +0000 UTC m=+70.936254657" watchObservedRunningTime="2026-07-28 20:26:26.717913068 +0000 UTC m=+70.937301954"
Jul 28 20:26:29.712851 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:29.712814    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x6kqb" event={"ID":"38317c49-b1d3-4f74-a662-f2844ed25d02","Type":"ContainerStarted","Data":"571c1f431b826693a3f8775f58f512a57f56c2b0a1c8622a7eed0c22469024e5"}
Jul 28 20:26:29.713312 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:29.712979    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x6kqb"
Jul 28 20:26:29.714759 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:29.714726    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vg2dj" event={"ID":"57cc3100-f7ce-4374-ae22-73b79eb8db6a","Type":"ContainerStarted","Data":"b9bdc181d97a3f56815b33df6299662f4c69815173436dcda31fb2ae81afc551"}
Jul 28 20:26:29.718776 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:29.718727    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9" event={"ID":"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163","Type":"ContainerStarted","Data":"493bfeea29cfb641c3eb942e6caeedb98f7b39364c90fe84474cc3dc8c5ad2b9"}
Jul 28 20:26:29.718906 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:29.718828    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9" event={"ID":"cdac1ff8-87d8-4d02-97e1-fbf74ea2e163","Type":"ContainerStarted","Data":"19f1025fc13eda6ed02cc95b0e81bd46acfbdc23ac6ea82a8fdae694501882d8"}
Jul 28 20:26:29.719107 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:29.719086    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x6kqb"
Jul 28 20:26:29.719255 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:29.719242    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9"
Jul 28 20:26:29.720359 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:29.720319    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qfldd" event={"ID":"93e5d919-86e5-4cf9-b433-12ec1ea8cd0f","Type":"ContainerStarted","Data":"2be62ad69e7d6f391d9288b43986019152008ea50a190258161d489a1aa1e90a"}
Jul 28 20:26:29.720562 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:29.720540    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:26:29.724593 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:29.724576    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9"
Jul 28 20:26:29.730083 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:29.730046    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x6kqb" podStartSLOduration=3.142203027 podStartE2EDuration="7.730034099s" totalImagesPullingTime="4.587831072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:29.728107707 +0000 UTC m=+73.947496592" watchObservedRunningTime="2026-07-28 20:26:29.730034099 +0000 UTC m=+73.949422984"
Jul 28 20:26:29.743050 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:29.743004    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qfldd" podStartSLOduration=68.763304417 podStartE2EDuration="1m13.742985538s" totalImagesPullingTime="4.979681121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:29.742731022 +0000 UTC m=+73.962119908" watchObservedRunningTime="2026-07-28 20:26:29.742985538 +0000 UTC m=+73.962374424"
Jul 28 20:26:29.757625 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:29.757573    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vg2dj" podStartSLOduration=67.191421309 podStartE2EDuration="1m13.757557133s" totalImagesPullingTime="6.566135824s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:29.756808481 +0000 UTC m=+73.976197367" watchObservedRunningTime="2026-07-28 20:26:29.757557133 +0000 UTC m=+73.976946018"
Jul 28 20:26:29.779011 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:29.778958    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-668d64b687-bvpl9" podStartSLOduration=5.908243921 podStartE2EDuration="9.778939526s" totalImagesPullingTime="3.870695605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:26:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:29.778149342 +0000 UTC m=+73.997538228" watchObservedRunningTime="2026-07-28 20:26:29.778939526 +0000 UTC m=+73.998328412"
Jul 28 20:26:31.735666 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:31.735627    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca","Type":"ContainerStarted","Data":"23ee2e8d47a972bfaa571feb127802b183f9e3e3a2a9cae94b1ad88e8e4677a0"}
Jul 28 20:26:31.736075 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:31.735713    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca","Type":"ContainerStarted","Data":"a454b680fbc4e3eb580c31e189c5b4fa1c61bd5c2266c17ba73f36651d34cb81"}
Jul 28 20:26:31.736075 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:31.735741    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca","Type":"ContainerStarted","Data":"8cc3440996e2d8a1608f17043e200c7684330a6776215a66dc05a6bb196298e2"}
Jul 28 20:26:31.736075 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:31.735770    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca","Type":"ContainerStarted","Data":"a5c067fcf7c9bd270e2069cfedcc02c9d307e209fdbe7722ada9fe1f949aa941"}
Jul 28 20:26:31.736075 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:31.735809    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca","Type":"ContainerStarted","Data":"ea403b924a86290d3a358c2cc3079a2d899b492c414cb73529c548155a1418d0"}
Jul 28 20:26:31.736075 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:31.735833    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca","Type":"ContainerStarted","Data":"cea6eb5e44616805d2179b38be92c75d93c2da3bdc454ef81aaec95b698688f4"}
Jul 28 20:26:31.774778 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:31.774719    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.772629911 podStartE2EDuration="8.774696588s" totalImagesPullingTime="4.975499867s" totalInitContainerRuntime="26.56681ms" isStatefulPod=false podCreationTimestamp="2026-07-28 20:26:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:31.772273867 +0000 UTC m=+75.991662774" watchObservedRunningTime="2026-07-28 20:26:31.774696588 +0000 UTC m=+75.994085493"
Jul 28 20:26:34.082604 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:26:34.082558    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:27:00.729762 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:27:00.729731    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qfldd"
Jul 28 20:27:24.082918 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:27:24.082863    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:27:24.101774 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:27:24.101750    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:27:24.959697 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:27:24.959668    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 20:29:34.781726 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:29:34.781693    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dfzct"]
Jul 28 20:29:34.783879 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:29:34.783847    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-dfzct"
Jul 28 20:29:34.786559 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:29:34.786535    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 28 20:29:34.787578 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:29:34.787560    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 28 20:29:34.787711 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:29:34.787585    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-dcx42\""
Jul 28 20:29:34.792983 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:29:34.792964    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dfzct"]
Jul 28 20:29:34.920438 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:29:34.920400    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqchz\" (UniqueName: \"kubernetes.io/projected/2436a2e3-d5c5-4997-b89b-c3537b411157-kube-api-access-qqchz\") pod \"cert-manager-55b4d954d5-dfzct\" (UID: \"2436a2e3-d5c5-4997-b89b-c3537b411157\") " pod="cert-manager/cert-manager-55b4d954d5-dfzct"
Jul 28 20:29:34.920634 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:29:34.920448    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2436a2e3-d5c5-4997-b89b-c3537b411157-bound-sa-token\") pod \"cert-manager-55b4d954d5-dfzct\" (UID: \"2436a2e3-d5c5-4997-b89b-c3537b411157\") " pod="cert-manager/cert-manager-55b4d954d5-dfzct"
Jul 28 20:29:35.021206 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:29:35.021170    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2436a2e3-d5c5-4997-b89b-c3537b411157-bound-sa-token\") pod \"cert-manager-55b4d954d5-dfzct\" (UID: \"2436a2e3-d5c5-4997-b89b-c3537b411157\") " pod="cert-manager/cert-manager-55b4d954d5-dfzct"
Jul 28 20:29:35.021411 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:29:35.021249    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqchz\" (UniqueName: \"kubernetes.io/projected/2436a2e3-d5c5-4997-b89b-c3537b411157-kube-api-access-qqchz\") pod \"cert-manager-55b4d954d5-dfzct\" (UID: \"2436a2e3-d5c5-4997-b89b-c3537b411157\") " pod="cert-manager/cert-manager-55b4d954d5-dfzct"
Jul 28 20:29:35.029776 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:29:35.029746    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqchz\" (UniqueName: \"kubernetes.io/projected/2436a2e3-d5c5-4997-b89b-c3537b411157-kube-api-access-qqchz\") pod \"cert-manager-55b4d954d5-dfzct\" (UID: \"2436a2e3-d5c5-4997-b89b-c3537b411157\") " pod="cert-manager/cert-manager-55b4d954d5-dfzct"
Jul 28 20:29:35.029887 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:29:35.029801    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2436a2e3-d5c5-4997-b89b-c3537b411157-bound-sa-token\") pod \"cert-manager-55b4d954d5-dfzct\" (UID: \"2436a2e3-d5c5-4997-b89b-c3537b411157\") " pod="cert-manager/cert-manager-55b4d954d5-dfzct"
Jul 28 20:29:35.102036 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:29:35.101994    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-dfzct"
Jul 28 20:29:35.224396 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:29:35.224359    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dfzct"]
Jul 28 20:29:35.227259 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:29:35.227237    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2436a2e3_d5c5_4997_b89b_c3537b411157.slice/crio-50593e19ad3e7bcf74b3cb02b48b0bbdb7d478cd12f791d9dd5339556ab07d5a WatchSource:0}: Error finding container 50593e19ad3e7bcf74b3cb02b48b0bbdb7d478cd12f791d9dd5339556ab07d5a: Status 404 returned error can't find the container with id 50593e19ad3e7bcf74b3cb02b48b0bbdb7d478cd12f791d9dd5339556ab07d5a
Jul 28 20:29:35.412018 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:29:35.411935    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-dfzct" event={"ID":"2436a2e3-d5c5-4997-b89b-c3537b411157","Type":"ContainerStarted","Data":"50593e19ad3e7bcf74b3cb02b48b0bbdb7d478cd12f791d9dd5339556ab07d5a"}
Jul 28 20:29:39.428917 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:29:39.428882    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-dfzct" event={"ID":"2436a2e3-d5c5-4997-b89b-c3537b411157","Type":"ContainerStarted","Data":"8cdb4fec4d62b58d206b4f66111e4faa071368b1ed07a03914e9d91e4890a707"}
Jul 28 20:29:39.445525 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:29:39.445479    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-dfzct" podStartSLOduration=2.185033698 podStartE2EDuration="5.445464933s" totalImagesPullingTime="3.260431235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:29:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:29:39.444240162 +0000 UTC m=+263.663629048" watchObservedRunningTime="2026-07-28 20:29:39.445464933 +0000 UTC m=+263.664853817"
Jul 28 20:30:07.349489 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:07.349453    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56794f8cc8-66phd"]
Jul 28 20:30:07.356074 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:07.356048    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-66phd"
Jul 28 20:30:07.358604 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:07.358578    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 28 20:30:07.358730 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:07.358707    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 28 20:30:07.359496 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:07.359480    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 28 20:30:07.359780 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:07.359767    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sr7hb\""
Jul 28 20:30:07.359866 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:07.359803    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 28 20:30:07.370420 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:07.370401    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56794f8cc8-66phd"]
Jul 28 20:30:07.390845 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:07.390812    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48ba4dcd-704d-4c9f-9462-a105f9e330e8-webhook-cert\") pod \"opendatahub-operator-controller-manager-56794f8cc8-66phd\" (UID: \"48ba4dcd-704d-4c9f-9462-a105f9e330e8\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-66phd"
Jul 28 20:30:07.390845 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:07.390846    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48ba4dcd-704d-4c9f-9462-a105f9e330e8-tmp\") pod \"opendatahub-operator-controller-manager-56794f8cc8-66phd\" (UID: \"48ba4dcd-704d-4c9f-9462-a105f9e330e8\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-66phd"
Jul 28 20:30:07.391011 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:07.390865    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68brl\" (UniqueName: \"kubernetes.io/projected/48ba4dcd-704d-4c9f-9462-a105f9e330e8-kube-api-access-68brl\") pod \"opendatahub-operator-controller-manager-56794f8cc8-66phd\" (UID: \"48ba4dcd-704d-4c9f-9462-a105f9e330e8\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-66phd"
Jul 28 20:30:07.391011 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:07.390972    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/48ba4dcd-704d-4c9f-9462-a105f9e330e8-manifests\") pod \"opendatahub-operator-controller-manager-56794f8cc8-66phd\" (UID: \"48ba4dcd-704d-4c9f-9462-a105f9e330e8\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-66phd"
Jul 28 20:30:07.391011 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:07.391009    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/48ba4dcd-704d-4c9f-9462-a105f9e330e8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56794f8cc8-66phd\" (UID: \"48ba4dcd-704d-4c9f-9462-a105f9e330e8\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-66phd"
Jul 28 20:30:07.491757 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:07.491711    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48ba4dcd-704d-4c9f-9462-a105f9e330e8-webhook-cert\") pod \"opendatahub-operator-controller-manager-56794f8cc8-66phd\" (UID: \"48ba4dcd-704d-4c9f-9462-a105f9e330e8\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-66phd"
Jul 28 20:30:07.491757 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:07.491754    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48ba4dcd-704d-4c9f-9462-a105f9e330e8-tmp\") pod \"opendatahub-operator-controller-manager-56794f8cc8-66phd\" (UID: \"48ba4dcd-704d-4c9f-9462-a105f9e330e8\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-66phd"
Jul 28 20:30:07.492024 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:07.491775    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68brl\" (UniqueName: \"kubernetes.io/projected/48ba4dcd-704d-4c9f-9462-a105f9e330e8-kube-api-access-68brl\") pod \"opendatahub-operator-controller-manager-56794f8cc8-66phd\" (UID: \"48ba4dcd-704d-4c9f-9462-a105f9e330e8\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-66phd"
Jul 28 20:30:07.492024 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:07.491823    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/48ba4dcd-704d-4c9f-9462-a105f9e330e8-manifests\") pod \"opendatahub-operator-controller-manager-56794f8cc8-66phd\" (UID: \"48ba4dcd-704d-4c9f-9462-a105f9e330e8\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-66phd"
Jul 28 20:30:07.492024 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:07.491850    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/48ba4dcd-704d-4c9f-9462-a105f9e330e8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56794f8cc8-66phd\" (UID: \"48ba4dcd-704d-4c9f-9462-a105f9e330e8\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-66phd"
Jul 28 20:30:07.492277 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:07.492253    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/48ba4dcd-704d-4c9f-9462-a105f9e330e8-manifests\") pod \"opendatahub-operator-controller-manager-56794f8cc8-66phd\" (UID: \"48ba4dcd-704d-4c9f-9462-a105f9e330e8\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-66phd"
Jul 28 20:30:07.494020 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:07.493999    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48ba4dcd-704d-4c9f-9462-a105f9e330e8-tmp\") pod \"opendatahub-operator-controller-manager-56794f8cc8-66phd\" (UID: \"48ba4dcd-704d-4c9f-9462-a105f9e330e8\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-66phd"
Jul 28 20:30:07.494297 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:07.494277    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/48ba4dcd-704d-4c9f-9462-a105f9e330e8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56794f8cc8-66phd\" (UID: \"48ba4dcd-704d-4c9f-9462-a105f9e330e8\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-66phd"
Jul 28 20:30:07.494390 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:07.494372    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/48ba4dcd-704d-4c9f-9462-a105f9e330e8-webhook-cert\") pod \"opendatahub-operator-controller-manager-56794f8cc8-66phd\" (UID: \"48ba4dcd-704d-4c9f-9462-a105f9e330e8\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-66phd"
Jul 28 20:30:07.502412 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:07.502393    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68brl\" (UniqueName: \"kubernetes.io/projected/48ba4dcd-704d-4c9f-9462-a105f9e330e8-kube-api-access-68brl\") pod \"opendatahub-operator-controller-manager-56794f8cc8-66phd\" (UID: \"48ba4dcd-704d-4c9f-9462-a105f9e330e8\") " pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-66phd"
Jul 28 20:30:07.666152 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:07.666056    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-66phd"
Jul 28 20:30:07.806393 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:07.806368    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56794f8cc8-66phd"]
Jul 28 20:30:07.808881 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:30:07.808854    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48ba4dcd_704d_4c9f_9462_a105f9e330e8.slice/crio-cb76473b2b1bd08aa6694126517761339901001a542332a12ca9969e2e47a1d2 WatchSource:0}: Error finding container cb76473b2b1bd08aa6694126517761339901001a542332a12ca9969e2e47a1d2: Status 404 returned error can't find the container with id cb76473b2b1bd08aa6694126517761339901001a542332a12ca9969e2e47a1d2
Jul 28 20:30:08.542181 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:08.542134    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-66phd" event={"ID":"48ba4dcd-704d-4c9f-9462-a105f9e330e8","Type":"ContainerStarted","Data":"cb76473b2b1bd08aa6694126517761339901001a542332a12ca9969e2e47a1d2"}
Jul 28 20:30:11.557101 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:11.557069    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-66phd" event={"ID":"48ba4dcd-704d-4c9f-9462-a105f9e330e8","Type":"ContainerStarted","Data":"4d49a31059109feb15624c773344f810cd8c7ebc40286ac907ba1814c499f18c"}
Jul 28 20:30:12.562194 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:12.562160    2556 generic.go:356] "Generic (PLEG): container finished" podID="48ba4dcd-704d-4c9f-9462-a105f9e330e8" containerID="4d49a31059109feb15624c773344f810cd8c7ebc40286ac907ba1814c499f18c" exitCode=0
Jul 28 20:30:12.562194 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:12.562198    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-66phd" event={"ID":"48ba4dcd-704d-4c9f-9462-a105f9e330e8","Type":"ContainerDied","Data":"4d49a31059109feb15624c773344f810cd8c7ebc40286ac907ba1814c499f18c"}
Jul 28 20:30:13.568091 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:13.568053    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-66phd" event={"ID":"48ba4dcd-704d-4c9f-9462-a105f9e330e8","Type":"ContainerStarted","Data":"92803dd020a93ccbd7730e748cdd26b6b72ff189d7c34c9c67bc002d01737a18"}
Jul 28 20:30:13.568513 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:13.568230    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-66phd"
Jul 28 20:30:13.594799 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:13.594737    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-66phd" podStartSLOduration=2.067983173 podStartE2EDuration="6.594716235s" totalImagesPullingTime="3.438145056s" totalInitContainerRuntime="1.088588006s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:30:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:30:13.593338157 +0000 UTC m=+297.812727042" watchObservedRunningTime="2026-07-28 20:30:13.594716235 +0000 UTC m=+297.814105121"
Jul 28 20:30:16.164070 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:16.164034    2556 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 20:30:24.574963 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:24.574930    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-56794f8cc8-66phd"
Jul 28 20:30:27.169725 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:27.169694    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7d6cc5795b-kvhql"]
Jul 28 20:30:27.171915 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:27.171899    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d6cc5795b-kvhql"
Jul 28 20:30:27.175563 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:27.175537    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 28 20:30:27.175774 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:27.175757    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 28 20:30:27.175888 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:27.175815    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 28 20:30:27.176811 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:27.176791    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 28 20:30:27.176938 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:27.176921    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-fz72w\""
Jul 28 20:30:27.194151 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:27.194132    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d6cc5795b-kvhql"]
Jul 28 20:30:27.266314 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:27.266287    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/989d2fe6-53ba-48a5-b571-2aa024fa5384-tls-certs\") pod \"kube-auth-proxy-7d6cc5795b-kvhql\" (UID: \"989d2fe6-53ba-48a5-b571-2aa024fa5384\") " pod="openshift-ingress/kube-auth-proxy-7d6cc5795b-kvhql"
Jul 28 20:30:27.266314 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:27.266318    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/989d2fe6-53ba-48a5-b571-2aa024fa5384-tmp\") pod \"kube-auth-proxy-7d6cc5795b-kvhql\" (UID: \"989d2fe6-53ba-48a5-b571-2aa024fa5384\") " pod="openshift-ingress/kube-auth-proxy-7d6cc5795b-kvhql"
Jul 28 20:30:27.266558 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:27.266432    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxp7s\" (UniqueName: \"kubernetes.io/projected/989d2fe6-53ba-48a5-b571-2aa024fa5384-kube-api-access-sxp7s\") pod \"kube-auth-proxy-7d6cc5795b-kvhql\" (UID: \"989d2fe6-53ba-48a5-b571-2aa024fa5384\") " pod="openshift-ingress/kube-auth-proxy-7d6cc5795b-kvhql"
Jul 28 20:30:27.367721 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:27.367691    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/989d2fe6-53ba-48a5-b571-2aa024fa5384-tls-certs\") pod \"kube-auth-proxy-7d6cc5795b-kvhql\" (UID: \"989d2fe6-53ba-48a5-b571-2aa024fa5384\") " pod="openshift-ingress/kube-auth-proxy-7d6cc5795b-kvhql"
Jul 28 20:30:27.367853 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:27.367726    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/989d2fe6-53ba-48a5-b571-2aa024fa5384-tmp\") pod \"kube-auth-proxy-7d6cc5795b-kvhql\" (UID: \"989d2fe6-53ba-48a5-b571-2aa024fa5384\") " pod="openshift-ingress/kube-auth-proxy-7d6cc5795b-kvhql"
Jul 28 20:30:27.367853 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:27.367791    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxp7s\" (UniqueName: \"kubernetes.io/projected/989d2fe6-53ba-48a5-b571-2aa024fa5384-kube-api-access-sxp7s\") pod \"kube-auth-proxy-7d6cc5795b-kvhql\" (UID: \"989d2fe6-53ba-48a5-b571-2aa024fa5384\") " pod="openshift-ingress/kube-auth-proxy-7d6cc5795b-kvhql"
Jul 28 20:30:27.367853 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:30:27.367842    2556 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 28 20:30:27.367965 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:30:27.367914    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/989d2fe6-53ba-48a5-b571-2aa024fa5384-tls-certs podName:989d2fe6-53ba-48a5-b571-2aa024fa5384 nodeName:}" failed. No retries permitted until 2026-07-28 20:30:27.867893634 +0000 UTC m=+312.087282514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/989d2fe6-53ba-48a5-b571-2aa024fa5384-tls-certs") pod "kube-auth-proxy-7d6cc5795b-kvhql" (UID: "989d2fe6-53ba-48a5-b571-2aa024fa5384") : secret "kube-auth-proxy-tls" not found
Jul 28 20:30:27.369932 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:27.369908    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/989d2fe6-53ba-48a5-b571-2aa024fa5384-tmp\") pod \"kube-auth-proxy-7d6cc5795b-kvhql\" (UID: \"989d2fe6-53ba-48a5-b571-2aa024fa5384\") " pod="openshift-ingress/kube-auth-proxy-7d6cc5795b-kvhql"
Jul 28 20:30:27.388894 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:27.388866    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxp7s\" (UniqueName: \"kubernetes.io/projected/989d2fe6-53ba-48a5-b571-2aa024fa5384-kube-api-access-sxp7s\") pod \"kube-auth-proxy-7d6cc5795b-kvhql\" (UID: \"989d2fe6-53ba-48a5-b571-2aa024fa5384\") " pod="openshift-ingress/kube-auth-proxy-7d6cc5795b-kvhql"
Jul 28 20:30:27.871590 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:27.871549    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/989d2fe6-53ba-48a5-b571-2aa024fa5384-tls-certs\") pod \"kube-auth-proxy-7d6cc5795b-kvhql\" (UID: \"989d2fe6-53ba-48a5-b571-2aa024fa5384\") " pod="openshift-ingress/kube-auth-proxy-7d6cc5795b-kvhql"
Jul 28 20:30:27.873931 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:27.873912    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/989d2fe6-53ba-48a5-b571-2aa024fa5384-tls-certs\") pod \"kube-auth-proxy-7d6cc5795b-kvhql\" (UID: \"989d2fe6-53ba-48a5-b571-2aa024fa5384\") " pod="openshift-ingress/kube-auth-proxy-7d6cc5795b-kvhql"
Jul 28 20:30:28.080969 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:28.080933    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d6cc5795b-kvhql"
Jul 28 20:30:28.294381 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:28.294325    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d6cc5795b-kvhql"]
Jul 28 20:30:28.300033 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:30:28.300009    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod989d2fe6_53ba_48a5_b571_2aa024fa5384.slice/crio-ad81101868359ce21e61ac5cc4756894921421dcd1143bb8cc2166d5d6d23569 WatchSource:0}: Error finding container ad81101868359ce21e61ac5cc4756894921421dcd1143bb8cc2166d5d6d23569: Status 404 returned error can't find the container with id ad81101868359ce21e61ac5cc4756894921421dcd1143bb8cc2166d5d6d23569
Jul 28 20:30:28.301710 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:28.301692    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 20:30:28.626450 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:28.626417    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d6cc5795b-kvhql" event={"ID":"989d2fe6-53ba-48a5-b571-2aa024fa5384","Type":"ContainerStarted","Data":"ad81101868359ce21e61ac5cc4756894921421dcd1143bb8cc2166d5d6d23569"}
Jul 28 20:30:33.649053 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:33.649016    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d6cc5795b-kvhql" event={"ID":"989d2fe6-53ba-48a5-b571-2aa024fa5384","Type":"ContainerStarted","Data":"635cf103e5543214f2d93a26315f0c701de5d62fc0cef211aeedd79a67bd44b1"}
Jul 28 20:30:33.682285 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:33.682231    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7d6cc5795b-kvhql" podStartSLOduration=2.282186627 podStartE2EDuration="6.682210452s" totalImagesPullingTime="4.400023825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:30:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:30:33.681724429 +0000 UTC m=+317.901113336" watchObservedRunningTime="2026-07-28 20:30:33.682210452 +0000 UTC m=+317.901599338"
Jul 28 20:30:34.634511 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.634482    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r"]
Jul 28 20:30:34.636729 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.636709    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r"
Jul 28 20:30:34.640161 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.640131    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 28 20:30:34.640455 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.640439    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dsphz\""
Jul 28 20:30:34.640542 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.640520    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 28 20:30:34.640603 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.640552    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 28 20:30:34.640778 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.640761    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 28 20:30:34.656496 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.656475    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r"]
Jul 28 20:30:34.735776 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.735746    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/611c7c97-fef9-4a19-90fc-7977d1410ca0-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-6t45r\" (UID: \"611c7c97-fef9-4a19-90fc-7977d1410ca0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r"
Jul 28 20:30:34.735776 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.735779    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/611c7c97-fef9-4a19-90fc-7977d1410ca0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-6t45r\" (UID: \"611c7c97-fef9-4a19-90fc-7977d1410ca0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r"
Jul 28 20:30:34.735964 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.735805    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/611c7c97-fef9-4a19-90fc-7977d1410ca0-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-6t45r\" (UID: \"611c7c97-fef9-4a19-90fc-7977d1410ca0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r"
Jul 28 20:30:34.735964 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.735891    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk8tc\" (UniqueName: \"kubernetes.io/projected/611c7c97-fef9-4a19-90fc-7977d1410ca0-kube-api-access-fk8tc\") pod \"istiod-openshift-gateway-5677ccb49b-6t45r\" (UID: \"611c7c97-fef9-4a19-90fc-7977d1410ca0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r"
Jul 28 20:30:34.735964 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.735907    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/611c7c97-fef9-4a19-90fc-7977d1410ca0-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-6t45r\" (UID: \"611c7c97-fef9-4a19-90fc-7977d1410ca0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r"
Jul 28 20:30:34.736062 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.735973    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/611c7c97-fef9-4a19-90fc-7977d1410ca0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-6t45r\" (UID: \"611c7c97-fef9-4a19-90fc-7977d1410ca0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r"
Jul 28 20:30:34.736062 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.736012    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/611c7c97-fef9-4a19-90fc-7977d1410ca0-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-6t45r\" (UID: \"611c7c97-fef9-4a19-90fc-7977d1410ca0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r"
Jul 28 20:30:34.837308 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.837274    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk8tc\" (UniqueName: \"kubernetes.io/projected/611c7c97-fef9-4a19-90fc-7977d1410ca0-kube-api-access-fk8tc\") pod \"istiod-openshift-gateway-5677ccb49b-6t45r\" (UID: \"611c7c97-fef9-4a19-90fc-7977d1410ca0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r"
Jul 28 20:30:34.837308 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.837310    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/611c7c97-fef9-4a19-90fc-7977d1410ca0-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-6t45r\" (UID: \"611c7c97-fef9-4a19-90fc-7977d1410ca0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r"
Jul 28 20:30:34.837536 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.837375    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/611c7c97-fef9-4a19-90fc-7977d1410ca0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-6t45r\" (UID: \"611c7c97-fef9-4a19-90fc-7977d1410ca0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r"
Jul 28 20:30:34.837536 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.837405    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/611c7c97-fef9-4a19-90fc-7977d1410ca0-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-6t45r\" (UID: \"611c7c97-fef9-4a19-90fc-7977d1410ca0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r"
Jul 28 20:30:34.837536 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.837465    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/611c7c97-fef9-4a19-90fc-7977d1410ca0-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-6t45r\" (UID: \"611c7c97-fef9-4a19-90fc-7977d1410ca0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r"
Jul 28 20:30:34.837536 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.837491    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/611c7c97-fef9-4a19-90fc-7977d1410ca0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-6t45r\" (UID: \"611c7c97-fef9-4a19-90fc-7977d1410ca0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r"
Jul 28 20:30:34.837536 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.837518    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/611c7c97-fef9-4a19-90fc-7977d1410ca0-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-6t45r\" (UID: \"611c7c97-fef9-4a19-90fc-7977d1410ca0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r"
Jul 28 20:30:34.838065 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.838032    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/611c7c97-fef9-4a19-90fc-7977d1410ca0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-6t45r\" (UID: \"611c7c97-fef9-4a19-90fc-7977d1410ca0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r"
Jul 28 20:30:34.839784 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.839765    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/611c7c97-fef9-4a19-90fc-7977d1410ca0-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-6t45r\" (UID: \"611c7c97-fef9-4a19-90fc-7977d1410ca0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r"
Jul 28 20:30:34.839923 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.839904    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/611c7c97-fef9-4a19-90fc-7977d1410ca0-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-6t45r\" (UID: \"611c7c97-fef9-4a19-90fc-7977d1410ca0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r"
Jul 28 20:30:34.840145 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.840126    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/611c7c97-fef9-4a19-90fc-7977d1410ca0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-6t45r\" (UID: \"611c7c97-fef9-4a19-90fc-7977d1410ca0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r"
Jul 28 20:30:34.840205 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.840142    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/611c7c97-fef9-4a19-90fc-7977d1410ca0-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-6t45r\" (UID: \"611c7c97-fef9-4a19-90fc-7977d1410ca0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r"
Jul 28 20:30:34.861579 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.861560    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/611c7c97-fef9-4a19-90fc-7977d1410ca0-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-6t45r\" (UID: \"611c7c97-fef9-4a19-90fc-7977d1410ca0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r"
Jul 28 20:30:34.876226 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.876197    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk8tc\" (UniqueName: \"kubernetes.io/projected/611c7c97-fef9-4a19-90fc-7977d1410ca0-kube-api-access-fk8tc\") pod \"istiod-openshift-gateway-5677ccb49b-6t45r\" (UID: \"611c7c97-fef9-4a19-90fc-7977d1410ca0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r"
Jul 28 20:30:34.946309 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:34.946245    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r"
Jul 28 20:30:35.110150 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:35.110128    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r"]
Jul 28 20:30:35.111689 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:30:35.111662    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod611c7c97_fef9_4a19_90fc_7977d1410ca0.slice/crio-7db1eda580139c932ca88547869adf8c9c83e4ccabf870cb97cb8fd5ddba4a37 WatchSource:0}: Error finding container 7db1eda580139c932ca88547869adf8c9c83e4ccabf870cb97cb8fd5ddba4a37: Status 404 returned error can't find the container with id 7db1eda580139c932ca88547869adf8c9c83e4ccabf870cb97cb8fd5ddba4a37
Jul 28 20:30:35.662057 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:35.662018    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r" event={"ID":"611c7c97-fef9-4a19-90fc-7977d1410ca0","Type":"ContainerStarted","Data":"7db1eda580139c932ca88547869adf8c9c83e4ccabf870cb97cb8fd5ddba4a37"}
Jul 28 20:30:37.343289 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:37.343255    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:30:37.343556 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:37.343323    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:30:37.672670 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:37.672585    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r" event={"ID":"611c7c97-fef9-4a19-90fc-7977d1410ca0","Type":"ContainerStarted","Data":"e1f03ec15e914e7abb3985eaaff136a007d8fd15ad68befe1200183618fde96e"}
Jul 28 20:30:37.672825 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:37.672783    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r"
Jul 28 20:30:37.769567 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:37.769505    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r" podStartSLOduration=1.5401412570000002 podStartE2EDuration="3.769486286s" totalImagesPullingTime="2.229345029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:30:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:30:37.769471138 +0000 UTC m=+321.988860023" watchObservedRunningTime="2026-07-28 20:30:37.769486286 +0000 UTC m=+321.988875170"
Jul 28 20:30:38.401068 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:38.401031    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-54dcc5fbb6-j68vq"]
Jul 28 20:30:38.404082 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:38.404066    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-j68vq"
Jul 28 20:30:38.409734 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:38.409710    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 28 20:30:38.410818 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:38.410804    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 28 20:30:38.410883 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:38.410802    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-dfkjn\""
Jul 28 20:30:38.413290 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:38.413225    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 28 20:30:38.413445 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:38.413431    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 28 20:30:38.413523 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:38.413509    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 28 20:30:38.423591 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:38.423565    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54dcc5fbb6-j68vq"]
Jul 28 20:30:38.573754 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:38.573723    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9e805fbc-5abd-481f-be38-1c38aedb1575-manager-config\") pod \"lws-controller-manager-54dcc5fbb6-j68vq\" (UID: \"9e805fbc-5abd-481f-be38-1c38aedb1575\") " pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-j68vq"
Jul 28 20:30:38.573917 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:38.573762    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e805fbc-5abd-481f-be38-1c38aedb1575-cert\") pod \"lws-controller-manager-54dcc5fbb6-j68vq\" (UID: \"9e805fbc-5abd-481f-be38-1c38aedb1575\") " pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-j68vq"
Jul 28 20:30:38.573917 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:38.573787    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvhlx\" (UniqueName: \"kubernetes.io/projected/9e805fbc-5abd-481f-be38-1c38aedb1575-kube-api-access-xvhlx\") pod \"lws-controller-manager-54dcc5fbb6-j68vq\" (UID: \"9e805fbc-5abd-481f-be38-1c38aedb1575\") " pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-j68vq"
Jul 28 20:30:38.573917 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:38.573869    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e805fbc-5abd-481f-be38-1c38aedb1575-metrics-cert\") pod \"lws-controller-manager-54dcc5fbb6-j68vq\" (UID: \"9e805fbc-5abd-481f-be38-1c38aedb1575\") " pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-j68vq"
Jul 28 20:30:38.674731 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:38.674656    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9e805fbc-5abd-481f-be38-1c38aedb1575-manager-config\") pod \"lws-controller-manager-54dcc5fbb6-j68vq\" (UID: \"9e805fbc-5abd-481f-be38-1c38aedb1575\") " pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-j68vq"
Jul 28 20:30:38.674731 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:38.674708    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e805fbc-5abd-481f-be38-1c38aedb1575-cert\") pod \"lws-controller-manager-54dcc5fbb6-j68vq\" (UID: \"9e805fbc-5abd-481f-be38-1c38aedb1575\") " pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-j68vq"
Jul 28 20:30:38.674940 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:38.674736    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvhlx\" (UniqueName: \"kubernetes.io/projected/9e805fbc-5abd-481f-be38-1c38aedb1575-kube-api-access-xvhlx\") pod \"lws-controller-manager-54dcc5fbb6-j68vq\" (UID: \"9e805fbc-5abd-481f-be38-1c38aedb1575\") " pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-j68vq"
Jul 28 20:30:38.674940 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:38.674788    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e805fbc-5abd-481f-be38-1c38aedb1575-metrics-cert\") pod \"lws-controller-manager-54dcc5fbb6-j68vq\" (UID: \"9e805fbc-5abd-481f-be38-1c38aedb1575\") " pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-j68vq"
Jul 28 20:30:38.675397 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:38.675373    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9e805fbc-5abd-481f-be38-1c38aedb1575-manager-config\") pod \"lws-controller-manager-54dcc5fbb6-j68vq\" (UID: \"9e805fbc-5abd-481f-be38-1c38aedb1575\") " pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-j68vq"
Jul 28 20:30:38.677252 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:38.677230    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e805fbc-5abd-481f-be38-1c38aedb1575-cert\") pod \"lws-controller-manager-54dcc5fbb6-j68vq\" (UID: \"9e805fbc-5abd-481f-be38-1c38aedb1575\") " pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-j68vq"
Jul 28 20:30:38.677332 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:38.677254    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e805fbc-5abd-481f-be38-1c38aedb1575-metrics-cert\") pod \"lws-controller-manager-54dcc5fbb6-j68vq\" (UID: \"9e805fbc-5abd-481f-be38-1c38aedb1575\") " pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-j68vq"
Jul 28 20:30:38.678545 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:38.678526    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6t45r"
Jul 28 20:30:38.692909 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:38.692887    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvhlx\" (UniqueName: \"kubernetes.io/projected/9e805fbc-5abd-481f-be38-1c38aedb1575-kube-api-access-xvhlx\") pod \"lws-controller-manager-54dcc5fbb6-j68vq\" (UID: \"9e805fbc-5abd-481f-be38-1c38aedb1575\") " pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-j68vq"
Jul 28 20:30:38.712779 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:38.712757    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-j68vq"
Jul 28 20:30:38.887225 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:38.887202    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54dcc5fbb6-j68vq"]
Jul 28 20:30:38.888832 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:30:38.888802    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e805fbc_5abd_481f_be38_1c38aedb1575.slice/crio-e289674cc2f41a54e47de229736f0eca122122ce2d27b4e8190c2e5ee336185a WatchSource:0}: Error finding container e289674cc2f41a54e47de229736f0eca122122ce2d27b4e8190c2e5ee336185a: Status 404 returned error can't find the container with id e289674cc2f41a54e47de229736f0eca122122ce2d27b4e8190c2e5ee336185a
Jul 28 20:30:39.682244 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:39.682207    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-j68vq" event={"ID":"9e805fbc-5abd-481f-be38-1c38aedb1575","Type":"ContainerStarted","Data":"e289674cc2f41a54e47de229736f0eca122122ce2d27b4e8190c2e5ee336185a"}
Jul 28 20:30:42.704838 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:42.704798    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-j68vq" event={"ID":"9e805fbc-5abd-481f-be38-1c38aedb1575","Type":"ContainerStarted","Data":"53cdbd01168589ab6198f19c655ff8cd92342d666065a885b1c484444b54c69a"}
Jul 28 20:30:42.705233 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:42.704885    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-j68vq"
Jul 28 20:30:42.739297 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:42.739249    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-j68vq" podStartSLOduration=1.7128271929999999 podStartE2EDuration="4.739232785s" totalImagesPullingTime="3.026405592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:30:42.73710694 +0000 UTC m=+326.956495841" watchObservedRunningTime="2026-07-28 20:30:42.739232785 +0000 UTC m=+326.958621669"
Jul 28 20:30:53.711484 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:30:53.711454    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-54dcc5fbb6-j68vq"
Jul 28 20:34:56.592821 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:56.592780    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6"]
Jul 28 20:34:56.595243 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:56.595218    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6"
Jul 28 20:34:56.599427 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:56.599406    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sx8kt\""
Jul 28 20:34:56.599561 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:56.599426    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 28 20:34:56.599561 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:56.599443    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 28 20:34:56.599561 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:56.599406    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 28 20:34:56.612660 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:56.612634    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6"]
Jul 28 20:34:56.722065 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:56.722034    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70ff8c0a-b860-4a20-a962-8d6b7a2e16f9-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwwp6\" (UID: \"70ff8c0a-b860-4a20-a962-8d6b7a2e16f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6"
Jul 28 20:34:56.722065 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:56.722068    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70ff8c0a-b860-4a20-a962-8d6b7a2e16f9-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwwp6\" (UID: \"70ff8c0a-b860-4a20-a962-8d6b7a2e16f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6"
Jul 28 20:34:56.722284 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:56.722092    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70ff8c0a-b860-4a20-a962-8d6b7a2e16f9-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwwp6\" (UID: \"70ff8c0a-b860-4a20-a962-8d6b7a2e16f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6"
Jul 28 20:34:56.722284 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:56.722127    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70ff8c0a-b860-4a20-a962-8d6b7a2e16f9-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwwp6\" (UID: \"70ff8c0a-b860-4a20-a962-8d6b7a2e16f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6"
Jul 28 20:34:56.722284 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:56.722160    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ch7z\" (UniqueName: \"kubernetes.io/projected/70ff8c0a-b860-4a20-a962-8d6b7a2e16f9-kube-api-access-7ch7z\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwwp6\" (UID: \"70ff8c0a-b860-4a20-a962-8d6b7a2e16f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6"
Jul 28 20:34:56.722284 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:56.722215    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70ff8c0a-b860-4a20-a962-8d6b7a2e16f9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwwp6\" (UID: \"70ff8c0a-b860-4a20-a962-8d6b7a2e16f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6"
Jul 28 20:34:56.822759 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:56.822725    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70ff8c0a-b860-4a20-a962-8d6b7a2e16f9-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwwp6\" (UID: \"70ff8c0a-b860-4a20-a962-8d6b7a2e16f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6"
Jul 28 20:34:56.822920 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:56.822769    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ch7z\" (UniqueName: \"kubernetes.io/projected/70ff8c0a-b860-4a20-a962-8d6b7a2e16f9-kube-api-access-7ch7z\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwwp6\" (UID: \"70ff8c0a-b860-4a20-a962-8d6b7a2e16f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6"
Jul 28 20:34:56.822920 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:56.822833    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70ff8c0a-b860-4a20-a962-8d6b7a2e16f9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwwp6\" (UID: \"70ff8c0a-b860-4a20-a962-8d6b7a2e16f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6"
Jul 28 20:34:56.822920 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:56.822884    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70ff8c0a-b860-4a20-a962-8d6b7a2e16f9-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwwp6\" (UID: \"70ff8c0a-b860-4a20-a962-8d6b7a2e16f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6"
Jul 28 20:34:56.822920 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:56.822910    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70ff8c0a-b860-4a20-a962-8d6b7a2e16f9-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwwp6\" (UID: \"70ff8c0a-b860-4a20-a962-8d6b7a2e16f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6"
Jul 28 20:34:56.823079 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:56.822941    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70ff8c0a-b860-4a20-a962-8d6b7a2e16f9-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwwp6\" (UID: \"70ff8c0a-b860-4a20-a962-8d6b7a2e16f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6"
Jul 28 20:34:56.823190 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:56.823171    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70ff8c0a-b860-4a20-a962-8d6b7a2e16f9-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwwp6\" (UID: \"70ff8c0a-b860-4a20-a962-8d6b7a2e16f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6"
Jul 28 20:34:56.823249 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:56.823224    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70ff8c0a-b860-4a20-a962-8d6b7a2e16f9-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwwp6\" (UID: \"70ff8c0a-b860-4a20-a962-8d6b7a2e16f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6"
Jul 28 20:34:56.823320 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:56.823306    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70ff8c0a-b860-4a20-a962-8d6b7a2e16f9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwwp6\" (UID: \"70ff8c0a-b860-4a20-a962-8d6b7a2e16f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6"
Jul 28 20:34:56.825136 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:56.825110    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70ff8c0a-b860-4a20-a962-8d6b7a2e16f9-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwwp6\" (UID: \"70ff8c0a-b860-4a20-a962-8d6b7a2e16f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6"
Jul 28 20:34:56.825254 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:56.825239    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70ff8c0a-b860-4a20-a962-8d6b7a2e16f9-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwwp6\" (UID: \"70ff8c0a-b860-4a20-a962-8d6b7a2e16f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6"
Jul 28 20:34:56.831034 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:56.831007    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ch7z\" (UniqueName: \"kubernetes.io/projected/70ff8c0a-b860-4a20-a962-8d6b7a2e16f9-kube-api-access-7ch7z\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cwwp6\" (UID: \"70ff8c0a-b860-4a20-a962-8d6b7a2e16f9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6"
Jul 28 20:34:56.906463 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:56.906380    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6"
Jul 28 20:34:57.035968 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:57.035311    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6"]
Jul 28 20:34:57.038160 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:34:57.038129    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70ff8c0a_b860_4a20_a962_8d6b7a2e16f9.slice/crio-718527c7c6f79a09ffce710fbbc3c09dc5d31e1b24c110a112cc5b2c53f6745d WatchSource:0}: Error finding container 718527c7c6f79a09ffce710fbbc3c09dc5d31e1b24c110a112cc5b2c53f6745d: Status 404 returned error can't find the container with id 718527c7c6f79a09ffce710fbbc3c09dc5d31e1b24c110a112cc5b2c53f6745d
Jul 28 20:34:57.793644 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:57.793606    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6" event={"ID":"70ff8c0a-b860-4a20-a962-8d6b7a2e16f9","Type":"ContainerStarted","Data":"718527c7c6f79a09ffce710fbbc3c09dc5d31e1b24c110a112cc5b2c53f6745d"}
Jul 28 20:34:58.799800 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:58.799763    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6" event={"ID":"70ff8c0a-b860-4a20-a962-8d6b7a2e16f9","Type":"ContainerStarted","Data":"7a1e884650a6b2b4a3bca3614eeee5d87b5264b0d38725ca0f816bae59f0fb09"}
Jul 28 20:34:58.819333 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:34:58.819281    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6" podStartSLOduration=1.811877825 podStartE2EDuration="2.819265346s" totalImagesPullingTime="1.007387521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:34:58.81702578 +0000 UTC m=+583.036414667" watchObservedRunningTime="2026-07-28 20:34:58.819265346 +0000 UTC m=+583.038654232"
Jul 28 20:35:06.907495 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:35:06.907457    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6"
Jul 28 20:35:06.907902 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:35:06.907532    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6"
Jul 28 20:35:06.920035 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:35:06.920008    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6"
Jul 28 20:35:07.850599 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:35:07.850565    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cwwp6"
Jul 28 20:48:20.336695 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:20.336661    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"]
Jul 28 20:48:20.339944 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:20.339922    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"
Jul 28 20:48:20.343518 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:20.343497    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-9af4156f-kserve-self-signed-certs\""
Jul 28 20:48:20.387946 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:20.387921    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"]
Jul 28 20:48:20.481200 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:20.481173    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/819cb560-ef9f-4e22-a144-6b08fbe16c3e-tmp-dir\") pod \"e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t\" (UID: \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\") " pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"
Jul 28 20:48:20.481327 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:20.481203    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/819cb560-ef9f-4e22-a144-6b08fbe16c3e-dshm\") pod \"e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t\" (UID: \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\") " pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"
Jul 28 20:48:20.481402 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:20.481331    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/819cb560-ef9f-4e22-a144-6b08fbe16c3e-tls-certs\") pod \"e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t\" (UID: \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\") " pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"
Jul 28 20:48:20.481448 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:20.481406    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vvmr\" (UniqueName: \"kubernetes.io/projected/819cb560-ef9f-4e22-a144-6b08fbe16c3e-kube-api-access-6vvmr\") pod \"e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t\" (UID: \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\") " pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"
Jul 28 20:48:20.481549 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:20.481531    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/819cb560-ef9f-4e22-a144-6b08fbe16c3e-home\") pod \"e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t\" (UID: \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\") " pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"
Jul 28 20:48:20.481594 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:20.481558    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/819cb560-ef9f-4e22-a144-6b08fbe16c3e-model-cache\") pod \"e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t\" (UID: \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\") " pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"
Jul 28 20:48:20.582615 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:20.582589    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/819cb560-ef9f-4e22-a144-6b08fbe16c3e-home\") pod \"e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t\" (UID: \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\") " pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"
Jul 28 20:48:20.582615 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:20.582616    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/819cb560-ef9f-4e22-a144-6b08fbe16c3e-model-cache\") pod \"e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t\" (UID: \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\") " pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"
Jul 28 20:48:20.582783 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:20.582633    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/819cb560-ef9f-4e22-a144-6b08fbe16c3e-tmp-dir\") pod \"e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t\" (UID: \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\") " pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"
Jul 28 20:48:20.582783 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:20.582650    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/819cb560-ef9f-4e22-a144-6b08fbe16c3e-dshm\") pod \"e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t\" (UID: \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\") " pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"
Jul 28 20:48:20.582783 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:20.582718    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/819cb560-ef9f-4e22-a144-6b08fbe16c3e-tls-certs\") pod \"e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t\" (UID: \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\") " pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"
Jul 28 20:48:20.582783 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:20.582762    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vvmr\" (UniqueName: \"kubernetes.io/projected/819cb560-ef9f-4e22-a144-6b08fbe16c3e-kube-api-access-6vvmr\") pod \"e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t\" (UID: \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\") " pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"
Jul 28 20:48:20.583062 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:20.583032    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/819cb560-ef9f-4e22-a144-6b08fbe16c3e-tmp-dir\") pod \"e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t\" (UID: \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\") " pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"
Jul 28 20:48:20.583130 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:20.583089    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/819cb560-ef9f-4e22-a144-6b08fbe16c3e-home\") pod \"e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t\" (UID: \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\") " pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"
Jul 28 20:48:20.583179 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:20.583126    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/819cb560-ef9f-4e22-a144-6b08fbe16c3e-model-cache\") pod \"e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t\" (UID: \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\") " pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"
Jul 28 20:48:20.584789 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:20.584764    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/819cb560-ef9f-4e22-a144-6b08fbe16c3e-dshm\") pod \"e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t\" (UID: \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\") " pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"
Jul 28 20:48:20.585021 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:20.585005    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/819cb560-ef9f-4e22-a144-6b08fbe16c3e-tls-certs\") pod \"e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t\" (UID: \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\") " pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"
Jul 28 20:48:20.595006 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:20.594956    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vvmr\" (UniqueName: \"kubernetes.io/projected/819cb560-ef9f-4e22-a144-6b08fbe16c3e-kube-api-access-6vvmr\") pod \"e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t\" (UID: \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\") " pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"
Jul 28 20:48:20.649292 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:20.649266    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"
Jul 28 20:48:20.790998 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:20.790967    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"]
Jul 28 20:48:20.792705 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:48:20.792683    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod819cb560_ef9f_4e22_a144_6b08fbe16c3e.slice/crio-c8ce1e704dfbbfd122b18f41a33d2e66a319de80ac68bd80135b7307497230bb WatchSource:0}: Error finding container c8ce1e704dfbbfd122b18f41a33d2e66a319de80ac68bd80135b7307497230bb: Status 404 returned error can't find the container with id c8ce1e704dfbbfd122b18f41a33d2e66a319de80ac68bd80135b7307497230bb
Jul 28 20:48:21.262836 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:21.262757    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t" event={"ID":"819cb560-ef9f-4e22-a144-6b08fbe16c3e","Type":"ContainerStarted","Data":"aefe29e8008bffaf1a7e3b130928f928e302bb63e565e75024d9c8c534cc2a53"}
Jul 28 20:48:21.262836 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:21.262793    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t" event={"ID":"819cb560-ef9f-4e22-a144-6b08fbe16c3e","Type":"ContainerStarted","Data":"c8ce1e704dfbbfd122b18f41a33d2e66a319de80ac68bd80135b7307497230bb"}
Jul 28 20:48:21.290718 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:21.290664    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t" podStartSLOduration=1.290649309 podStartE2EDuration="1.290649309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:48:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:48:21.289720442 +0000 UTC m=+1385.509109330" watchObservedRunningTime="2026-07-28 20:48:21.290649309 +0000 UTC m=+1385.510038194"
Jul 28 20:48:30.650061 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:30.650028    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"
Jul 28 20:48:30.650604 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:30.650089    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"
Jul 28 20:48:30.662409 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:30.662387    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"
Jul 28 20:48:31.316337 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:48:31.316305    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"
Jul 28 20:49:00.750435 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:00.750406    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"]
Jul 28 20:49:15.769336 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:15.769251    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t" podUID="819cb560-ef9f-4e22-a144-6b08fbe16c3e" containerName="main" containerID="cri-o://aefe29e8008bffaf1a7e3b130928f928e302bb63e565e75024d9c8c534cc2a53" gracePeriod=45
Jul 28 20:49:16.007988 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:16.007960    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"
Jul 28 20:49:16.050336 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:16.050302    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/819cb560-ef9f-4e22-a144-6b08fbe16c3e-tls-certs\") pod \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\" (UID: \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\") "
Jul 28 20:49:16.050336 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:16.050357    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/819cb560-ef9f-4e22-a144-6b08fbe16c3e-dshm\") pod \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\" (UID: \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\") "
Jul 28 20:49:16.050596 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:16.050392    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/819cb560-ef9f-4e22-a144-6b08fbe16c3e-home\") pod \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\" (UID: \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\") "
Jul 28 20:49:16.050596 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:16.050474    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/819cb560-ef9f-4e22-a144-6b08fbe16c3e-model-cache\") pod \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\" (UID: \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\") "
Jul 28 20:49:16.050596 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:16.050530    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/819cb560-ef9f-4e22-a144-6b08fbe16c3e-tmp-dir\") pod \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\" (UID: \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\") "
Jul 28 20:49:16.050596 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:16.050571    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vvmr\" (UniqueName: \"kubernetes.io/projected/819cb560-ef9f-4e22-a144-6b08fbe16c3e-kube-api-access-6vvmr\") pod \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\" (UID: \"819cb560-ef9f-4e22-a144-6b08fbe16c3e\") "
Jul 28 20:49:16.050789 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:16.050647    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/819cb560-ef9f-4e22-a144-6b08fbe16c3e-home" (OuterVolumeSpecName: "home") pod "819cb560-ef9f-4e22-a144-6b08fbe16c3e" (UID: "819cb560-ef9f-4e22-a144-6b08fbe16c3e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:49:16.050789 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:16.050732    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/819cb560-ef9f-4e22-a144-6b08fbe16c3e-model-cache" (OuterVolumeSpecName: "model-cache") pod "819cb560-ef9f-4e22-a144-6b08fbe16c3e" (UID: "819cb560-ef9f-4e22-a144-6b08fbe16c3e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:49:16.050881 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:16.050814    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/819cb560-ef9f-4e22-a144-6b08fbe16c3e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "819cb560-ef9f-4e22-a144-6b08fbe16c3e" (UID: "819cb560-ef9f-4e22-a144-6b08fbe16c3e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:49:16.050931 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:16.050878    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/819cb560-ef9f-4e22-a144-6b08fbe16c3e-home\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:49:16.050931 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:16.050897    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/819cb560-ef9f-4e22-a144-6b08fbe16c3e-model-cache\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:49:16.052614 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:16.052587    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/819cb560-ef9f-4e22-a144-6b08fbe16c3e-dshm" (OuterVolumeSpecName: "dshm") pod "819cb560-ef9f-4e22-a144-6b08fbe16c3e" (UID: "819cb560-ef9f-4e22-a144-6b08fbe16c3e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:49:16.052614 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:16.052608    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/819cb560-ef9f-4e22-a144-6b08fbe16c3e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "819cb560-ef9f-4e22-a144-6b08fbe16c3e" (UID: "819cb560-ef9f-4e22-a144-6b08fbe16c3e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:49:16.052749 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:16.052666    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/819cb560-ef9f-4e22-a144-6b08fbe16c3e-kube-api-access-6vvmr" (OuterVolumeSpecName: "kube-api-access-6vvmr") pod "819cb560-ef9f-4e22-a144-6b08fbe16c3e" (UID: "819cb560-ef9f-4e22-a144-6b08fbe16c3e"). InnerVolumeSpecName "kube-api-access-6vvmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:49:16.151708 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:16.151678    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/819cb560-ef9f-4e22-a144-6b08fbe16c3e-tmp-dir\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:49:16.151708 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:16.151704    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vvmr\" (UniqueName: \"kubernetes.io/projected/819cb560-ef9f-4e22-a144-6b08fbe16c3e-kube-api-access-6vvmr\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:49:16.151708 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:16.151713    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/819cb560-ef9f-4e22-a144-6b08fbe16c3e-tls-certs\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:49:16.151927 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:16.151722    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/819cb560-ef9f-4e22-a144-6b08fbe16c3e-dshm\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:49:16.502320 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:16.502288    2556 generic.go:356] "Generic (PLEG): container finished" podID="819cb560-ef9f-4e22-a144-6b08fbe16c3e" containerID="aefe29e8008bffaf1a7e3b130928f928e302bb63e565e75024d9c8c534cc2a53" exitCode=0
Jul 28 20:49:16.502503 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:16.502328    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"
Jul 28 20:49:16.502503 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:16.502363    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t" event={"ID":"819cb560-ef9f-4e22-a144-6b08fbe16c3e","Type":"ContainerDied","Data":"aefe29e8008bffaf1a7e3b130928f928e302bb63e565e75024d9c8c534cc2a53"}
Jul 28 20:49:16.502503 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:16.502397    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t" event={"ID":"819cb560-ef9f-4e22-a144-6b08fbe16c3e","Type":"ContainerDied","Data":"c8ce1e704dfbbfd122b18f41a33d2e66a319de80ac68bd80135b7307497230bb"}
Jul 28 20:49:16.503335 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:16.503321    2556 scope.go:117] "RemoveContainer" containerID="aefe29e8008bffaf1a7e3b130928f928e302bb63e565e75024d9c8c534cc2a53"
Jul 28 20:49:16.511281 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:16.511262    2556 scope.go:117] "RemoveContainer" containerID="aefe29e8008bffaf1a7e3b130928f928e302bb63e565e75024d9c8c534cc2a53"
Jul 28 20:49:16.511651 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:49:16.511631    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aefe29e8008bffaf1a7e3b130928f928e302bb63e565e75024d9c8c534cc2a53\": container with ID starting with aefe29e8008bffaf1a7e3b130928f928e302bb63e565e75024d9c8c534cc2a53 not found: ID does not exist" containerID="aefe29e8008bffaf1a7e3b130928f928e302bb63e565e75024d9c8c534cc2a53"
Jul 28 20:49:16.511723 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:16.511664    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aefe29e8008bffaf1a7e3b130928f928e302bb63e565e75024d9c8c534cc2a53"} err="failed to get container status \"aefe29e8008bffaf1a7e3b130928f928e302bb63e565e75024d9c8c534cc2a53\": rpc error: code = NotFound desc = could not find container \"aefe29e8008bffaf1a7e3b130928f928e302bb63e565e75024d9c8c534cc2a53\": container with ID starting with aefe29e8008bffaf1a7e3b130928f928e302bb63e565e75024d9c8c534cc2a53 not found: ID does not exist"
Jul 28 20:49:16.521713 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:16.521688    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"]
Jul 28 20:49:16.527012 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:16.526989    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-9af4156f-kserve-8b546c855-ncw4t"]
Jul 28 20:49:18.312657 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:49:18.312616    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="819cb560-ef9f-4e22-a144-6b08fbe16c3e" path="/var/lib/kubelet/pods/819cb560-ef9f-4e22-a144-6b08fbe16c3e/volumes"
Jul 28 20:53:33.891545 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:33.891512    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"]
Jul 28 20:53:33.892151 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:33.891863    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="819cb560-ef9f-4e22-a144-6b08fbe16c3e" containerName="main"
Jul 28 20:53:33.892151 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:33.891877    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="819cb560-ef9f-4e22-a144-6b08fbe16c3e" containerName="main"
Jul 28 20:53:33.892151 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:33.891946    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="819cb560-ef9f-4e22-a144-6b08fbe16c3e" containerName="main"
Jul 28 20:53:33.895167 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:33.895150    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:33.898019 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:33.898001    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-e4b24854-gw-openshift-default-dockercfg-bvgwz\""
Jul 28 20:53:33.911844 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:33.911821    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"]
Jul 28 20:53:34.041745 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.041711    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1e75964-6a8e-4e30-8859-433d24b216dc-istiod-ca-cert\") pod \"e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") " pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:34.041745 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.041747    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-credential-socket\") pod \"e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") " pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:34.041938 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.041767    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1e75964-6a8e-4e30-8859-433d24b216dc-istio-token\") pod \"e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") " pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:34.041938 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.041795    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-workload-socket\") pod \"e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") " pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:34.041938 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.041815    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-istio-data\") pod \"e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") " pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:34.041938 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.041845    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-workload-certs\") pod \"e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") " pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:34.041938 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.041899    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1e75964-6a8e-4e30-8859-433d24b216dc-istio-podinfo\") pod \"e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") " pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:34.042092 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.041980    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p74z2\" (UniqueName: \"kubernetes.io/projected/d1e75964-6a8e-4e30-8859-433d24b216dc-kube-api-access-p74z2\") pod \"e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") " pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:34.042092 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.042007    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-istio-envoy\") pod \"e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") " pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:34.142760 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.142677    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-istio-envoy\") pod \"e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") " pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:34.142760 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.142722    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1e75964-6a8e-4e30-8859-433d24b216dc-istiod-ca-cert\") pod \"e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") " pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:34.142760 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.142743    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-credential-socket\") pod \"e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") " pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:34.143025 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.142766    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1e75964-6a8e-4e30-8859-433d24b216dc-istio-token\") pod \"e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") " pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:34.143025 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.142794    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-workload-socket\") pod \"e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") " pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:34.143025 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.142813    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-istio-data\") pod \"e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") " pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:34.143025 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.142848    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-workload-certs\") pod \"e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") " pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:34.143025 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.142895    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1e75964-6a8e-4e30-8859-433d24b216dc-istio-podinfo\") pod \"e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") " pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:34.143025 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.142950    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p74z2\" (UniqueName: \"kubernetes.io/projected/d1e75964-6a8e-4e30-8859-433d24b216dc-kube-api-access-p74z2\") pod \"e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") " pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:34.143327 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.143196    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-credential-socket\") pod \"e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") " pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:34.143576 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.143554    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-workload-certs\") pod \"e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") " pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:34.143660 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.143574    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-workload-socket\") pod \"e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") " pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:34.143660 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.143580    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1e75964-6a8e-4e30-8859-433d24b216dc-istiod-ca-cert\") pod \"e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") " pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:34.143660 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.143638    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-istio-data\") pod \"e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") " pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:34.144994 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.144968    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-istio-envoy\") pod \"e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") " pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:34.145598 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.145576    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1e75964-6a8e-4e30-8859-433d24b216dc-istio-podinfo\") pod \"e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") " pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:34.152954 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.152923    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1e75964-6a8e-4e30-8859-433d24b216dc-istio-token\") pod \"e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") " pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:34.154470 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.154449    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p74z2\" (UniqueName: \"kubernetes.io/projected/d1e75964-6a8e-4e30-8859-433d24b216dc-kube-api-access-p74z2\") pod \"e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") " pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:34.205197 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.205172    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:34.341750 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.341728    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"]
Jul 28 20:53:34.343832 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:53:34.343806    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1e75964_6a8e_4e30_8859_433d24b216dc.slice/crio-8f1524d75e8191d0177e3252f329be3d66a913eb07f69c227f1081f891893bc4 WatchSource:0}: Error finding container 8f1524d75e8191d0177e3252f329be3d66a913eb07f69c227f1081f891893bc4: Status 404 returned error can't find the container with id 8f1524d75e8191d0177e3252f329be3d66a913eb07f69c227f1081f891893bc4
Jul 28 20:53:34.345769 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.345750    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 20:53:34.614900 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:34.614866    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc" event={"ID":"d1e75964-6a8e-4e30-8859-433d24b216dc","Type":"ContainerStarted","Data":"8f1524d75e8191d0177e3252f329be3d66a913eb07f69c227f1081f891893bc4"}
Jul 28 20:53:37.087138 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:37.087103    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:53:37.087431 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:37.087174    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:53:37.087431 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:37.087203    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:53:37.631724 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:37.631685    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc" event={"ID":"d1e75964-6a8e-4e30-8859-433d24b216dc","Type":"ContainerStarted","Data":"1c76e0b1c6856bb4546e8bb13d5b660344b508cdf5add72404a0d323ceeba3b7"}
Jul 28 20:53:37.656407 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:37.656339    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc" podStartSLOduration=1.915443397 podStartE2EDuration="4.656324738s" totalImagesPullingTime="2.740881341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:53:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:53:37.654648771 +0000 UTC m=+1701.874037657" watchObservedRunningTime="2026-07-28 20:53:37.656324738 +0000 UTC m=+1701.875713620"
Jul 28 20:53:38.205406 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:38.205367    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:38.210274 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:38.210249    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:38.636246 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:38.636214    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:38.637257 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:38.637240    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:50.691434 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:50.691334    2556 generic.go:356] "Generic (PLEG): container finished" podID="d1e75964-6a8e-4e30-8859-433d24b216dc" containerID="1c76e0b1c6856bb4546e8bb13d5b660344b508cdf5add72404a0d323ceeba3b7" exitCode=0
Jul 28 20:53:50.691434 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:50.691405    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc" event={"ID":"d1e75964-6a8e-4e30-8859-433d24b216dc","Type":"ContainerDied","Data":"1c76e0b1c6856bb4546e8bb13d5b660344b508cdf5add72404a0d323ceeba3b7"}
Jul 28 20:53:50.691852 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:50.691770    2556 scope.go:117] "RemoveContainer" containerID="1c76e0b1c6856bb4546e8bb13d5b660344b508cdf5add72404a0d323ceeba3b7"
Jul 28 20:53:50.692705 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:50.692681    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:53:50.692766 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:50.692741    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:53:50.692801 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:50.692772    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:53:51.700378 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:51.700323    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc" event={"ID":"d1e75964-6a8e-4e30-8859-433d24b216dc","Type":"ContainerStarted","Data":"c5d42b48402a98ed4f732c59f310eafe54633a738890497f53592c6b423caab6"}
Jul 28 20:53:52.206134 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:52.206095    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:52.207283 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:52.207257    2556 patch_prober.go:28] interesting pod/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body=
Jul 28 20:53:52.207404 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:52.207308    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc" podUID="d1e75964-6a8e-4e30-8859-433d24b216dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused"
Jul 28 20:53:53.206607 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:53.206568    2556 patch_prober.go:28] interesting pod/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body=
Jul 28 20:53:53.207008 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:53.206627    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc" podUID="d1e75964-6a8e-4e30-8859-433d24b216dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused"
Jul 28 20:53:53.636516 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:53.636483    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:54.205765 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:54.205726    2556 patch_prober.go:28] interesting pod/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body=
Jul 28 20:53:54.205935 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:54.205784    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc" podUID="d1e75964-6a8e-4e30-8859-433d24b216dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused"
Jul 28 20:53:55.206254 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:55.206214    2556 patch_prober.go:28] interesting pod/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body=
Jul 28 20:53:55.206683 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:55.206289    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc" podUID="d1e75964-6a8e-4e30-8859-433d24b216dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused"
Jul 28 20:53:56.210259 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:56.210230    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:53:56.211233 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:53:56.211215    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:54:11.051097 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:11.051066    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"]
Jul 28 20:54:11.051608 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:11.051264    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc" podUID="d1e75964-6a8e-4e30-8859-433d24b216dc" containerName="istio-proxy" containerID="cri-o://c5d42b48402a98ed4f732c59f310eafe54633a738890497f53592c6b423caab6" gracePeriod=30
Jul 28 20:54:11.212525 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:11.212487    2556 patch_prober.go:28] interesting pod/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 20:54:11.212675 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:11.212548    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc" podUID="d1e75964-6a8e-4e30-8859-433d24b216dc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 20:54:16.313520 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.313459    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:54:16.403856 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.403825    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-istio-data\") pod \"d1e75964-6a8e-4e30-8859-433d24b216dc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") "
Jul 28 20:54:16.403983 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.403897    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-workload-certs\") pod \"d1e75964-6a8e-4e30-8859-433d24b216dc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") "
Jul 28 20:54:16.403983 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.403929    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1e75964-6a8e-4e30-8859-433d24b216dc-istiod-ca-cert\") pod \"d1e75964-6a8e-4e30-8859-433d24b216dc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") "
Jul 28 20:54:16.404086 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.403987    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-credential-socket\") pod \"d1e75964-6a8e-4e30-8859-433d24b216dc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") "
Jul 28 20:54:16.404086 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.404018    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1e75964-6a8e-4e30-8859-433d24b216dc-istio-podinfo\") pod \"d1e75964-6a8e-4e30-8859-433d24b216dc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") "
Jul 28 20:54:16.404188 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.404148    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p74z2\" (UniqueName: \"kubernetes.io/projected/d1e75964-6a8e-4e30-8859-433d24b216dc-kube-api-access-p74z2\") pod \"d1e75964-6a8e-4e30-8859-433d24b216dc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") "
Jul 28 20:54:16.404188 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.404167    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d1e75964-6a8e-4e30-8859-433d24b216dc" (UID: "d1e75964-6a8e-4e30-8859-433d24b216dc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:54:16.404336 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.404193    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-workload-socket\") pod \"d1e75964-6a8e-4e30-8859-433d24b216dc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") "
Jul 28 20:54:16.404336 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.404231    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1e75964-6a8e-4e30-8859-433d24b216dc-istio-token\") pod \"d1e75964-6a8e-4e30-8859-433d24b216dc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") "
Jul 28 20:54:16.404336 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.404257    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-istio-envoy\") pod \"d1e75964-6a8e-4e30-8859-433d24b216dc\" (UID: \"d1e75964-6a8e-4e30-8859-433d24b216dc\") "
Jul 28 20:54:16.404656 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.404603    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-istio-data" (OuterVolumeSpecName: "istio-data") pod "d1e75964-6a8e-4e30-8859-433d24b216dc" (UID: "d1e75964-6a8e-4e30-8859-433d24b216dc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:54:16.404656 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.404640    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-workload-certs\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:54:16.404940 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.404830    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d1e75964-6a8e-4e30-8859-433d24b216dc" (UID: "d1e75964-6a8e-4e30-8859-433d24b216dc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:54:16.405100 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.405060    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1e75964-6a8e-4e30-8859-433d24b216dc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d1e75964-6a8e-4e30-8859-433d24b216dc" (UID: "d1e75964-6a8e-4e30-8859-433d24b216dc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:54:16.405201 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.405101    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d1e75964-6a8e-4e30-8859-433d24b216dc" (UID: "d1e75964-6a8e-4e30-8859-433d24b216dc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:54:16.407048 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.407026    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d1e75964-6a8e-4e30-8859-433d24b216dc" (UID: "d1e75964-6a8e-4e30-8859-433d24b216dc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:54:16.407155 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.407044    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1e75964-6a8e-4e30-8859-433d24b216dc-istio-token" (OuterVolumeSpecName: "istio-token") pod "d1e75964-6a8e-4e30-8859-433d24b216dc" (UID: "d1e75964-6a8e-4e30-8859-433d24b216dc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:54:16.407155 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.407092    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d1e75964-6a8e-4e30-8859-433d24b216dc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d1e75964-6a8e-4e30-8859-433d24b216dc" (UID: "d1e75964-6a8e-4e30-8859-433d24b216dc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:54:16.407226 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.407175    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1e75964-6a8e-4e30-8859-433d24b216dc-kube-api-access-p74z2" (OuterVolumeSpecName: "kube-api-access-p74z2") pod "d1e75964-6a8e-4e30-8859-433d24b216dc" (UID: "d1e75964-6a8e-4e30-8859-433d24b216dc"). InnerVolumeSpecName "kube-api-access-p74z2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:54:16.505495 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.505467    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-credential-socket\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:54:16.505495 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.505495    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1e75964-6a8e-4e30-8859-433d24b216dc-istio-podinfo\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:54:16.505643 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.505508    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p74z2\" (UniqueName: \"kubernetes.io/projected/d1e75964-6a8e-4e30-8859-433d24b216dc-kube-api-access-p74z2\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:54:16.505643 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.505517    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-workload-socket\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:54:16.505643 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.505525    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1e75964-6a8e-4e30-8859-433d24b216dc-istio-token\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:54:16.505643 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.505533    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-istio-envoy\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:54:16.505643 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.505540    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1e75964-6a8e-4e30-8859-433d24b216dc-istio-data\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:54:16.505643 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.505547    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1e75964-6a8e-4e30-8859-433d24b216dc-istiod-ca-cert\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:54:16.809668 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.809634    2556 generic.go:356] "Generic (PLEG): container finished" podID="d1e75964-6a8e-4e30-8859-433d24b216dc" containerID="c5d42b48402a98ed4f732c59f310eafe54633a738890497f53592c6b423caab6" exitCode=0
Jul 28 20:54:16.809826 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.809691    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"
Jul 28 20:54:16.809826 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.809715    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc" event={"ID":"d1e75964-6a8e-4e30-8859-433d24b216dc","Type":"ContainerDied","Data":"c5d42b48402a98ed4f732c59f310eafe54633a738890497f53592c6b423caab6"}
Jul 28 20:54:16.809826 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.809767    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc" event={"ID":"d1e75964-6a8e-4e30-8859-433d24b216dc","Type":"ContainerDied","Data":"8f1524d75e8191d0177e3252f329be3d66a913eb07f69c227f1081f891893bc4"}
Jul 28 20:54:16.809826 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.809791    2556 scope.go:117] "RemoveContainer" containerID="c5d42b48402a98ed4f732c59f310eafe54633a738890497f53592c6b423caab6"
Jul 28 20:54:16.818921 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.818902    2556 scope.go:117] "RemoveContainer" containerID="1c76e0b1c6856bb4546e8bb13d5b660344b508cdf5add72404a0d323ceeba3b7"
Jul 28 20:54:16.826129 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.826111    2556 scope.go:117] "RemoveContainer" containerID="c5d42b48402a98ed4f732c59f310eafe54633a738890497f53592c6b423caab6"
Jul 28 20:54:16.826409 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:54:16.826387    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5d42b48402a98ed4f732c59f310eafe54633a738890497f53592c6b423caab6\": container with ID starting with c5d42b48402a98ed4f732c59f310eafe54633a738890497f53592c6b423caab6 not found: ID does not exist" containerID="c5d42b48402a98ed4f732c59f310eafe54633a738890497f53592c6b423caab6"
Jul 28 20:54:16.826469 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.826422    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5d42b48402a98ed4f732c59f310eafe54633a738890497f53592c6b423caab6"} err="failed to get container status \"c5d42b48402a98ed4f732c59f310eafe54633a738890497f53592c6b423caab6\": rpc error: code = NotFound desc = could not find container \"c5d42b48402a98ed4f732c59f310eafe54633a738890497f53592c6b423caab6\": container with ID starting with c5d42b48402a98ed4f732c59f310eafe54633a738890497f53592c6b423caab6 not found: ID does not exist"
Jul 28 20:54:16.826469 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.826448    2556 scope.go:117] "RemoveContainer" containerID="1c76e0b1c6856bb4546e8bb13d5b660344b508cdf5add72404a0d323ceeba3b7"
Jul 28 20:54:16.826667 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:54:16.826649    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c76e0b1c6856bb4546e8bb13d5b660344b508cdf5add72404a0d323ceeba3b7\": container with ID starting with 1c76e0b1c6856bb4546e8bb13d5b660344b508cdf5add72404a0d323ceeba3b7 not found: ID does not exist" containerID="1c76e0b1c6856bb4546e8bb13d5b660344b508cdf5add72404a0d323ceeba3b7"
Jul 28 20:54:16.826727 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.826679    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c76e0b1c6856bb4546e8bb13d5b660344b508cdf5add72404a0d323ceeba3b7"} err="failed to get container status \"1c76e0b1c6856bb4546e8bb13d5b660344b508cdf5add72404a0d323ceeba3b7\": rpc error: code = NotFound desc = could not find container \"1c76e0b1c6856bb4546e8bb13d5b660344b508cdf5add72404a0d323ceeba3b7\": container with ID starting with 1c76e0b1c6856bb4546e8bb13d5b660344b508cdf5add72404a0d323ceeba3b7 not found: ID does not exist"
Jul 28 20:54:16.833207 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.833185    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"]
Jul 28 20:54:16.837321 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:16.837301    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-e4b24854-gw-openshift-default-6df4dcbb64-k4wdc"]
Jul 28 20:54:18.313094 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:18.313060    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1e75964-6a8e-4e30-8859-433d24b216dc" path="/var/lib/kubelet/pods/d1e75964-6a8e-4e30-8859-433d24b216dc/volumes"
Jul 28 20:54:47.261726 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.261692    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"]
Jul 28 20:54:47.262233 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.262033    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1e75964-6a8e-4e30-8859-433d24b216dc" containerName="istio-proxy"
Jul 28 20:54:47.262233 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.262044    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1e75964-6a8e-4e30-8859-433d24b216dc" containerName="istio-proxy"
Jul 28 20:54:47.262233 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.262099    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1e75964-6a8e-4e30-8859-433d24b216dc" containerName="istio-proxy"
Jul 28 20:54:47.262233 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.262107    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1e75964-6a8e-4e30-8859-433d24b216dc" containerName="istio-proxy"
Jul 28 20:54:47.265310 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.265289    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.270200 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.270182    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-4871db53-openshift-default-dockercfg-d2mhm\""
Jul 28 20:54:47.279666 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.279641    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"]
Jul 28 20:54:47.364760 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.364717    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istio-token\") pod \"e2e-derive-4871db53-openshift-default-559474d88-6fl8g\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") " pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.364760 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.364763    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istio-data\") pod \"e2e-derive-4871db53-openshift-default-559474d88-6fl8g\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") " pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.364962 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.364781    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istio-envoy\") pod \"e2e-derive-4871db53-openshift-default-559474d88-6fl8g\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") " pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.364962 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.364865    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-credential-socket\") pod \"e2e-derive-4871db53-openshift-default-559474d88-6fl8g\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") " pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.364962 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.364906    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-workload-certs\") pod \"e2e-derive-4871db53-openshift-default-559474d88-6fl8g\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") " pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.364962 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.364929    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgzzl\" (UniqueName: \"kubernetes.io/projected/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-kube-api-access-lgzzl\") pod \"e2e-derive-4871db53-openshift-default-559474d88-6fl8g\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") " pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.364962 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.364949    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-workload-socket\") pod \"e2e-derive-4871db53-openshift-default-559474d88-6fl8g\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") " pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.365111 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.364966    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istio-podinfo\") pod \"e2e-derive-4871db53-openshift-default-559474d88-6fl8g\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") " pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.365111 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.364992    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istiod-ca-cert\") pod \"e2e-derive-4871db53-openshift-default-559474d88-6fl8g\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") " pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.465380 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.465327    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istiod-ca-cert\") pod \"e2e-derive-4871db53-openshift-default-559474d88-6fl8g\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") " pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.465553 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.465391    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istio-token\") pod \"e2e-derive-4871db53-openshift-default-559474d88-6fl8g\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") " pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.465553 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.465414    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istio-data\") pod \"e2e-derive-4871db53-openshift-default-559474d88-6fl8g\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") " pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.465553 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.465434    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istio-envoy\") pod \"e2e-derive-4871db53-openshift-default-559474d88-6fl8g\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") " pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.465553 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.465471    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-credential-socket\") pod \"e2e-derive-4871db53-openshift-default-559474d88-6fl8g\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") " pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.465553 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.465509    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-workload-certs\") pod \"e2e-derive-4871db53-openshift-default-559474d88-6fl8g\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") " pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.465810 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.465785    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgzzl\" (UniqueName: \"kubernetes.io/projected/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-kube-api-access-lgzzl\") pod \"e2e-derive-4871db53-openshift-default-559474d88-6fl8g\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") " pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.465868 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.465836    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-workload-socket\") pod \"e2e-derive-4871db53-openshift-default-559474d88-6fl8g\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") " pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.465868 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.465852    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-credential-socket\") pod \"e2e-derive-4871db53-openshift-default-559474d88-6fl8g\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") " pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.465966 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.465867    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istio-podinfo\") pod \"e2e-derive-4871db53-openshift-default-559474d88-6fl8g\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") " pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.465966 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.465919    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istio-data\") pod \"e2e-derive-4871db53-openshift-default-559474d88-6fl8g\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") " pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.465966 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.465946    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-workload-certs\") pod \"e2e-derive-4871db53-openshift-default-559474d88-6fl8g\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") " pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.466140 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.466120    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istiod-ca-cert\") pod \"e2e-derive-4871db53-openshift-default-559474d88-6fl8g\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") " pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.466309 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.466287    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-workload-socket\") pod \"e2e-derive-4871db53-openshift-default-559474d88-6fl8g\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") " pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.467904 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.467885    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istio-envoy\") pod \"e2e-derive-4871db53-openshift-default-559474d88-6fl8g\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") " pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.468199 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.468183    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istio-podinfo\") pod \"e2e-derive-4871db53-openshift-default-559474d88-6fl8g\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") " pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.475929 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.475900    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgzzl\" (UniqueName: \"kubernetes.io/projected/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-kube-api-access-lgzzl\") pod \"e2e-derive-4871db53-openshift-default-559474d88-6fl8g\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") " pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.476014 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.475939    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istio-token\") pod \"e2e-derive-4871db53-openshift-default-559474d88-6fl8g\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") " pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.577271 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.577239    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:47.723434 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.723409    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"]
Jul 28 20:54:47.726059 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:54:47.726031    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd79bef5a_9c1e_4060_b936_b0d0ba132e9b.slice/crio-596d6108621952cc6a30fcfebf8e1a71bf2e09b98243f09fd5944356e9728ebf WatchSource:0}: Error finding container 596d6108621952cc6a30fcfebf8e1a71bf2e09b98243f09fd5944356e9728ebf: Status 404 returned error can't find the container with id 596d6108621952cc6a30fcfebf8e1a71bf2e09b98243f09fd5944356e9728ebf
Jul 28 20:54:47.728221 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.728194    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:54:47.728315 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.728269    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:54:47.728315 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.728311    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:54:47.954608 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.954508    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g" event={"ID":"d79bef5a-9c1e-4060-b936-b0d0ba132e9b","Type":"ContainerStarted","Data":"04fda827b68954c275bef0cdf73f4100993e5095a56ca06665a01552b337126e"}
Jul 28 20:54:47.954608 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.954578    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g" event={"ID":"d79bef5a-9c1e-4060-b936-b0d0ba132e9b","Type":"ContainerStarted","Data":"596d6108621952cc6a30fcfebf8e1a71bf2e09b98243f09fd5944356e9728ebf"}
Jul 28 20:54:47.979133 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:47.979086    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g" podStartSLOduration=0.979068898 podStartE2EDuration="979.068898ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:54:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:54:47.97767715 +0000 UTC m=+1772.197066039" watchObservedRunningTime="2026-07-28 20:54:47.979068898 +0000 UTC m=+1772.198457782"
Jul 28 20:54:48.577506 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:48.577475    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:48.582503 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:48.582478    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:48.959156 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:48.959068    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:54:48.960004 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:54:48.959987    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:55:03.024904 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:03.024869    2556 generic.go:356] "Generic (PLEG): container finished" podID="d79bef5a-9c1e-4060-b936-b0d0ba132e9b" containerID="04fda827b68954c275bef0cdf73f4100993e5095a56ca06665a01552b337126e" exitCode=0
Jul 28 20:55:03.025295 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:03.024945    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g" event={"ID":"d79bef5a-9c1e-4060-b936-b0d0ba132e9b","Type":"ContainerDied","Data":"04fda827b68954c275bef0cdf73f4100993e5095a56ca06665a01552b337126e"}
Jul 28 20:55:03.025339 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:03.025304    2556 scope.go:117] "RemoveContainer" containerID="04fda827b68954c275bef0cdf73f4100993e5095a56ca06665a01552b337126e"
Jul 28 20:55:03.026260 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:03.026237    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:55:03.026315 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:03.026297    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:55:03.026372 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:03.026328    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:55:03.959915 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:03.959884    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:55:04.030969 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:04.030938    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g" event={"ID":"d79bef5a-9c1e-4060-b936-b0d0ba132e9b","Type":"ContainerStarted","Data":"cf30b69cabea76f2fefd360ee0644c3d0ddbc640d80fe1f18be4453cb498af72"}
Jul 28 20:55:04.579021 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:04.578993    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:55:04.579361 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:04.579321    2556 patch_prober.go:28] interesting pod/e2e-derive-4871db53-openshift-default-559474d88-6fl8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Jul 28 20:55:04.579532 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:04.579503    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g" podUID="d79bef5a-9c1e-4060-b936-b0d0ba132e9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Jul 28 20:55:05.581369 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:05.578449    2556 patch_prober.go:28] interesting pod/e2e-derive-4871db53-openshift-default-559474d88-6fl8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Jul 28 20:55:05.581369 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:05.578529    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g" podUID="d79bef5a-9c1e-4060-b936-b0d0ba132e9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Jul 28 20:55:06.578705 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:06.578668    2556 patch_prober.go:28] interesting pod/e2e-derive-4871db53-openshift-default-559474d88-6fl8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Jul 28 20:55:06.579004 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:06.578974    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g" podUID="d79bef5a-9c1e-4060-b936-b0d0ba132e9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Jul 28 20:55:07.578282 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:07.578243    2556 patch_prober.go:28] interesting pod/e2e-derive-4871db53-openshift-default-559474d88-6fl8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Jul 28 20:55:07.578786 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:07.578313    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g" podUID="d79bef5a-9c1e-4060-b936-b0d0ba132e9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Jul 28 20:55:08.582044 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:08.582014    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:55:08.582426 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:08.582374    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:55:08.583103 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:08.583086    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:55:30.492502 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:30.492464    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"]
Jul 28 20:55:30.492989 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:30.492707    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g" podUID="d79bef5a-9c1e-4060-b936-b0d0ba132e9b" containerName="istio-proxy" containerID="cri-o://cf30b69cabea76f2fefd360ee0644c3d0ddbc640d80fe1f18be4453cb498af72" gracePeriod=30
Jul 28 20:55:35.746941 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:35.746914    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:55:35.808262 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:35.808233    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-credential-socket\") pod \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") "
Jul 28 20:55:35.808444 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:35.808284    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-workload-socket\") pod \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") "
Jul 28 20:55:35.808444 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:35.808301    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-workload-certs\") pod \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") "
Jul 28 20:55:35.808444 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:35.808318    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istio-podinfo\") pod \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") "
Jul 28 20:55:35.808444 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:35.808339    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istio-token\") pod \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") "
Jul 28 20:55:35.808444 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:35.808407    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istiod-ca-cert\") pod \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") "
Jul 28 20:55:35.808711 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:35.808449    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istio-envoy\") pod \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") "
Jul 28 20:55:35.808711 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:35.808481    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgzzl\" (UniqueName: \"kubernetes.io/projected/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-kube-api-access-lgzzl\") pod \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") "
Jul 28 20:55:35.808711 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:35.808509    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istio-data\") pod \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\" (UID: \"d79bef5a-9c1e-4060-b936-b0d0ba132e9b\") "
Jul 28 20:55:35.808711 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:35.808542    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d79bef5a-9c1e-4060-b936-b0d0ba132e9b" (UID: "d79bef5a-9c1e-4060-b936-b0d0ba132e9b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:55:35.808711 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:35.808565    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d79bef5a-9c1e-4060-b936-b0d0ba132e9b" (UID: "d79bef5a-9c1e-4060-b936-b0d0ba132e9b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:55:35.808711 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:35.808612    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d79bef5a-9c1e-4060-b936-b0d0ba132e9b" (UID: "d79bef5a-9c1e-4060-b936-b0d0ba132e9b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:55:35.808969 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:35.808825    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-credential-socket\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:55:35.808969 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:35.808844    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-workload-socket\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:55:35.808969 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:35.808859    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-workload-certs\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:55:35.808969 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:35.808951    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d79bef5a-9c1e-4060-b936-b0d0ba132e9b" (UID: "d79bef5a-9c1e-4060-b936-b0d0ba132e9b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:55:35.809481 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:35.809458    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istio-data" (OuterVolumeSpecName: "istio-data") pod "d79bef5a-9c1e-4060-b936-b0d0ba132e9b" (UID: "d79bef5a-9c1e-4060-b936-b0d0ba132e9b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:55:35.810572 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:35.810553    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d79bef5a-9c1e-4060-b936-b0d0ba132e9b" (UID: "d79bef5a-9c1e-4060-b936-b0d0ba132e9b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:55:35.810640 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:35.810580    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istio-token" (OuterVolumeSpecName: "istio-token") pod "d79bef5a-9c1e-4060-b936-b0d0ba132e9b" (UID: "d79bef5a-9c1e-4060-b936-b0d0ba132e9b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:55:35.810991 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:35.810969    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d79bef5a-9c1e-4060-b936-b0d0ba132e9b" (UID: "d79bef5a-9c1e-4060-b936-b0d0ba132e9b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:55:35.810991 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:35.810977    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-kube-api-access-lgzzl" (OuterVolumeSpecName: "kube-api-access-lgzzl") pod "d79bef5a-9c1e-4060-b936-b0d0ba132e9b" (UID: "d79bef5a-9c1e-4060-b936-b0d0ba132e9b"). InnerVolumeSpecName "kube-api-access-lgzzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:55:35.909494 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:35.909470    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istio-podinfo\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:55:35.909494 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:35.909492    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istio-token\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:55:35.909494 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:35.909501    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istiod-ca-cert\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:55:35.909714 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:35.909509    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istio-envoy\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:55:35.909714 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:35.909518    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgzzl\" (UniqueName: \"kubernetes.io/projected/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-kube-api-access-lgzzl\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:55:35.909714 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:35.909526    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d79bef5a-9c1e-4060-b936-b0d0ba132e9b-istio-data\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:55:36.171770 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:36.171683    2556 generic.go:356] "Generic (PLEG): container finished" podID="d79bef5a-9c1e-4060-b936-b0d0ba132e9b" containerID="cf30b69cabea76f2fefd360ee0644c3d0ddbc640d80fe1f18be4453cb498af72" exitCode=0
Jul 28 20:55:36.171770 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:36.171724    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g" event={"ID":"d79bef5a-9c1e-4060-b936-b0d0ba132e9b","Type":"ContainerDied","Data":"cf30b69cabea76f2fefd360ee0644c3d0ddbc640d80fe1f18be4453cb498af72"}
Jul 28 20:55:36.171939 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:36.171776    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g" event={"ID":"d79bef5a-9c1e-4060-b936-b0d0ba132e9b","Type":"ContainerDied","Data":"596d6108621952cc6a30fcfebf8e1a71bf2e09b98243f09fd5944356e9728ebf"}
Jul 28 20:55:36.171939 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:36.171798    2556 scope.go:117] "RemoveContainer" containerID="cf30b69cabea76f2fefd360ee0644c3d0ddbc640d80fe1f18be4453cb498af72"
Jul 28 20:55:36.171939 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:36.171726    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"
Jul 28 20:55:36.181354 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:36.181324    2556 scope.go:117] "RemoveContainer" containerID="04fda827b68954c275bef0cdf73f4100993e5095a56ca06665a01552b337126e"
Jul 28 20:55:36.188867 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:36.188849    2556 scope.go:117] "RemoveContainer" containerID="cf30b69cabea76f2fefd360ee0644c3d0ddbc640d80fe1f18be4453cb498af72"
Jul 28 20:55:36.189107 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:55:36.189089    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf30b69cabea76f2fefd360ee0644c3d0ddbc640d80fe1f18be4453cb498af72\": container with ID starting with cf30b69cabea76f2fefd360ee0644c3d0ddbc640d80fe1f18be4453cb498af72 not found: ID does not exist" containerID="cf30b69cabea76f2fefd360ee0644c3d0ddbc640d80fe1f18be4453cb498af72"
Jul 28 20:55:36.189165 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:36.189113    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf30b69cabea76f2fefd360ee0644c3d0ddbc640d80fe1f18be4453cb498af72"} err="failed to get container status \"cf30b69cabea76f2fefd360ee0644c3d0ddbc640d80fe1f18be4453cb498af72\": rpc error: code = NotFound desc = could not find container \"cf30b69cabea76f2fefd360ee0644c3d0ddbc640d80fe1f18be4453cb498af72\": container with ID starting with cf30b69cabea76f2fefd360ee0644c3d0ddbc640d80fe1f18be4453cb498af72 not found: ID does not exist"
Jul 28 20:55:36.189165 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:36.189129    2556 scope.go:117] "RemoveContainer" containerID="04fda827b68954c275bef0cdf73f4100993e5095a56ca06665a01552b337126e"
Jul 28 20:55:36.189334 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:55:36.189314    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04fda827b68954c275bef0cdf73f4100993e5095a56ca06665a01552b337126e\": container with ID starting with 04fda827b68954c275bef0cdf73f4100993e5095a56ca06665a01552b337126e not found: ID does not exist" containerID="04fda827b68954c275bef0cdf73f4100993e5095a56ca06665a01552b337126e"
Jul 28 20:55:36.189394 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:36.189360    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04fda827b68954c275bef0cdf73f4100993e5095a56ca06665a01552b337126e"} err="failed to get container status \"04fda827b68954c275bef0cdf73f4100993e5095a56ca06665a01552b337126e\": rpc error: code = NotFound desc = could not find container \"04fda827b68954c275bef0cdf73f4100993e5095a56ca06665a01552b337126e\": container with ID starting with 04fda827b68954c275bef0cdf73f4100993e5095a56ca06665a01552b337126e not found: ID does not exist"
Jul 28 20:55:36.193938 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:36.193915    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"]
Jul 28 20:55:36.198273 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:36.198253    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-4871db53-openshift-default-559474d88-6fl8g"]
Jul 28 20:55:36.312759 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:55:36.312730    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d79bef5a-9c1e-4060-b936-b0d0ba132e9b" path="/var/lib/kubelet/pods/d79bef5a-9c1e-4060-b936-b0d0ba132e9b/volumes"
Jul 28 20:57:15.302497 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.302463    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"]
Jul 28 20:57:15.302958 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.302794    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1e75964-6a8e-4e30-8859-433d24b216dc" containerName="istio-proxy"
Jul 28 20:57:15.302958 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.302805    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1e75964-6a8e-4e30-8859-433d24b216dc" containerName="istio-proxy"
Jul 28 20:57:15.302958 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.302812    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d79bef5a-9c1e-4060-b936-b0d0ba132e9b" containerName="istio-proxy"
Jul 28 20:57:15.302958 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.302819    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d79bef5a-9c1e-4060-b936-b0d0ba132e9b" containerName="istio-proxy"
Jul 28 20:57:15.302958 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.302828    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d79bef5a-9c1e-4060-b936-b0d0ba132e9b" containerName="istio-proxy"
Jul 28 20:57:15.302958 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.302834    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d79bef5a-9c1e-4060-b936-b0d0ba132e9b" containerName="istio-proxy"
Jul 28 20:57:15.302958 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.302892    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d79bef5a-9c1e-4060-b936-b0d0ba132e9b" containerName="istio-proxy"
Jul 28 20:57:15.302958 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.302898    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d79bef5a-9c1e-4060-b936-b0d0ba132e9b" containerName="istio-proxy"
Jul 28 20:57:15.305966 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.305945    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.308715 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.308692    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-2c06c6bc-openshift-default-dockercfg-75w2c\""
Jul 28 20:57:15.325937 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.325915    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/397bf19f-07b3-4875-a31a-6f88dbb7153c-istio-token\") pod \"e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") " pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.326061 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.325955    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-istio-envoy\") pod \"e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") " pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.326061 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.325998    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/397bf19f-07b3-4875-a31a-6f88dbb7153c-istiod-ca-cert\") pod \"e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") " pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.326061 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.326056    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-istio-data\") pod \"e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") " pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.326244 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.326075    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/397bf19f-07b3-4875-a31a-6f88dbb7153c-istio-podinfo\") pod \"e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") " pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.326244 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.326104    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-credential-socket\") pod \"e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") " pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.326244 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.326151    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-workload-socket\") pod \"e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") " pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.326244 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.326212    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"]
Jul 28 20:57:15.326244 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.326226    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-workload-certs\") pod \"e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") " pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.326463 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.326250    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xppx6\" (UniqueName: \"kubernetes.io/projected/397bf19f-07b3-4875-a31a-6f88dbb7153c-kube-api-access-xppx6\") pod \"e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") " pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.426812 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.426777    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-workload-socket\") pod \"e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") " pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.426989 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.426829    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-workload-certs\") pod \"e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") " pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.426989 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.426846    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xppx6\" (UniqueName: \"kubernetes.io/projected/397bf19f-07b3-4875-a31a-6f88dbb7153c-kube-api-access-xppx6\") pod \"e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") " pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.426989 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.426878    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/397bf19f-07b3-4875-a31a-6f88dbb7153c-istio-token\") pod \"e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") " pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.426989 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.426897    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-istio-envoy\") pod \"e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") " pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.426989 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.426918    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/397bf19f-07b3-4875-a31a-6f88dbb7153c-istiod-ca-cert\") pod \"e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") " pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.426989 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.426953    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-istio-data\") pod \"e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") " pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.426989 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.426976    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/397bf19f-07b3-4875-a31a-6f88dbb7153c-istio-podinfo\") pod \"e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") " pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.427407 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.427005    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-credential-socket\") pod \"e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") " pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.427407 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.427225    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-workload-certs\") pod \"e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") " pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.427407 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.427276    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-workload-socket\") pod \"e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") " pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.427407 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.427378    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-credential-socket\") pod \"e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") " pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.427541 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.427419    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-istio-data\") pod \"e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") " pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.427630 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.427613    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/397bf19f-07b3-4875-a31a-6f88dbb7153c-istiod-ca-cert\") pod \"e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") " pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.429359 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.429327    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-istio-envoy\") pod \"e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") " pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.429524 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.429507    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/397bf19f-07b3-4875-a31a-6f88dbb7153c-istio-podinfo\") pod \"e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") " pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.434733 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.434710    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/397bf19f-07b3-4875-a31a-6f88dbb7153c-istio-token\") pod \"e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") " pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.435007 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.434990    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xppx6\" (UniqueName: \"kubernetes.io/projected/397bf19f-07b3-4875-a31a-6f88dbb7153c-kube-api-access-xppx6\") pod \"e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") " pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.616426 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.616319    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:15.786814 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.786789    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"]
Jul 28 20:57:15.789223 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:57:15.789194    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod397bf19f_07b3_4875_a31a_6f88dbb7153c.slice/crio-266b4e6d959ea61eef060e6047420ff35c92533fa9403846c80d46a64ed7ca2b WatchSource:0}: Error finding container 266b4e6d959ea61eef060e6047420ff35c92533fa9403846c80d46a64ed7ca2b: Status 404 returned error can't find the container with id 266b4e6d959ea61eef060e6047420ff35c92533fa9403846c80d46a64ed7ca2b
Jul 28 20:57:15.791541 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.791515    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:57:15.791611 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.791575    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:57:15.791611 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:15.791603    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:57:16.597868 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:16.597831    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs" event={"ID":"397bf19f-07b3-4875-a31a-6f88dbb7153c","Type":"ContainerStarted","Data":"13620af846eceea4c34a54d0757e39bf24ee9123c5e280f0abb89996b8a079ee"}
Jul 28 20:57:16.598251 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:16.597908    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs" event={"ID":"397bf19f-07b3-4875-a31a-6f88dbb7153c","Type":"ContainerStarted","Data":"266b4e6d959ea61eef060e6047420ff35c92533fa9403846c80d46a64ed7ca2b"}
Jul 28 20:57:16.616847 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:16.616817    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:16.617901 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:16.617863    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs" podStartSLOduration=1.617850785 podStartE2EDuration="1.617850785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:57:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:57:16.616554867 +0000 UTC m=+1920.835943779" watchObservedRunningTime="2026-07-28 20:57:16.617850785 +0000 UTC m=+1920.837239669"
Jul 28 20:57:16.621913 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:16.621886    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:17.602140 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:17.602107    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:17.603233 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:17.603217    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:32.604141 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:32.604107    2556 patch_prober.go:28] interesting pod/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 28 20:57:32.604576 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:32.604167    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs" podUID="397bf19f-07b3-4875-a31a-6f88dbb7153c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 28 20:57:32.668519 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:32.668486    2556 generic.go:356] "Generic (PLEG): container finished" podID="397bf19f-07b3-4875-a31a-6f88dbb7153c" containerID="13620af846eceea4c34a54d0757e39bf24ee9123c5e280f0abb89996b8a079ee" exitCode=0
Jul 28 20:57:32.668668 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:32.668530    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs" event={"ID":"397bf19f-07b3-4875-a31a-6f88dbb7153c","Type":"ContainerDied","Data":"13620af846eceea4c34a54d0757e39bf24ee9123c5e280f0abb89996b8a079ee"}
Jul 28 20:57:32.668900 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:32.668887    2556 scope.go:117] "RemoveContainer" containerID="13620af846eceea4c34a54d0757e39bf24ee9123c5e280f0abb89996b8a079ee"
Jul 28 20:57:32.669841 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:32.669816    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:57:32.669893 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:32.669878    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:57:32.669932 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:32.669908    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:57:33.677185 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:33.677149    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs" event={"ID":"397bf19f-07b3-4875-a31a-6f88dbb7153c","Type":"ContainerStarted","Data":"b4fcfbf59df087421d824b1b4cb92ceab157bd4a4b0f3308f42c587d78ea6745"}
Jul 28 20:57:34.617165 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:34.617131    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:34.617446 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:34.617422    2556 patch_prober.go:28] interesting pod/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 28 20:57:34.617538 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:34.617476    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs" podUID="397bf19f-07b3-4875-a31a-6f88dbb7153c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 28 20:57:35.617502 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:35.617465    2556 patch_prober.go:28] interesting pod/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 28 20:57:35.617928 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:35.617519    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs" podUID="397bf19f-07b3-4875-a31a-6f88dbb7153c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 28 20:57:36.617102 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:36.617063    2556 patch_prober.go:28] interesting pod/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 28 20:57:36.617288 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:36.617121    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs" podUID="397bf19f-07b3-4875-a31a-6f88dbb7153c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 28 20:57:37.617190 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:37.617151    2556 patch_prober.go:28] interesting pod/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Jul 28 20:57:37.617593 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:37.617220    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs" podUID="397bf19f-07b3-4875-a31a-6f88dbb7153c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Jul 28 20:57:38.621250 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:38.621222    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:38.621696 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:38.621503    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:57:38.622254 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:57:38.622238    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:58:09.185000 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:09.184925    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"]
Jul 28 20:58:09.185487 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:09.185120    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs" podUID="397bf19f-07b3-4875-a31a-6f88dbb7153c" containerName="istio-proxy" containerID="cri-o://b4fcfbf59df087421d824b1b4cb92ceab157bd4a4b0f3308f42c587d78ea6745" gracePeriod=30
Jul 28 20:58:14.422446 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.422422    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:58:14.548249 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.548224    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/397bf19f-07b3-4875-a31a-6f88dbb7153c-istio-token\") pod \"397bf19f-07b3-4875-a31a-6f88dbb7153c\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") "
Jul 28 20:58:14.548423 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.548256    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-workload-socket\") pod \"397bf19f-07b3-4875-a31a-6f88dbb7153c\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") "
Jul 28 20:58:14.548423 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.548274    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-workload-certs\") pod \"397bf19f-07b3-4875-a31a-6f88dbb7153c\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") "
Jul 28 20:58:14.548423 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.548303    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-istio-envoy\") pod \"397bf19f-07b3-4875-a31a-6f88dbb7153c\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") "
Jul 28 20:58:14.548423 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.548336    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/397bf19f-07b3-4875-a31a-6f88dbb7153c-istiod-ca-cert\") pod \"397bf19f-07b3-4875-a31a-6f88dbb7153c\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") "
Jul 28 20:58:14.548423 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.548395    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/397bf19f-07b3-4875-a31a-6f88dbb7153c-istio-podinfo\") pod \"397bf19f-07b3-4875-a31a-6f88dbb7153c\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") "
Jul 28 20:58:14.548742 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.548444    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-istio-data\") pod \"397bf19f-07b3-4875-a31a-6f88dbb7153c\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") "
Jul 28 20:58:14.548742 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.548488    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-credential-socket\") pod \"397bf19f-07b3-4875-a31a-6f88dbb7153c\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") "
Jul 28 20:58:14.548742 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.548540    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xppx6\" (UniqueName: \"kubernetes.io/projected/397bf19f-07b3-4875-a31a-6f88dbb7153c-kube-api-access-xppx6\") pod \"397bf19f-07b3-4875-a31a-6f88dbb7153c\" (UID: \"397bf19f-07b3-4875-a31a-6f88dbb7153c\") "
Jul 28 20:58:14.548742 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.548622    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "397bf19f-07b3-4875-a31a-6f88dbb7153c" (UID: "397bf19f-07b3-4875-a31a-6f88dbb7153c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:58:14.548742 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.548652    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "397bf19f-07b3-4875-a31a-6f88dbb7153c" (UID: "397bf19f-07b3-4875-a31a-6f88dbb7153c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:58:14.548964 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.548833    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "397bf19f-07b3-4875-a31a-6f88dbb7153c" (UID: "397bf19f-07b3-4875-a31a-6f88dbb7153c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:58:14.548964 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.548833    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/397bf19f-07b3-4875-a31a-6f88dbb7153c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "397bf19f-07b3-4875-a31a-6f88dbb7153c" (UID: "397bf19f-07b3-4875-a31a-6f88dbb7153c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:58:14.548964 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.548890    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-workload-socket\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:58:14.548964 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.548912    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-workload-certs\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:58:14.549496 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.549461    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-istio-data" (OuterVolumeSpecName: "istio-data") pod "397bf19f-07b3-4875-a31a-6f88dbb7153c" (UID: "397bf19f-07b3-4875-a31a-6f88dbb7153c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:58:14.550545 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.550516    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/397bf19f-07b3-4875-a31a-6f88dbb7153c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "397bf19f-07b3-4875-a31a-6f88dbb7153c" (UID: "397bf19f-07b3-4875-a31a-6f88dbb7153c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:58:14.550545 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.550530    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "397bf19f-07b3-4875-a31a-6f88dbb7153c" (UID: "397bf19f-07b3-4875-a31a-6f88dbb7153c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:58:14.550670 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.550630    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/397bf19f-07b3-4875-a31a-6f88dbb7153c-kube-api-access-xppx6" (OuterVolumeSpecName: "kube-api-access-xppx6") pod "397bf19f-07b3-4875-a31a-6f88dbb7153c" (UID: "397bf19f-07b3-4875-a31a-6f88dbb7153c"). InnerVolumeSpecName "kube-api-access-xppx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:58:14.550706 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.550698    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/397bf19f-07b3-4875-a31a-6f88dbb7153c-istio-token" (OuterVolumeSpecName: "istio-token") pod "397bf19f-07b3-4875-a31a-6f88dbb7153c" (UID: "397bf19f-07b3-4875-a31a-6f88dbb7153c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:58:14.650144 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.650107    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-istio-data\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:58:14.650144 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.650140    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-credential-socket\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:58:14.650144 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.650150    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xppx6\" (UniqueName: \"kubernetes.io/projected/397bf19f-07b3-4875-a31a-6f88dbb7153c-kube-api-access-xppx6\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:58:14.650307 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.650159    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/397bf19f-07b3-4875-a31a-6f88dbb7153c-istio-token\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:58:14.650307 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.650167    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/397bf19f-07b3-4875-a31a-6f88dbb7153c-istio-envoy\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:58:14.650307 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.650175    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/397bf19f-07b3-4875-a31a-6f88dbb7153c-istiod-ca-cert\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:58:14.650307 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.650182    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/397bf19f-07b3-4875-a31a-6f88dbb7153c-istio-podinfo\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 20:58:14.871234 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.871144    2556 generic.go:356] "Generic (PLEG): container finished" podID="397bf19f-07b3-4875-a31a-6f88dbb7153c" containerID="b4fcfbf59df087421d824b1b4cb92ceab157bd4a4b0f3308f42c587d78ea6745" exitCode=0
Jul 28 20:58:14.871234 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.871192    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"
Jul 28 20:58:14.871234 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.871221    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs" event={"ID":"397bf19f-07b3-4875-a31a-6f88dbb7153c","Type":"ContainerDied","Data":"b4fcfbf59df087421d824b1b4cb92ceab157bd4a4b0f3308f42c587d78ea6745"}
Jul 28 20:58:14.871526 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.871270    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs" event={"ID":"397bf19f-07b3-4875-a31a-6f88dbb7153c","Type":"ContainerDied","Data":"266b4e6d959ea61eef060e6047420ff35c92533fa9403846c80d46a64ed7ca2b"}
Jul 28 20:58:14.871526 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.871295    2556 scope.go:117] "RemoveContainer" containerID="b4fcfbf59df087421d824b1b4cb92ceab157bd4a4b0f3308f42c587d78ea6745"
Jul 28 20:58:14.880393 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.880372    2556 scope.go:117] "RemoveContainer" containerID="13620af846eceea4c34a54d0757e39bf24ee9123c5e280f0abb89996b8a079ee"
Jul 28 20:58:14.889863 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.889849    2556 scope.go:117] "RemoveContainer" containerID="b4fcfbf59df087421d824b1b4cb92ceab157bd4a4b0f3308f42c587d78ea6745"
Jul 28 20:58:14.890118 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:58:14.890100    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4fcfbf59df087421d824b1b4cb92ceab157bd4a4b0f3308f42c587d78ea6745\": container with ID starting with b4fcfbf59df087421d824b1b4cb92ceab157bd4a4b0f3308f42c587d78ea6745 not found: ID does not exist" containerID="b4fcfbf59df087421d824b1b4cb92ceab157bd4a4b0f3308f42c587d78ea6745"
Jul 28 20:58:14.890170 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.890127    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4fcfbf59df087421d824b1b4cb92ceab157bd4a4b0f3308f42c587d78ea6745"} err="failed to get container status \"b4fcfbf59df087421d824b1b4cb92ceab157bd4a4b0f3308f42c587d78ea6745\": rpc error: code = NotFound desc = could not find container \"b4fcfbf59df087421d824b1b4cb92ceab157bd4a4b0f3308f42c587d78ea6745\": container with ID starting with b4fcfbf59df087421d824b1b4cb92ceab157bd4a4b0f3308f42c587d78ea6745 not found: ID does not exist"
Jul 28 20:58:14.890170 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.890144    2556 scope.go:117] "RemoveContainer" containerID="13620af846eceea4c34a54d0757e39bf24ee9123c5e280f0abb89996b8a079ee"
Jul 28 20:58:14.890374 ip-10-0-136-118 kubenswrapper[2556]: E0728 20:58:14.890359    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13620af846eceea4c34a54d0757e39bf24ee9123c5e280f0abb89996b8a079ee\": container with ID starting with 13620af846eceea4c34a54d0757e39bf24ee9123c5e280f0abb89996b8a079ee not found: ID does not exist" containerID="13620af846eceea4c34a54d0757e39bf24ee9123c5e280f0abb89996b8a079ee"
Jul 28 20:58:14.890417 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.890379    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13620af846eceea4c34a54d0757e39bf24ee9123c5e280f0abb89996b8a079ee"} err="failed to get container status \"13620af846eceea4c34a54d0757e39bf24ee9123c5e280f0abb89996b8a079ee\": rpc error: code = NotFound desc = could not find container \"13620af846eceea4c34a54d0757e39bf24ee9123c5e280f0abb89996b8a079ee\": container with ID starting with 13620af846eceea4c34a54d0757e39bf24ee9123c5e280f0abb89996b8a079ee not found: ID does not exist"
Jul 28 20:58:14.893391 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.893373    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"]
Jul 28 20:58:14.897195 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:14.897174    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-2c06c6bc-openshift-default-79b5f66c6d-sz4qs"]
Jul 28 20:58:16.314887 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:16.314856    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="397bf19f-07b3-4875-a31a-6f88dbb7153c" path="/var/lib/kubelet/pods/397bf19f-07b3-4875-a31a-6f88dbb7153c/volumes"
Jul 28 20:58:29.731523 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.731484    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"]
Jul 28 20:58:29.732067 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.732043    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="397bf19f-07b3-4875-a31a-6f88dbb7153c" containerName="istio-proxy"
Jul 28 20:58:29.732067 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.732065    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="397bf19f-07b3-4875-a31a-6f88dbb7153c" containerName="istio-proxy"
Jul 28 20:58:29.732240 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.732094    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="397bf19f-07b3-4875-a31a-6f88dbb7153c" containerName="istio-proxy"
Jul 28 20:58:29.732240 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.732103    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="397bf19f-07b3-4875-a31a-6f88dbb7153c" containerName="istio-proxy"
Jul 28 20:58:29.732240 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.732185    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="397bf19f-07b3-4875-a31a-6f88dbb7153c" containerName="istio-proxy"
Jul 28 20:58:29.735406 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.735386    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:29.738076 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.738060    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a8387f77-openshift-default-dockercfg-gk75d\""
Jul 28 20:58:29.746598 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.746576    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"]
Jul 28 20:58:29.881877 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.881843    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-workload-certs\") pod \"e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") " pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:29.882061 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.881883    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c47116b3-6a98-44cb-b463-fb88179d0ef3-istio-podinfo\") pod \"e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") " pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:29.882061 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.881901    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c47116b3-6a98-44cb-b463-fb88179d0ef3-istio-token\") pod \"e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") " pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:29.882061 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.882038    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-workload-socket\") pod \"e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") " pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:29.882244 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.882088    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-istio-data\") pod \"e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") " pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:29.882244 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.882150    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-istio-envoy\") pod \"e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") " pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:29.882244 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.882181    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c47116b3-6a98-44cb-b463-fb88179d0ef3-istiod-ca-cert\") pod \"e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") " pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:29.882244 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.882224    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-credential-socket\") pod \"e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") " pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:29.882437 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.882250    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whz29\" (UniqueName: \"kubernetes.io/projected/c47116b3-6a98-44cb-b463-fb88179d0ef3-kube-api-access-whz29\") pod \"e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") " pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:29.983211 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.983141    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-istio-envoy\") pod \"e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") " pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:29.983211 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.983172    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c47116b3-6a98-44cb-b463-fb88179d0ef3-istiod-ca-cert\") pod \"e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") " pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:29.983211 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.983195    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-credential-socket\") pod \"e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") " pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:29.983470 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.983218    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whz29\" (UniqueName: \"kubernetes.io/projected/c47116b3-6a98-44cb-b463-fb88179d0ef3-kube-api-access-whz29\") pod \"e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") " pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:29.983470 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.983255    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-workload-certs\") pod \"e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") " pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:29.983470 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.983278    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c47116b3-6a98-44cb-b463-fb88179d0ef3-istio-podinfo\") pod \"e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") " pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:29.983470 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.983295    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c47116b3-6a98-44cb-b463-fb88179d0ef3-istio-token\") pod \"e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") " pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:29.983470 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.983386    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-workload-socket\") pod \"e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") " pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:29.983470 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.983418    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-istio-data\") pod \"e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") " pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:29.983747 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.983649    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-workload-certs\") pod \"e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") " pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:29.983918 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.983801    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-istio-data\") pod \"e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") " pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:29.983918 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.983861    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-credential-socket\") pod \"e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") " pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:29.984068 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.984020    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-workload-socket\") pod \"e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") " pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:29.984068 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.984028    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c47116b3-6a98-44cb-b463-fb88179d0ef3-istiod-ca-cert\") pod \"e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") " pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:29.985459 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.985438    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-istio-envoy\") pod \"e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") " pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:29.985591 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.985575    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c47116b3-6a98-44cb-b463-fb88179d0ef3-istio-podinfo\") pod \"e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") " pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:29.991446 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.991424    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c47116b3-6a98-44cb-b463-fb88179d0ef3-istio-token\") pod \"e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") " pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:29.991728 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:29.991707    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whz29\" (UniqueName: \"kubernetes.io/projected/c47116b3-6a98-44cb-b463-fb88179d0ef3-kube-api-access-whz29\") pod \"e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") " pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:30.046727 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:30.046702    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:30.199745 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:30.199722    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"]
Jul 28 20:58:30.201272 ip-10-0-136-118 kubenswrapper[2556]: W0728 20:58:30.201248    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc47116b3_6a98_44cb_b463_fb88179d0ef3.slice/crio-76ef6333acaea186472d674ee76163f5f6d9c2e8328a36e9cbfa8468f4c7db31 WatchSource:0}: Error finding container 76ef6333acaea186472d674ee76163f5f6d9c2e8328a36e9cbfa8468f4c7db31: Status 404 returned error can't find the container with id 76ef6333acaea186472d674ee76163f5f6d9c2e8328a36e9cbfa8468f4c7db31
Jul 28 20:58:30.203454 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:30.203415    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:58:30.203541 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:30.203500    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:58:30.203577 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:30.203542    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:58:30.943870 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:30.943835    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf" event={"ID":"c47116b3-6a98-44cb-b463-fb88179d0ef3","Type":"ContainerStarted","Data":"23742964a4c9f951c3293793654f68ae26e2a6d868c2d892a042bc753d4d26ba"}
Jul 28 20:58:30.944252 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:30.943886    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf" event={"ID":"c47116b3-6a98-44cb-b463-fb88179d0ef3","Type":"ContainerStarted","Data":"76ef6333acaea186472d674ee76163f5f6d9c2e8328a36e9cbfa8468f4c7db31"}
Jul 28 20:58:30.981174 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:30.981124    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf" podStartSLOduration=1.981109689 podStartE2EDuration="1.981109689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:58:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:58:30.979664877 +0000 UTC m=+1995.199053779" watchObservedRunningTime="2026-07-28 20:58:30.981109689 +0000 UTC m=+1995.200498575"
Jul 28 20:58:31.047194 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:31.047152    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:31.051806 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:31.051786    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:31.948826 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:31.948785    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:31.949893 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:31.949870    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:47.021919 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:47.021421    2556 patch_prober.go:28] interesting pod/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": read tcp 10.134.0.2:46050->10.134.0.26:15021: read: connection reset by peer" start-of-body=
Jul 28 20:58:47.021919 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:47.021498    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf" podUID="c47116b3-6a98-44cb-b463-fb88179d0ef3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": read tcp 10.134.0.2:46050->10.134.0.26:15021: read: connection reset by peer"
Jul 28 20:58:48.024022 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:48.023987    2556 generic.go:356] "Generic (PLEG): container finished" podID="c47116b3-6a98-44cb-b463-fb88179d0ef3" containerID="23742964a4c9f951c3293793654f68ae26e2a6d868c2d892a042bc753d4d26ba" exitCode=0
Jul 28 20:58:48.024464 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:48.024060    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf" event={"ID":"c47116b3-6a98-44cb-b463-fb88179d0ef3","Type":"ContainerDied","Data":"23742964a4c9f951c3293793654f68ae26e2a6d868c2d892a042bc753d4d26ba"}
Jul 28 20:58:48.024464 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:48.024457    2556 scope.go:117] "RemoveContainer" containerID="23742964a4c9f951c3293793654f68ae26e2a6d868c2d892a042bc753d4d26ba"
Jul 28 20:58:48.025513 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:48.025478    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:58:48.025617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:48.025540    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:58:48.025617 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:48.025571    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 20:58:49.030529 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:49.030495    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf" event={"ID":"c47116b3-6a98-44cb-b463-fb88179d0ef3","Type":"ContainerStarted","Data":"a89d8dbba65a467c0e4b443f403bd758113f7f6307ae8a92a48570e5141723bb"}
Jul 28 20:58:49.047645 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:49.047625    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:49.047944 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:49.047920    2556 patch_prober.go:28] interesting pod/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 28 20:58:49.048023 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:49.047976    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf" podUID="c47116b3-6a98-44cb-b463-fb88179d0ef3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 28 20:58:50.047429 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:50.047396    2556 patch_prober.go:28] interesting pod/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 28 20:58:50.047891 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:50.047455    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf" podUID="c47116b3-6a98-44cb-b463-fb88179d0ef3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 28 20:58:51.047382 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:51.047327    2556 patch_prober.go:28] interesting pod/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 28 20:58:51.047549 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:51.047405    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf" podUID="c47116b3-6a98-44cb-b463-fb88179d0ef3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 28 20:58:52.047524 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:52.047491    2556 patch_prober.go:28] interesting pod/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 28 20:58:52.047695 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:52.047560    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf" podUID="c47116b3-6a98-44cb-b463-fb88179d0ef3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 28 20:58:53.047663 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:53.047630    2556 patch_prober.go:28] interesting pod/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 28 20:58:53.047830 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:53.047690    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf" podUID="c47116b3-6a98-44cb-b463-fb88179d0ef3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 28 20:58:54.050805 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:54.050775    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:54.051191 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:54.051169    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 20:58:54.051861 ip-10-0-136-118 kubenswrapper[2556]: I0728 20:58:54.051838    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 21:00:41.103109 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:41.103076    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"]
Jul 28 21:00:41.103563 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:41.103273    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf" podUID="c47116b3-6a98-44cb-b463-fb88179d0ef3" containerName="istio-proxy" containerID="cri-o://a89d8dbba65a467c0e4b443f403bd758113f7f6307ae8a92a48570e5141723bb" gracePeriod=30
Jul 28 21:00:46.349087 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.349065    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 21:00:46.461234 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.461147    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c47116b3-6a98-44cb-b463-fb88179d0ef3-istio-token\") pod \"c47116b3-6a98-44cb-b463-fb88179d0ef3\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") "
Jul 28 21:00:46.461234 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.461196    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-workload-socket\") pod \"c47116b3-6a98-44cb-b463-fb88179d0ef3\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") "
Jul 28 21:00:46.461234 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.461225    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-workload-certs\") pod \"c47116b3-6a98-44cb-b463-fb88179d0ef3\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") "
Jul 28 21:00:46.461531 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.461253    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-istio-data\") pod \"c47116b3-6a98-44cb-b463-fb88179d0ef3\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") "
Jul 28 21:00:46.461531 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.461279    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c47116b3-6a98-44cb-b463-fb88179d0ef3-istiod-ca-cert\") pod \"c47116b3-6a98-44cb-b463-fb88179d0ef3\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") "
Jul 28 21:00:46.461531 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.461312    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-istio-envoy\") pod \"c47116b3-6a98-44cb-b463-fb88179d0ef3\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") "
Jul 28 21:00:46.461531 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.461370    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whz29\" (UniqueName: \"kubernetes.io/projected/c47116b3-6a98-44cb-b463-fb88179d0ef3-kube-api-access-whz29\") pod \"c47116b3-6a98-44cb-b463-fb88179d0ef3\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") "
Jul 28 21:00:46.461531 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.461406    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-credential-socket\") pod \"c47116b3-6a98-44cb-b463-fb88179d0ef3\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") "
Jul 28 21:00:46.461531 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.461432    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c47116b3-6a98-44cb-b463-fb88179d0ef3-istio-podinfo\") pod \"c47116b3-6a98-44cb-b463-fb88179d0ef3\" (UID: \"c47116b3-6a98-44cb-b463-fb88179d0ef3\") "
Jul 28 21:00:46.461531 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.461448    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c47116b3-6a98-44cb-b463-fb88179d0ef3" (UID: "c47116b3-6a98-44cb-b463-fb88179d0ef3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:00:46.461872 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.461697    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c47116b3-6a98-44cb-b463-fb88179d0ef3" (UID: "c47116b3-6a98-44cb-b463-fb88179d0ef3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:00:46.461872 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.461706    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-workload-socket\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:00:46.461872 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.461718    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c47116b3-6a98-44cb-b463-fb88179d0ef3" (UID: "c47116b3-6a98-44cb-b463-fb88179d0ef3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:00:46.462083 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.462045    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c47116b3-6a98-44cb-b463-fb88179d0ef3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c47116b3-6a98-44cb-b463-fb88179d0ef3" (UID: "c47116b3-6a98-44cb-b463-fb88179d0ef3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:00:46.462470 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.462444    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-istio-data" (OuterVolumeSpecName: "istio-data") pod "c47116b3-6a98-44cb-b463-fb88179d0ef3" (UID: "c47116b3-6a98-44cb-b463-fb88179d0ef3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:00:46.463407 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.463376    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c47116b3-6a98-44cb-b463-fb88179d0ef3-istio-token" (OuterVolumeSpecName: "istio-token") pod "c47116b3-6a98-44cb-b463-fb88179d0ef3" (UID: "c47116b3-6a98-44cb-b463-fb88179d0ef3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:00:46.463628 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.463613    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c47116b3-6a98-44cb-b463-fb88179d0ef3" (UID: "c47116b3-6a98-44cb-b463-fb88179d0ef3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:00:46.463845 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.463824    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c47116b3-6a98-44cb-b463-fb88179d0ef3-kube-api-access-whz29" (OuterVolumeSpecName: "kube-api-access-whz29") pod "c47116b3-6a98-44cb-b463-fb88179d0ef3" (UID: "c47116b3-6a98-44cb-b463-fb88179d0ef3"). InnerVolumeSpecName "kube-api-access-whz29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:00:46.463936 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.463915    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c47116b3-6a98-44cb-b463-fb88179d0ef3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c47116b3-6a98-44cb-b463-fb88179d0ef3" (UID: "c47116b3-6a98-44cb-b463-fb88179d0ef3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 21:00:46.540867 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.540837    2556 generic.go:356] "Generic (PLEG): container finished" podID="c47116b3-6a98-44cb-b463-fb88179d0ef3" containerID="a89d8dbba65a467c0e4b443f403bd758113f7f6307ae8a92a48570e5141723bb" exitCode=0
Jul 28 21:00:46.540979 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.540901    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"
Jul 28 21:00:46.540979 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.540921    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf" event={"ID":"c47116b3-6a98-44cb-b463-fb88179d0ef3","Type":"ContainerDied","Data":"a89d8dbba65a467c0e4b443f403bd758113f7f6307ae8a92a48570e5141723bb"}
Jul 28 21:00:46.541056 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.541010    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf" event={"ID":"c47116b3-6a98-44cb-b463-fb88179d0ef3","Type":"ContainerDied","Data":"76ef6333acaea186472d674ee76163f5f6d9c2e8328a36e9cbfa8468f4c7db31"}
Jul 28 21:00:46.541056 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.541039    2556 scope.go:117] "RemoveContainer" containerID="a89d8dbba65a467c0e4b443f403bd758113f7f6307ae8a92a48570e5141723bb"
Jul 28 21:00:46.549317 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.549300    2556 scope.go:117] "RemoveContainer" containerID="23742964a4c9f951c3293793654f68ae26e2a6d868c2d892a042bc753d4d26ba"
Jul 28 21:00:46.556502 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.556487    2556 scope.go:117] "RemoveContainer" containerID="a89d8dbba65a467c0e4b443f403bd758113f7f6307ae8a92a48570e5141723bb"
Jul 28 21:00:46.556779 ip-10-0-136-118 kubenswrapper[2556]: E0728 21:00:46.556761    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a89d8dbba65a467c0e4b443f403bd758113f7f6307ae8a92a48570e5141723bb\": container with ID starting with a89d8dbba65a467c0e4b443f403bd758113f7f6307ae8a92a48570e5141723bb not found: ID does not exist" containerID="a89d8dbba65a467c0e4b443f403bd758113f7f6307ae8a92a48570e5141723bb"
Jul 28 21:00:46.556824 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.556787    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a89d8dbba65a467c0e4b443f403bd758113f7f6307ae8a92a48570e5141723bb"} err="failed to get container status \"a89d8dbba65a467c0e4b443f403bd758113f7f6307ae8a92a48570e5141723bb\": rpc error: code = NotFound desc = could not find container \"a89d8dbba65a467c0e4b443f403bd758113f7f6307ae8a92a48570e5141723bb\": container with ID starting with a89d8dbba65a467c0e4b443f403bd758113f7f6307ae8a92a48570e5141723bb not found: ID does not exist"
Jul 28 21:00:46.556824 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.556804    2556 scope.go:117] "RemoveContainer" containerID="23742964a4c9f951c3293793654f68ae26e2a6d868c2d892a042bc753d4d26ba"
Jul 28 21:00:46.556994 ip-10-0-136-118 kubenswrapper[2556]: E0728 21:00:46.556978    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23742964a4c9f951c3293793654f68ae26e2a6d868c2d892a042bc753d4d26ba\": container with ID starting with 23742964a4c9f951c3293793654f68ae26e2a6d868c2d892a042bc753d4d26ba not found: ID does not exist" containerID="23742964a4c9f951c3293793654f68ae26e2a6d868c2d892a042bc753d4d26ba"
Jul 28 21:00:46.557034 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.556998    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23742964a4c9f951c3293793654f68ae26e2a6d868c2d892a042bc753d4d26ba"} err="failed to get container status \"23742964a4c9f951c3293793654f68ae26e2a6d868c2d892a042bc753d4d26ba\": rpc error: code = NotFound desc = could not find container \"23742964a4c9f951c3293793654f68ae26e2a6d868c2d892a042bc753d4d26ba\": container with ID starting with 23742964a4c9f951c3293793654f68ae26e2a6d868c2d892a042bc753d4d26ba not found: ID does not exist"
Jul 28 21:00:46.562429 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.562410    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c47116b3-6a98-44cb-b463-fb88179d0ef3-istio-token\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:00:46.562518 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.562433    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-workload-certs\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:00:46.562518 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.562446    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-istio-data\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:00:46.562518 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.562457    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c47116b3-6a98-44cb-b463-fb88179d0ef3-istiod-ca-cert\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:00:46.562518 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.562468    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-istio-envoy\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:00:46.562518 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.562480    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whz29\" (UniqueName: \"kubernetes.io/projected/c47116b3-6a98-44cb-b463-fb88179d0ef3-kube-api-access-whz29\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:00:46.562518 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.562492    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c47116b3-6a98-44cb-b463-fb88179d0ef3-credential-socket\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:00:46.562518 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.562505    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c47116b3-6a98-44cb-b463-fb88179d0ef3-istio-podinfo\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:00:46.567240 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.567221    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"]
Jul 28 21:00:46.575335 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:46.575315    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a8387f77-openshift-default-766c8b6fdd-ldmnf"]
Jul 28 21:00:48.312840 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:00:48.312809    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c47116b3-6a98-44cb-b463-fb88179d0ef3" path="/var/lib/kubelet/pods/c47116b3-6a98-44cb-b463-fb88179d0ef3/volumes"
Jul 28 21:01:37.553785 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.553756    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"]
Jul 28 21:01:37.554193 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.554093    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c47116b3-6a98-44cb-b463-fb88179d0ef3" containerName="istio-proxy"
Jul 28 21:01:37.554193 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.554104    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c47116b3-6a98-44cb-b463-fb88179d0ef3" containerName="istio-proxy"
Jul 28 21:01:37.554193 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.554124    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c47116b3-6a98-44cb-b463-fb88179d0ef3" containerName="istio-proxy"
Jul 28 21:01:37.554193 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.554129    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c47116b3-6a98-44cb-b463-fb88179d0ef3" containerName="istio-proxy"
Jul 28 21:01:37.554193 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.554185    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c47116b3-6a98-44cb-b463-fb88179d0ef3" containerName="istio-proxy"
Jul 28 21:01:37.554193 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.554194    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="397bf19f-07b3-4875-a31a-6f88dbb7153c" containerName="istio-proxy"
Jul 28 21:01:37.554406 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.554200    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c47116b3-6a98-44cb-b463-fb88179d0ef3" containerName="istio-proxy"
Jul 28 21:01:37.557071 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.557056    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:37.560752 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.560729    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-7465ef-openshift-default-dockercfg-vbf8b\""
Jul 28 21:01:37.574455 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.574432    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"]
Jul 28 21:01:37.701906 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.701869    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istiod-ca-cert\") pod \"e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") " pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:37.701906 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.701911    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istio-data\") pod \"e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") " pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:37.702120 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.701930    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istio-podinfo\") pod \"e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") " pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:37.702120 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.701978    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istio-token\") pod \"e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") " pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:37.702120 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.702004    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5stp\" (UniqueName: \"kubernetes.io/projected/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-kube-api-access-t5stp\") pod \"e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") " pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:37.702120 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.702054    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-workload-socket\") pod \"e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") " pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:37.702120 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.702068    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-credential-socket\") pod \"e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") " pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:37.702120 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.702089    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istio-envoy\") pod \"e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") " pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:37.702372 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.702146    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-workload-certs\") pod \"e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") " pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:37.803058 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.803025    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istio-data\") pod \"e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") " pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:37.803058 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.803058    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istio-podinfo\") pod \"e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") " pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:37.803283 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.803079    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istio-token\") pod \"e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") " pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:37.803283 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.803108    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5stp\" (UniqueName: \"kubernetes.io/projected/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-kube-api-access-t5stp\") pod \"e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") " pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:37.803283 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.803150    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-workload-socket\") pod \"e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") " pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:37.803283 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.803167    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-credential-socket\") pod \"e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") " pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:37.803283 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.803190    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istio-envoy\") pod \"e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") " pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:37.803283 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.803262    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-workload-certs\") pod \"e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") " pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:37.803589 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.803300    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istiod-ca-cert\") pod \"e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") " pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:37.803646 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.803611    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-workload-socket\") pod \"e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") " pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:37.803700 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.803650    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-credential-socket\") pod \"e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") " pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:37.803700 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.803684    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istio-data\") pod \"e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") " pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:37.803779 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.803750    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-workload-certs\") pod \"e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") " pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:37.804076 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.804030    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istiod-ca-cert\") pod \"e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") " pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:37.805494 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.805475    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istio-podinfo\") pod \"e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") " pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:37.805575 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.805558    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istio-envoy\") pod \"e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") " pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:37.818655 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.818630    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5stp\" (UniqueName: \"kubernetes.io/projected/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-kube-api-access-t5stp\") pod \"e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") " pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:37.822065 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.822044    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istio-token\") pod \"e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") " pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:37.867135 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:37.867101    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:38.004998 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:38.004966    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"]
Jul 28 21:01:38.006223 ip-10-0-136-118 kubenswrapper[2556]: W0728 21:01:38.006200    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda698e01b_ed59_45ff_9ccd_312a43e8bbf9.slice/crio-e2aed6178693b928884ca601cb2e8d90650d61fe616f4d414792da0d3cb50aae WatchSource:0}: Error finding container e2aed6178693b928884ca601cb2e8d90650d61fe616f4d414792da0d3cb50aae: Status 404 returned error can't find the container with id e2aed6178693b928884ca601cb2e8d90650d61fe616f4d414792da0d3cb50aae
Jul 28 21:01:38.008188 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:38.008158    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:01:38.008258 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:38.008218    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:01:38.008258 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:38.008244    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:01:38.766108 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:38.766072    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp" event={"ID":"a698e01b-ed59-45ff-9ccd-312a43e8bbf9","Type":"ContainerStarted","Data":"20d9701f63d97283bb9b691aeb36714729f94c609c18c9777bf86e76bc110cf6"}
Jul 28 21:01:38.766498 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:38.766123    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp" event={"ID":"a698e01b-ed59-45ff-9ccd-312a43e8bbf9","Type":"ContainerStarted","Data":"e2aed6178693b928884ca601cb2e8d90650d61fe616f4d414792da0d3cb50aae"}
Jul 28 21:01:38.793431 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:38.793385    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp" podStartSLOduration=1.793369558 podStartE2EDuration="1.793369558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:01:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:01:38.792136392 +0000 UTC m=+2183.011525276" watchObservedRunningTime="2026-07-28 21:01:38.793369558 +0000 UTC m=+2183.012758434"
Jul 28 21:01:38.867785 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:38.867749    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:39.872716 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:39.872686    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:40.774805 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:40.774774    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:40.775725 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:40.775707    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:54.840104 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:54.840068    2556 generic.go:356] "Generic (PLEG): container finished" podID="a698e01b-ed59-45ff-9ccd-312a43e8bbf9" containerID="20d9701f63d97283bb9b691aeb36714729f94c609c18c9777bf86e76bc110cf6" exitCode=0
Jul 28 21:01:54.840534 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:54.840145    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp" event={"ID":"a698e01b-ed59-45ff-9ccd-312a43e8bbf9","Type":"ContainerDied","Data":"20d9701f63d97283bb9b691aeb36714729f94c609c18c9777bf86e76bc110cf6"}
Jul 28 21:01:54.840623 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:54.840605    2556 scope.go:117] "RemoveContainer" containerID="20d9701f63d97283bb9b691aeb36714729f94c609c18c9777bf86e76bc110cf6"
Jul 28 21:01:54.841653 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:54.841625    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:01:54.841758 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:54.841691    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:01:54.841758 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:54.841721    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:01:55.775146 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:55.775093    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:55.846033 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:55.845993    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp" event={"ID":"a698e01b-ed59-45ff-9ccd-312a43e8bbf9","Type":"ContainerStarted","Data":"3d183aac0170ad261fd57c973a943e5137a32f9d39fa62aacdcd2f5de59018a1"}
Jul 28 21:01:55.867500 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:55.867465    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:55.868557 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:55.868532    2556 patch_prober.go:28] interesting pod/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 28 21:01:55.868693 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:55.868584    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp" podUID="a698e01b-ed59-45ff-9ccd-312a43e8bbf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 28 21:01:56.868204 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:56.868170    2556 patch_prober.go:28] interesting pod/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 28 21:01:56.868777 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:56.868229    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp" podUID="a698e01b-ed59-45ff-9ccd-312a43e8bbf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 28 21:01:57.868051 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:57.868006    2556 patch_prober.go:28] interesting pod/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 28 21:01:57.868225 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:57.868070    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp" podUID="a698e01b-ed59-45ff-9ccd-312a43e8bbf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 28 21:01:58.867901 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:58.867869    2556 patch_prober.go:28] interesting pod/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Jul 28 21:01:58.868080 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:58.867930    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp" podUID="a698e01b-ed59-45ff-9ccd-312a43e8bbf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Jul 28 21:01:59.871603 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:59.871571    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:59.871981 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:59.871961    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:01:59.872696 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:01:59.872672    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:02:06.532619 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.532583    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"]
Jul 28 21:02:06.545684 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.545652    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.546892 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.546862    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"]
Jul 28 21:02:06.548267 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.548247    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-3d8bda-openshift-default-dockercfg-7flff\""
Jul 28 21:02:06.656415 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.656376    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-credential-socket\") pod \"e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") " pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.656602 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.656452    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istio-token\") pod \"e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") " pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.656602 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.656488    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-workload-socket\") pod \"e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") " pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.656602 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.656509    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt84m\" (UniqueName: \"kubernetes.io/projected/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-kube-api-access-jt84m\") pod \"e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") " pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.656602 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.656576    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-workload-certs\") pod \"e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") " pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.656780 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.656660    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istio-data\") pod \"e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") " pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.656780 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.656689    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istiod-ca-cert\") pod \"e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") " pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.656780 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.656743    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istio-envoy\") pod \"e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") " pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.656780 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.656761    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istio-podinfo\") pod \"e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") " pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.757190 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.757158    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-workload-socket\") pod \"e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") " pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.757190 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.757193    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt84m\" (UniqueName: \"kubernetes.io/projected/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-kube-api-access-jt84m\") pod \"e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") " pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.757458 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.757324    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-workload-certs\") pod \"e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") " pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.757458 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.757399    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istio-data\") pod \"e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") " pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.757458 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.757427    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istiod-ca-cert\") pod \"e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") " pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.757623 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.757504    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istio-envoy\") pod \"e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") " pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.757623 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.757535    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istio-podinfo\") pod \"e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") " pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.757623 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.757576    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-credential-socket\") pod \"e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") " pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.757623 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.757609    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-workload-socket\") pod \"e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") " pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.757806 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.757781    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-workload-certs\") pod \"e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") " pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.757867 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.757831    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istio-token\") pod \"e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") " pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.757920 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.757893    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istio-data\") pod \"e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") " pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.757979 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.757953    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-credential-socket\") pod \"e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") " pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.758208 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.758184    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istiod-ca-cert\") pod \"e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") " pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.760058 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.760030    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istio-envoy\") pod \"e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") " pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.760269 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.760249    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istio-podinfo\") pod \"e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") " pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.765811 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.765791    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istio-token\") pod \"e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") " pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.766042 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.766018    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt84m\" (UniqueName: \"kubernetes.io/projected/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-kube-api-access-jt84m\") pod \"e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") " pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.856625 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.856593    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:06.991635 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.991610    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"]
Jul 28 21:02:06.993650 ip-10-0-136-118 kubenswrapper[2556]: W0728 21:02:06.993621    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6f76ec2_7cd0_4f24_8403_e096b3ecad23.slice/crio-613015c600389ec2e1df6b838a227baed51fcf63a1a230a7752c592f05b1872b WatchSource:0}: Error finding container 613015c600389ec2e1df6b838a227baed51fcf63a1a230a7752c592f05b1872b: Status 404 returned error can't find the container with id 613015c600389ec2e1df6b838a227baed51fcf63a1a230a7752c592f05b1872b
Jul 28 21:02:06.995769 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.995733    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:02:06.995829 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.995806    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:02:06.995870 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:06.995833    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:02:07.899375 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:07.899329    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96" event={"ID":"d6f76ec2-7cd0-4f24-8403-e096b3ecad23","Type":"ContainerStarted","Data":"9d7883869e6de853d0ab0f761141122880ebf2f4def5be74447d66762c408cbb"}
Jul 28 21:02:07.899769 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:07.899393    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96" event={"ID":"d6f76ec2-7cd0-4f24-8403-e096b3ecad23","Type":"ContainerStarted","Data":"613015c600389ec2e1df6b838a227baed51fcf63a1a230a7752c592f05b1872b"}
Jul 28 21:02:07.919050 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:07.919008    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96" podStartSLOduration=1.9189934910000002 podStartE2EDuration="1.918993491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:02:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:02:07.917950755 +0000 UTC m=+2212.137339640" watchObservedRunningTime="2026-07-28 21:02:07.918993491 +0000 UTC m=+2212.138382376"
Jul 28 21:02:08.857207 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:08.857172    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:08.862018 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:08.861992    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:08.903446 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:08.903419    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:08.904395 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:08.904372    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:24.945539 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:24.945504    2556 patch_prober.go:28] interesting pod/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 21:02:24.945943 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:24.945576    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96" podUID="d6f76ec2-7cd0-4f24-8403-e096b3ecad23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 21:02:25.985968 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:25.985935    2556 generic.go:356] "Generic (PLEG): container finished" podID="d6f76ec2-7cd0-4f24-8403-e096b3ecad23" containerID="9d7883869e6de853d0ab0f761141122880ebf2f4def5be74447d66762c408cbb" exitCode=0
Jul 28 21:02:25.986429 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:25.985987    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96" event={"ID":"d6f76ec2-7cd0-4f24-8403-e096b3ecad23","Type":"ContainerDied","Data":"9d7883869e6de853d0ab0f761141122880ebf2f4def5be74447d66762c408cbb"}
Jul 28 21:02:25.986429 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:25.986393    2556 scope.go:117] "RemoveContainer" containerID="9d7883869e6de853d0ab0f761141122880ebf2f4def5be74447d66762c408cbb"
Jul 28 21:02:25.987394 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:25.987366    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:02:25.987466 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:25.987451    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:02:25.987556 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:25.987542    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:02:26.995460 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:26.995420    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96" event={"ID":"d6f76ec2-7cd0-4f24-8403-e096b3ecad23","Type":"ContainerStarted","Data":"dfc2735213daef9d1dfa84f8a6b5753a9e00978b5d6ea3ef15a936b7cce63b24"}
Jul 28 21:02:27.857491 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:27.857462    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:27.857663 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:27.857644    2556 patch_prober.go:28] interesting pod/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Jul 28 21:02:27.857716 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:27.857698    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96" podUID="d6f76ec2-7cd0-4f24-8403-e096b3ecad23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Jul 28 21:02:28.857380 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:28.857319    2556 patch_prober.go:28] interesting pod/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Jul 28 21:02:28.857782 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:28.857420    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96" podUID="d6f76ec2-7cd0-4f24-8403-e096b3ecad23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Jul 28 21:02:29.857029 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:29.856993    2556 patch_prober.go:28] interesting pod/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Jul 28 21:02:29.857199 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:29.857066    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96" podUID="d6f76ec2-7cd0-4f24-8403-e096b3ecad23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Jul 28 21:02:30.861513 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:30.861485    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:30.861933 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:30.861871    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:30.862546 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:30.862528    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:02:55.400228 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:55.400152    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"]
Jul 28 21:02:55.403491 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:55.403473    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"
Jul 28 21:02:55.407230 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:55.407205    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-3d8bda\"/\"default-dockercfg-mkqzt\""
Jul 28 21:02:55.407369 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:55.407204    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-3d8bda\"/\"kube-root-ca.crt\""
Jul 28 21:02:55.407369 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:55.407330    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-3d8bda\"/\"test-model-3d8bda-kserve-self-signed-certs\""
Jul 28 21:02:55.407492 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:55.407205    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-3d8bda\"/\"openshift-service-ca.crt\""
Jul 28 21:02:55.412702 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:55.412677    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"]
Jul 28 21:02:55.494361 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:55.494321    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1d9b599-ee1c-4504-ab7b-d3d08600624c-tmp-dir\") pod \"test-model-3d8bda-kserve-b5597b86f-jzx8c\" (UID: \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\") " pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"
Jul 28 21:02:55.494531 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:55.494433    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1d9b599-ee1c-4504-ab7b-d3d08600624c-home\") pod \"test-model-3d8bda-kserve-b5597b86f-jzx8c\" (UID: \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\") " pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"
Jul 28 21:02:55.494531 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:55.494515    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1d9b599-ee1c-4504-ab7b-d3d08600624c-tls-certs\") pod \"test-model-3d8bda-kserve-b5597b86f-jzx8c\" (UID: \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\") " pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"
Jul 28 21:02:55.494634 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:55.494576    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2gg9\" (UniqueName: \"kubernetes.io/projected/d1d9b599-ee1c-4504-ab7b-d3d08600624c-kube-api-access-q2gg9\") pod \"test-model-3d8bda-kserve-b5597b86f-jzx8c\" (UID: \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\") " pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"
Jul 28 21:02:55.494634 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:55.494607    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1d9b599-ee1c-4504-ab7b-d3d08600624c-dshm\") pod \"test-model-3d8bda-kserve-b5597b86f-jzx8c\" (UID: \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\") " pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"
Jul 28 21:02:55.494634 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:55.494624    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1d9b599-ee1c-4504-ab7b-d3d08600624c-model-cache\") pod \"test-model-3d8bda-kserve-b5597b86f-jzx8c\" (UID: \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\") " pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"
Jul 28 21:02:55.595834 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:55.595804    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1d9b599-ee1c-4504-ab7b-d3d08600624c-home\") pod \"test-model-3d8bda-kserve-b5597b86f-jzx8c\" (UID: \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\") " pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"
Jul 28 21:02:55.595971 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:55.595849    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1d9b599-ee1c-4504-ab7b-d3d08600624c-tls-certs\") pod \"test-model-3d8bda-kserve-b5597b86f-jzx8c\" (UID: \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\") " pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"
Jul 28 21:02:55.595971 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:55.595945    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2gg9\" (UniqueName: \"kubernetes.io/projected/d1d9b599-ee1c-4504-ab7b-d3d08600624c-kube-api-access-q2gg9\") pod \"test-model-3d8bda-kserve-b5597b86f-jzx8c\" (UID: \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\") " pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"
Jul 28 21:02:55.596063 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:55.595970    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1d9b599-ee1c-4504-ab7b-d3d08600624c-dshm\") pod \"test-model-3d8bda-kserve-b5597b86f-jzx8c\" (UID: \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\") " pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"
Jul 28 21:02:55.596063 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:55.595989    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1d9b599-ee1c-4504-ab7b-d3d08600624c-model-cache\") pod \"test-model-3d8bda-kserve-b5597b86f-jzx8c\" (UID: \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\") " pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"
Jul 28 21:02:55.596063 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:55.596042    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1d9b599-ee1c-4504-ab7b-d3d08600624c-tmp-dir\") pod \"test-model-3d8bda-kserve-b5597b86f-jzx8c\" (UID: \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\") " pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"
Jul 28 21:02:55.596248 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:55.596228    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1d9b599-ee1c-4504-ab7b-d3d08600624c-home\") pod \"test-model-3d8bda-kserve-b5597b86f-jzx8c\" (UID: \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\") " pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"
Jul 28 21:02:55.596411 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:55.596384    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1d9b599-ee1c-4504-ab7b-d3d08600624c-model-cache\") pod \"test-model-3d8bda-kserve-b5597b86f-jzx8c\" (UID: \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\") " pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"
Jul 28 21:02:55.596479 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:55.596442    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1d9b599-ee1c-4504-ab7b-d3d08600624c-tmp-dir\") pod \"test-model-3d8bda-kserve-b5597b86f-jzx8c\" (UID: \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\") " pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"
Jul 28 21:02:55.598119 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:55.598101    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1d9b599-ee1c-4504-ab7b-d3d08600624c-dshm\") pod \"test-model-3d8bda-kserve-b5597b86f-jzx8c\" (UID: \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\") " pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"
Jul 28 21:02:55.598411 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:55.598394    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1d9b599-ee1c-4504-ab7b-d3d08600624c-tls-certs\") pod \"test-model-3d8bda-kserve-b5597b86f-jzx8c\" (UID: \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\") " pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"
Jul 28 21:02:55.607100 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:55.607081    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2gg9\" (UniqueName: \"kubernetes.io/projected/d1d9b599-ee1c-4504-ab7b-d3d08600624c-kube-api-access-q2gg9\") pod \"test-model-3d8bda-kserve-b5597b86f-jzx8c\" (UID: \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\") " pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"
Jul 28 21:02:55.713483 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:55.713389    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"
Jul 28 21:02:55.841113 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:55.841089    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"]
Jul 28 21:02:55.843229 ip-10-0-136-118 kubenswrapper[2556]: W0728 21:02:55.843205    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1d9b599_ee1c_4504_ab7b_d3d08600624c.slice/crio-7368c368b38df51b22540a91cbc5160fac29a9d3643814661a46b4f6a57dcbb7 WatchSource:0}: Error finding container 7368c368b38df51b22540a91cbc5160fac29a9d3643814661a46b4f6a57dcbb7: Status 404 returned error can't find the container with id 7368c368b38df51b22540a91cbc5160fac29a9d3643814661a46b4f6a57dcbb7
Jul 28 21:02:56.142562 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:56.142523    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c" event={"ID":"d1d9b599-ee1c-4504-ab7b-d3d08600624c","Type":"ContainerStarted","Data":"dff269c974023783f673842fcd7dd074765055734a426a91b7082e69bbf34e1d"}
Jul 28 21:02:56.142562 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:56.142566    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c" event={"ID":"d1d9b599-ee1c-4504-ab7b-d3d08600624c","Type":"ContainerStarted","Data":"7368c368b38df51b22540a91cbc5160fac29a9d3643814661a46b4f6a57dcbb7"}
Jul 28 21:02:56.161368 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:02:56.161296    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c" podStartSLOduration=1.161278974 podStartE2EDuration="1.161278974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:02:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:02:56.160588188 +0000 UTC m=+2260.379977088" watchObservedRunningTime="2026-07-28 21:02:56.161278974 +0000 UTC m=+2260.380667859"
Jul 28 21:03:05.714531 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:05.714494    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"
Jul 28 21:03:05.714531 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:05.714534    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"
Jul 28 21:03:05.726983 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:05.726955    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"
Jul 28 21:03:06.197984 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:06.197954    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"
Jul 28 21:03:40.501924 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:40.501889    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"]
Jul 28 21:03:55.521050 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:55.520993    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c" podUID="d1d9b599-ee1c-4504-ab7b-d3d08600624c" containerName="main" containerID="cri-o://dff269c974023783f673842fcd7dd074765055734a426a91b7082e69bbf34e1d" gracePeriod=45
Jul 28 21:03:55.757016 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:55.756987    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"
Jul 28 21:03:55.836976 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:55.836949    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1d9b599-ee1c-4504-ab7b-d3d08600624c-tls-certs\") pod \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\" (UID: \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\") "
Jul 28 21:03:55.836976 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:55.836978    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2gg9\" (UniqueName: \"kubernetes.io/projected/d1d9b599-ee1c-4504-ab7b-d3d08600624c-kube-api-access-q2gg9\") pod \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\" (UID: \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\") "
Jul 28 21:03:55.837151 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:55.836997    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1d9b599-ee1c-4504-ab7b-d3d08600624c-model-cache\") pod \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\" (UID: \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\") "
Jul 28 21:03:55.837151 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:55.837031    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1d9b599-ee1c-4504-ab7b-d3d08600624c-home\") pod \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\" (UID: \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\") "
Jul 28 21:03:55.837151 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:55.837076    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1d9b599-ee1c-4504-ab7b-d3d08600624c-dshm\") pod \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\" (UID: \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\") "
Jul 28 21:03:55.837151 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:55.837144    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1d9b599-ee1c-4504-ab7b-d3d08600624c-tmp-dir\") pod \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\" (UID: \"d1d9b599-ee1c-4504-ab7b-d3d08600624c\") "
Jul 28 21:03:55.837308 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:55.837258    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1d9b599-ee1c-4504-ab7b-d3d08600624c-model-cache" (OuterVolumeSpecName: "model-cache") pod "d1d9b599-ee1c-4504-ab7b-d3d08600624c" (UID: "d1d9b599-ee1c-4504-ab7b-d3d08600624c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:03:55.837308 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:55.837293    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1d9b599-ee1c-4504-ab7b-d3d08600624c-home" (OuterVolumeSpecName: "home") pod "d1d9b599-ee1c-4504-ab7b-d3d08600624c" (UID: "d1d9b599-ee1c-4504-ab7b-d3d08600624c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:03:55.837546 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:55.837515    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1d9b599-ee1c-4504-ab7b-d3d08600624c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d1d9b599-ee1c-4504-ab7b-d3d08600624c" (UID: "d1d9b599-ee1c-4504-ab7b-d3d08600624c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:03:55.837693 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:55.837675    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1d9b599-ee1c-4504-ab7b-d3d08600624c-model-cache\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:03:55.837693 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:55.837692    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1d9b599-ee1c-4504-ab7b-d3d08600624c-home\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:03:55.837882 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:55.837721    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1d9b599-ee1c-4504-ab7b-d3d08600624c-tmp-dir\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:03:55.839158 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:55.839140    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1d9b599-ee1c-4504-ab7b-d3d08600624c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d1d9b599-ee1c-4504-ab7b-d3d08600624c" (UID: "d1d9b599-ee1c-4504-ab7b-d3d08600624c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 21:03:55.839245 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:55.839179    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1d9b599-ee1c-4504-ab7b-d3d08600624c-dshm" (OuterVolumeSpecName: "dshm") pod "d1d9b599-ee1c-4504-ab7b-d3d08600624c" (UID: "d1d9b599-ee1c-4504-ab7b-d3d08600624c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:03:55.839245 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:55.839228    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1d9b599-ee1c-4504-ab7b-d3d08600624c-kube-api-access-q2gg9" (OuterVolumeSpecName: "kube-api-access-q2gg9") pod "d1d9b599-ee1c-4504-ab7b-d3d08600624c" (UID: "d1d9b599-ee1c-4504-ab7b-d3d08600624c"). InnerVolumeSpecName "kube-api-access-q2gg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:03:55.938643 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:55.938618    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1d9b599-ee1c-4504-ab7b-d3d08600624c-tls-certs\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:03:55.938643 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:55.938640    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2gg9\" (UniqueName: \"kubernetes.io/projected/d1d9b599-ee1c-4504-ab7b-d3d08600624c-kube-api-access-q2gg9\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:03:55.938787 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:55.938650    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1d9b599-ee1c-4504-ab7b-d3d08600624c-dshm\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:03:56.410248 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:56.410212    2556 generic.go:356] "Generic (PLEG): container finished" podID="d1d9b599-ee1c-4504-ab7b-d3d08600624c" containerID="dff269c974023783f673842fcd7dd074765055734a426a91b7082e69bbf34e1d" exitCode=0
Jul 28 21:03:56.410454 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:56.410254    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"
Jul 28 21:03:56.410454 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:56.410299    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c" event={"ID":"d1d9b599-ee1c-4504-ab7b-d3d08600624c","Type":"ContainerDied","Data":"dff269c974023783f673842fcd7dd074765055734a426a91b7082e69bbf34e1d"}
Jul 28 21:03:56.410454 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:56.410363    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c" event={"ID":"d1d9b599-ee1c-4504-ab7b-d3d08600624c","Type":"ContainerDied","Data":"7368c368b38df51b22540a91cbc5160fac29a9d3643814661a46b4f6a57dcbb7"}
Jul 28 21:03:56.410454 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:56.410388    2556 scope.go:117] "RemoveContainer" containerID="dff269c974023783f673842fcd7dd074765055734a426a91b7082e69bbf34e1d"
Jul 28 21:03:56.418619 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:56.418601    2556 scope.go:117] "RemoveContainer" containerID="dff269c974023783f673842fcd7dd074765055734a426a91b7082e69bbf34e1d"
Jul 28 21:03:56.418849 ip-10-0-136-118 kubenswrapper[2556]: E0728 21:03:56.418825    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dff269c974023783f673842fcd7dd074765055734a426a91b7082e69bbf34e1d\": container with ID starting with dff269c974023783f673842fcd7dd074765055734a426a91b7082e69bbf34e1d not found: ID does not exist" containerID="dff269c974023783f673842fcd7dd074765055734a426a91b7082e69bbf34e1d"
Jul 28 21:03:56.418915 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:56.418857    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dff269c974023783f673842fcd7dd074765055734a426a91b7082e69bbf34e1d"} err="failed to get container status \"dff269c974023783f673842fcd7dd074765055734a426a91b7082e69bbf34e1d\": rpc error: code = NotFound desc = could not find container \"dff269c974023783f673842fcd7dd074765055734a426a91b7082e69bbf34e1d\": container with ID starting with dff269c974023783f673842fcd7dd074765055734a426a91b7082e69bbf34e1d not found: ID does not exist"
Jul 28 21:03:56.429654 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:56.429627    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"]
Jul 28 21:03:56.440736 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:56.440709    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-3d8bda/test-model-3d8bda-kserve-b5597b86f-jzx8c"]
Jul 28 21:03:57.992506 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:57.992473    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"]
Jul 28 21:03:57.992904 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:57.992725    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp" podUID="a698e01b-ed59-45ff-9ccd-312a43e8bbf9" containerName="istio-proxy" containerID="cri-o://3d183aac0170ad261fd57c973a943e5137a32f9d39fa62aacdcd2f5de59018a1" gracePeriod=30
Jul 28 21:03:58.313770 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:58.313738    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1d9b599-ee1c-4504-ab7b-d3d08600624c" path="/var/lib/kubelet/pods/d1d9b599-ee1c-4504-ab7b-d3d08600624c/volumes"
Jul 28 21:03:59.874114 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:59.874076    2556 patch_prober.go:28] interesting pod/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 21:03:59.874607 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:03:59.874135    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp" podUID="a698e01b-ed59-45ff-9ccd-312a43e8bbf9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 21:04:03.241122 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.241087    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:04:03.404657 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.404618    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-workload-socket\") pod \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") "
Jul 28 21:04:03.404850 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.404673    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-credential-socket\") pod \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") "
Jul 28 21:04:03.404850 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.404731    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istio-data\") pod \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") "
Jul 28 21:04:03.404850 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.404795    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5stp\" (UniqueName: \"kubernetes.io/projected/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-kube-api-access-t5stp\") pod \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") "
Jul 28 21:04:03.404850 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.404827    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istio-envoy\") pod \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") "
Jul 28 21:04:03.405067 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.404863    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-workload-certs\") pod \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") "
Jul 28 21:04:03.405067 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.404950    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a698e01b-ed59-45ff-9ccd-312a43e8bbf9" (UID: "a698e01b-ed59-45ff-9ccd-312a43e8bbf9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:04:03.405067 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.405008    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istio-token\") pod \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") "
Jul 28 21:04:03.405067 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.405037    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a698e01b-ed59-45ff-9ccd-312a43e8bbf9" (UID: "a698e01b-ed59-45ff-9ccd-312a43e8bbf9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:04:03.405067 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.405065    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istiod-ca-cert\") pod \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") "
Jul 28 21:04:03.405296 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.405099    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istio-podinfo\") pod \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\" (UID: \"a698e01b-ed59-45ff-9ccd-312a43e8bbf9\") "
Jul 28 21:04:03.405464 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.405434    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a698e01b-ed59-45ff-9ccd-312a43e8bbf9" (UID: "a698e01b-ed59-45ff-9ccd-312a43e8bbf9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:04:03.405584 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.405481    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-workload-socket\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:04:03.405584 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.405502    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-credential-socket\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:04:03.405584 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.405479    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a698e01b-ed59-45ff-9ccd-312a43e8bbf9" (UID: "a698e01b-ed59-45ff-9ccd-312a43e8bbf9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:04:03.405734 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.405703    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istio-data" (OuterVolumeSpecName: "istio-data") pod "a698e01b-ed59-45ff-9ccd-312a43e8bbf9" (UID: "a698e01b-ed59-45ff-9ccd-312a43e8bbf9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:04:03.407269 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.407249    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a698e01b-ed59-45ff-9ccd-312a43e8bbf9" (UID: "a698e01b-ed59-45ff-9ccd-312a43e8bbf9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 21:04:03.407269 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.407259    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-kube-api-access-t5stp" (OuterVolumeSpecName: "kube-api-access-t5stp") pod "a698e01b-ed59-45ff-9ccd-312a43e8bbf9" (UID: "a698e01b-ed59-45ff-9ccd-312a43e8bbf9"). InnerVolumeSpecName "kube-api-access-t5stp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:04:03.407515 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.407498    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a698e01b-ed59-45ff-9ccd-312a43e8bbf9" (UID: "a698e01b-ed59-45ff-9ccd-312a43e8bbf9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:04:03.407645 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.407627    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istio-token" (OuterVolumeSpecName: "istio-token") pod "a698e01b-ed59-45ff-9ccd-312a43e8bbf9" (UID: "a698e01b-ed59-45ff-9ccd-312a43e8bbf9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:04:03.443498 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.443461    2556 generic.go:356] "Generic (PLEG): container finished" podID="a698e01b-ed59-45ff-9ccd-312a43e8bbf9" containerID="3d183aac0170ad261fd57c973a943e5137a32f9d39fa62aacdcd2f5de59018a1" exitCode=0
Jul 28 21:04:03.443647 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.443510    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"
Jul 28 21:04:03.443647 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.443533    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp" event={"ID":"a698e01b-ed59-45ff-9ccd-312a43e8bbf9","Type":"ContainerDied","Data":"3d183aac0170ad261fd57c973a943e5137a32f9d39fa62aacdcd2f5de59018a1"}
Jul 28 21:04:03.443647 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.443583    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp" event={"ID":"a698e01b-ed59-45ff-9ccd-312a43e8bbf9","Type":"ContainerDied","Data":"e2aed6178693b928884ca601cb2e8d90650d61fe616f4d414792da0d3cb50aae"}
Jul 28 21:04:03.443647 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.443607    2556 scope.go:117] "RemoveContainer" containerID="3d183aac0170ad261fd57c973a943e5137a32f9d39fa62aacdcd2f5de59018a1"
Jul 28 21:04:03.452791 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.452774    2556 scope.go:117] "RemoveContainer" containerID="20d9701f63d97283bb9b691aeb36714729f94c609c18c9777bf86e76bc110cf6"
Jul 28 21:04:03.461634 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.461612    2556 scope.go:117] "RemoveContainer" containerID="3d183aac0170ad261fd57c973a943e5137a32f9d39fa62aacdcd2f5de59018a1"
Jul 28 21:04:03.461950 ip-10-0-136-118 kubenswrapper[2556]: E0728 21:04:03.461930    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d183aac0170ad261fd57c973a943e5137a32f9d39fa62aacdcd2f5de59018a1\": container with ID starting with 3d183aac0170ad261fd57c973a943e5137a32f9d39fa62aacdcd2f5de59018a1 not found: ID does not exist" containerID="3d183aac0170ad261fd57c973a943e5137a32f9d39fa62aacdcd2f5de59018a1"
Jul 28 21:04:03.462016 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.461958    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d183aac0170ad261fd57c973a943e5137a32f9d39fa62aacdcd2f5de59018a1"} err="failed to get container status \"3d183aac0170ad261fd57c973a943e5137a32f9d39fa62aacdcd2f5de59018a1\": rpc error: code = NotFound desc = could not find container \"3d183aac0170ad261fd57c973a943e5137a32f9d39fa62aacdcd2f5de59018a1\": container with ID starting with 3d183aac0170ad261fd57c973a943e5137a32f9d39fa62aacdcd2f5de59018a1 not found: ID does not exist"
Jul 28 21:04:03.462016 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.461976    2556 scope.go:117] "RemoveContainer" containerID="20d9701f63d97283bb9b691aeb36714729f94c609c18c9777bf86e76bc110cf6"
Jul 28 21:04:03.462224 ip-10-0-136-118 kubenswrapper[2556]: E0728 21:04:03.462207    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20d9701f63d97283bb9b691aeb36714729f94c609c18c9777bf86e76bc110cf6\": container with ID starting with 20d9701f63d97283bb9b691aeb36714729f94c609c18c9777bf86e76bc110cf6 not found: ID does not exist" containerID="20d9701f63d97283bb9b691aeb36714729f94c609c18c9777bf86e76bc110cf6"
Jul 28 21:04:03.462317 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.462233    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20d9701f63d97283bb9b691aeb36714729f94c609c18c9777bf86e76bc110cf6"} err="failed to get container status \"20d9701f63d97283bb9b691aeb36714729f94c609c18c9777bf86e76bc110cf6\": rpc error: code = NotFound desc = could not find container \"20d9701f63d97283bb9b691aeb36714729f94c609c18c9777bf86e76bc110cf6\": container with ID starting with 20d9701f63d97283bb9b691aeb36714729f94c609c18c9777bf86e76bc110cf6 not found: ID does not exist"
Jul 28 21:04:03.466647 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.466622    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"]
Jul 28 21:04:03.473796 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.473770    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-7465ef-openshift-default-54564975d4-2q4zp"]
Jul 28 21:04:03.506900 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.506865    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5stp\" (UniqueName: \"kubernetes.io/projected/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-kube-api-access-t5stp\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:04:03.506900 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.506898    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istio-envoy\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:04:03.507087 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.506912    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-workload-certs\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:04:03.507087 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.506923    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istio-token\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:04:03.507087 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.506933    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istiod-ca-cert\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:04:03.507087 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.506944    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istio-podinfo\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:04:03.507087 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:03.506953    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a698e01b-ed59-45ff-9ccd-312a43e8bbf9-istio-data\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:04:04.313571 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:04.313538    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a698e01b-ed59-45ff-9ccd-312a43e8bbf9" path="/var/lib/kubelet/pods/a698e01b-ed59-45ff-9ccd-312a43e8bbf9/volumes"
Jul 28 21:04:15.511389 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:15.511292    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"]
Jul 28 21:04:15.511777 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:15.511539    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96" podUID="d6f76ec2-7cd0-4f24-8403-e096b3ecad23" containerName="istio-proxy" containerID="cri-o://dfc2735213daef9d1dfa84f8a6b5753a9e00978b5d6ea3ef15a936b7cce63b24" gracePeriod=30
Jul 28 21:04:15.864918 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:15.864871    2556 patch_prober.go:28] interesting pod/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 21:04:15.865103 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:15.864936    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96" podUID="d6f76ec2-7cd0-4f24-8403-e096b3ecad23" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 21:04:16.429973 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.429948    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"]
Jul 28 21:04:16.430411 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.430393    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1d9b599-ee1c-4504-ab7b-d3d08600624c" containerName="main"
Jul 28 21:04:16.430462 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.430415    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1d9b599-ee1c-4504-ab7b-d3d08600624c" containerName="main"
Jul 28 21:04:16.430462 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.430435    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a698e01b-ed59-45ff-9ccd-312a43e8bbf9" containerName="istio-proxy"
Jul 28 21:04:16.430462 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.430443    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a698e01b-ed59-45ff-9ccd-312a43e8bbf9" containerName="istio-proxy"
Jul 28 21:04:16.430462 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.430458    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a698e01b-ed59-45ff-9ccd-312a43e8bbf9" containerName="istio-proxy"
Jul 28 21:04:16.430588 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.430466    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a698e01b-ed59-45ff-9ccd-312a43e8bbf9" containerName="istio-proxy"
Jul 28 21:04:16.430588 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.430577    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a698e01b-ed59-45ff-9ccd-312a43e8bbf9" containerName="istio-proxy"
Jul 28 21:04:16.430650 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.430591    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a698e01b-ed59-45ff-9ccd-312a43e8bbf9" containerName="istio-proxy"
Jul 28 21:04:16.430650 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.430603    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1d9b599-ee1c-4504-ab7b-d3d08600624c" containerName="main"
Jul 28 21:04:16.435221 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.435202    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.437809 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.437787    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-8e6a5a-openshift-default-dockercfg-zzpsn\""
Jul 28 21:04:16.446942 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.446917    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"]
Jul 28 21:04:16.527847 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.527807    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istio-token\") pod \"e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") " pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.528245 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.527863    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istiod-ca-cert\") pod \"e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") " pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.528245 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.527891    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-credential-socket\") pod \"e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") " pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.528245 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.527914    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx8tw\" (UniqueName: \"kubernetes.io/projected/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-kube-api-access-tx8tw\") pod \"e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") " pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.528245 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.527944    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-workload-socket\") pod \"e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") " pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.528245 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.527961    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-workload-certs\") pod \"e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") " pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.528245 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.527985    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istio-data\") pod \"e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") " pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.528245 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.528023    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istio-podinfo\") pod \"e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") " pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.528245 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.528045    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istio-envoy\") pod \"e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") " pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.629265 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.629230    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istio-token\") pod \"e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") " pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.629485 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.629284    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istiod-ca-cert\") pod \"e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") " pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.629485 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.629315    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-credential-socket\") pod \"e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") " pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.629485 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.629337    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx8tw\" (UniqueName: \"kubernetes.io/projected/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-kube-api-access-tx8tw\") pod \"e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") " pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.629485 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.629433    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-workload-socket\") pod \"e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") " pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.629485 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.629465    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-workload-certs\") pod \"e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") " pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.629695 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.629490    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istio-data\") pod \"e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") " pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.629695 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.629555    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istio-podinfo\") pod \"e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") " pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.629695 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.629581    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istio-envoy\") pod \"e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") " pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.629909 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.629884    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-credential-socket\") pod \"e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") " pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.630023 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.629994    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-workload-socket\") pod \"e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") " pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.630171 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.630152    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istio-data\") pod \"e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") " pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.630531 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.630510    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istiod-ca-cert\") pod \"e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") " pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.630694 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.630673    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-workload-certs\") pod \"e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") " pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.632286 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.632261    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istio-envoy\") pod \"e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") " pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.633001 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.632967    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istio-podinfo\") pod \"e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") " pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.637796 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.637769    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx8tw\" (UniqueName: \"kubernetes.io/projected/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-kube-api-access-tx8tw\") pod \"e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") " pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.638192 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.638170    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istio-token\") pod \"e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") " pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.745183 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.745099    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:16.885440 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.885413    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"]
Jul 28 21:04:16.887204 ip-10-0-136-118 kubenswrapper[2556]: W0728 21:04:16.887179    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod373cca66_5bcc_49ca_bb3f_7ad16a56dd74.slice/crio-d70a2a56ea44827a3227ea21562f0aae9a1012f860efa1521c60af1e8e47327e WatchSource:0}: Error finding container d70a2a56ea44827a3227ea21562f0aae9a1012f860efa1521c60af1e8e47327e: Status 404 returned error can't find the container with id d70a2a56ea44827a3227ea21562f0aae9a1012f860efa1521c60af1e8e47327e
Jul 28 21:04:16.889457 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.889418    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:04:16.889536 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.889519    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:04:16.889577 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:16.889563    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:04:17.513201 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:17.513166    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6" event={"ID":"373cca66-5bcc-49ca-bb3f-7ad16a56dd74","Type":"ContainerStarted","Data":"ede758eda512d760f287c5ee74de471a9e6cdab92665e1da14c429af58786664"}
Jul 28 21:04:17.513427 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:17.513229    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6" event={"ID":"373cca66-5bcc-49ca-bb3f-7ad16a56dd74","Type":"ContainerStarted","Data":"d70a2a56ea44827a3227ea21562f0aae9a1012f860efa1521c60af1e8e47327e"}
Jul 28 21:04:17.533425 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:17.533300    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6" podStartSLOduration=1.533276763 podStartE2EDuration="1.533276763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:04:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:04:17.532961036 +0000 UTC m=+2341.752349922" watchObservedRunningTime="2026-07-28 21:04:17.533276763 +0000 UTC m=+2341.752665649"
Jul 28 21:04:17.746282 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:17.746240    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:17.751156 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:17.751129    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:18.518206 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:18.518174    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:18.519224 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:18.519204    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:20.761692 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:20.761666    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:04:20.868786 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:20.868752    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istio-token\") pod \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") "
Jul 28 21:04:20.868786 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:20.868787    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jt84m\" (UniqueName: \"kubernetes.io/projected/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-kube-api-access-jt84m\") pod \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") "
Jul 28 21:04:20.869051 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:20.868839    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-workload-socket\") pod \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") "
Jul 28 21:04:20.869051 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:20.868869    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-credential-socket\") pod \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") "
Jul 28 21:04:20.869051 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:20.868898    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istiod-ca-cert\") pod \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") "
Jul 28 21:04:20.869051 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:20.868938    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-workload-certs\") pod \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") "
Jul 28 21:04:20.869051 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:20.868988    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istio-podinfo\") pod \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") "
Jul 28 21:04:20.869051 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:20.869034    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istio-data\") pod \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") "
Jul 28 21:04:20.869376 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:20.869068    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d6f76ec2-7cd0-4f24-8403-e096b3ecad23" (UID: "d6f76ec2-7cd0-4f24-8403-e096b3ecad23"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:04:20.869376 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:20.869099    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istio-envoy\") pod \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\" (UID: \"d6f76ec2-7cd0-4f24-8403-e096b3ecad23\") "
Jul 28 21:04:20.869376 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:20.869306    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d6f76ec2-7cd0-4f24-8403-e096b3ecad23" (UID: "d6f76ec2-7cd0-4f24-8403-e096b3ecad23"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:04:20.869549 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:20.869459    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-workload-socket\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:04:20.869549 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:20.869482    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-workload-certs\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:04:20.869549 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:20.869492    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d6f76ec2-7cd0-4f24-8403-e096b3ecad23" (UID: "d6f76ec2-7cd0-4f24-8403-e096b3ecad23"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:04:20.869707 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:20.869574    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d6f76ec2-7cd0-4f24-8403-e096b3ecad23" (UID: "d6f76ec2-7cd0-4f24-8403-e096b3ecad23"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:04:20.869809 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:20.869789    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istio-data" (OuterVolumeSpecName: "istio-data") pod "d6f76ec2-7cd0-4f24-8403-e096b3ecad23" (UID: "d6f76ec2-7cd0-4f24-8403-e096b3ecad23"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:04:20.871195 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:20.871171    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istio-token" (OuterVolumeSpecName: "istio-token") pod "d6f76ec2-7cd0-4f24-8403-e096b3ecad23" (UID: "d6f76ec2-7cd0-4f24-8403-e096b3ecad23"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:04:20.871324 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:20.871279    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d6f76ec2-7cd0-4f24-8403-e096b3ecad23" (UID: "d6f76ec2-7cd0-4f24-8403-e096b3ecad23"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:04:20.871528 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:20.871508    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d6f76ec2-7cd0-4f24-8403-e096b3ecad23" (UID: "d6f76ec2-7cd0-4f24-8403-e096b3ecad23"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 21:04:20.871627 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:20.871606    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-kube-api-access-jt84m" (OuterVolumeSpecName: "kube-api-access-jt84m") pod "d6f76ec2-7cd0-4f24-8403-e096b3ecad23" (UID: "d6f76ec2-7cd0-4f24-8403-e096b3ecad23"). InnerVolumeSpecName "kube-api-access-jt84m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:04:20.970504 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:20.970468    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istio-podinfo\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:04:20.970504 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:20.970498    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istio-data\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:04:20.970504 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:20.970507    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istio-envoy\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:04:20.970732 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:20.970516    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istio-token\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:04:20.970732 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:20.970525    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jt84m\" (UniqueName: \"kubernetes.io/projected/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-kube-api-access-jt84m\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:04:20.970732 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:20.970534    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-credential-socket\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:04:20.970732 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:20.970543    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6f76ec2-7cd0-4f24-8403-e096b3ecad23-istiod-ca-cert\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:04:21.540867 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:21.540831    2556 generic.go:356] "Generic (PLEG): container finished" podID="d6f76ec2-7cd0-4f24-8403-e096b3ecad23" containerID="dfc2735213daef9d1dfa84f8a6b5753a9e00978b5d6ea3ef15a936b7cce63b24" exitCode=0
Jul 28 21:04:21.541025 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:21.540875    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"
Jul 28 21:04:21.541025 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:21.540895    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96" event={"ID":"d6f76ec2-7cd0-4f24-8403-e096b3ecad23","Type":"ContainerDied","Data":"dfc2735213daef9d1dfa84f8a6b5753a9e00978b5d6ea3ef15a936b7cce63b24"}
Jul 28 21:04:21.541025 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:21.540951    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96" event={"ID":"d6f76ec2-7cd0-4f24-8403-e096b3ecad23","Type":"ContainerDied","Data":"613015c600389ec2e1df6b838a227baed51fcf63a1a230a7752c592f05b1872b"}
Jul 28 21:04:21.541025 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:21.540974    2556 scope.go:117] "RemoveContainer" containerID="dfc2735213daef9d1dfa84f8a6b5753a9e00978b5d6ea3ef15a936b7cce63b24"
Jul 28 21:04:21.551982 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:21.551928    2556 scope.go:117] "RemoveContainer" containerID="9d7883869e6de853d0ab0f761141122880ebf2f4def5be74447d66762c408cbb"
Jul 28 21:04:21.559939 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:21.559922    2556 scope.go:117] "RemoveContainer" containerID="dfc2735213daef9d1dfa84f8a6b5753a9e00978b5d6ea3ef15a936b7cce63b24"
Jul 28 21:04:21.560203 ip-10-0-136-118 kubenswrapper[2556]: E0728 21:04:21.560184    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfc2735213daef9d1dfa84f8a6b5753a9e00978b5d6ea3ef15a936b7cce63b24\": container with ID starting with dfc2735213daef9d1dfa84f8a6b5753a9e00978b5d6ea3ef15a936b7cce63b24 not found: ID does not exist" containerID="dfc2735213daef9d1dfa84f8a6b5753a9e00978b5d6ea3ef15a936b7cce63b24"
Jul 28 21:04:21.560245 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:21.560213    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfc2735213daef9d1dfa84f8a6b5753a9e00978b5d6ea3ef15a936b7cce63b24"} err="failed to get container status \"dfc2735213daef9d1dfa84f8a6b5753a9e00978b5d6ea3ef15a936b7cce63b24\": rpc error: code = NotFound desc = could not find container \"dfc2735213daef9d1dfa84f8a6b5753a9e00978b5d6ea3ef15a936b7cce63b24\": container with ID starting with dfc2735213daef9d1dfa84f8a6b5753a9e00978b5d6ea3ef15a936b7cce63b24 not found: ID does not exist"
Jul 28 21:04:21.560245 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:21.560231    2556 scope.go:117] "RemoveContainer" containerID="9d7883869e6de853d0ab0f761141122880ebf2f4def5be74447d66762c408cbb"
Jul 28 21:04:21.560479 ip-10-0-136-118 kubenswrapper[2556]: E0728 21:04:21.560460    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d7883869e6de853d0ab0f761141122880ebf2f4def5be74447d66762c408cbb\": container with ID starting with 9d7883869e6de853d0ab0f761141122880ebf2f4def5be74447d66762c408cbb not found: ID does not exist" containerID="9d7883869e6de853d0ab0f761141122880ebf2f4def5be74447d66762c408cbb"
Jul 28 21:04:21.560527 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:21.560486    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d7883869e6de853d0ab0f761141122880ebf2f4def5be74447d66762c408cbb"} err="failed to get container status \"9d7883869e6de853d0ab0f761141122880ebf2f4def5be74447d66762c408cbb\": rpc error: code = NotFound desc = could not find container \"9d7883869e6de853d0ab0f761141122880ebf2f4def5be74447d66762c408cbb\": container with ID starting with 9d7883869e6de853d0ab0f761141122880ebf2f4def5be74447d66762c408cbb not found: ID does not exist"
Jul 28 21:04:21.565715 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:21.565693    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"]
Jul 28 21:04:21.572272 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:21.572251    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-3d8bda-openshift-default-589c9b7448-nfd96"]
Jul 28 21:04:22.313555 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:22.313517    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6f76ec2-7cd0-4f24-8403-e096b3ecad23" path="/var/lib/kubelet/pods/d6f76ec2-7cd0-4f24-8403-e096b3ecad23/volumes"
Jul 28 21:04:33.519335 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:33.519298    2556 patch_prober.go:28] interesting pod/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Jul 28 21:04:33.519772 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:33.519399    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6" podUID="373cca66-5bcc-49ca-bb3f-7ad16a56dd74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Jul 28 21:04:33.602606 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:33.602573    2556 generic.go:356] "Generic (PLEG): container finished" podID="373cca66-5bcc-49ca-bb3f-7ad16a56dd74" containerID="ede758eda512d760f287c5ee74de471a9e6cdab92665e1da14c429af58786664" exitCode=0
Jul 28 21:04:33.602759 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:33.602649    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6" event={"ID":"373cca66-5bcc-49ca-bb3f-7ad16a56dd74","Type":"ContainerDied","Data":"ede758eda512d760f287c5ee74de471a9e6cdab92665e1da14c429af58786664"}
Jul 28 21:04:33.603112 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:33.603094    2556 scope.go:117] "RemoveContainer" containerID="ede758eda512d760f287c5ee74de471a9e6cdab92665e1da14c429af58786664"
Jul 28 21:04:33.604050 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:33.604022    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:04:33.604103 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:33.604090    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:04:33.604159 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:33.604148    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:04:34.609233 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:34.609199    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6" event={"ID":"373cca66-5bcc-49ca-bb3f-7ad16a56dd74","Type":"ContainerStarted","Data":"15909c2e302162fb9cc6b30f0326163901822d4903260f1fef59f8c985665c0d"}
Jul 28 21:04:34.745855 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:34.745828    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:34.746063 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:34.746001    2556 patch_prober.go:28] interesting pod/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Jul 28 21:04:34.746139 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:34.746078    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6" podUID="373cca66-5bcc-49ca-bb3f-7ad16a56dd74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Jul 28 21:04:35.746230 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:35.746192    2556 patch_prober.go:28] interesting pod/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Jul 28 21:04:35.746653 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:35.746250    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6" podUID="373cca66-5bcc-49ca-bb3f-7ad16a56dd74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Jul 28 21:04:36.745659 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:36.745622    2556 patch_prober.go:28] interesting pod/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Jul 28 21:04:36.745827 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:36.745678    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6" podUID="373cca66-5bcc-49ca-bb3f-7ad16a56dd74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Jul 28 21:04:37.745849 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:37.745812    2556 patch_prober.go:28] interesting pod/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Jul 28 21:04:37.746244 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:37.745866    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6" podUID="373cca66-5bcc-49ca-bb3f-7ad16a56dd74" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Jul 28 21:04:38.749361 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:38.749317    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:38.749717 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:38.749587    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:38.750189 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:38.750173    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:04:45.354434 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.354399    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"]
Jul 28 21:04:45.354818 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.354753    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6f76ec2-7cd0-4f24-8403-e096b3ecad23" containerName="istio-proxy"
Jul 28 21:04:45.354818 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.354763    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6f76ec2-7cd0-4f24-8403-e096b3ecad23" containerName="istio-proxy"
Jul 28 21:04:45.354818 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.354772    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6f76ec2-7cd0-4f24-8403-e096b3ecad23" containerName="istio-proxy"
Jul 28 21:04:45.354818 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.354778    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6f76ec2-7cd0-4f24-8403-e096b3ecad23" containerName="istio-proxy"
Jul 28 21:04:45.354960 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.354826    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6f76ec2-7cd0-4f24-8403-e096b3ecad23" containerName="istio-proxy"
Jul 28 21:04:45.354960 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.354834    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6f76ec2-7cd0-4f24-8403-e096b3ecad23" containerName="istio-proxy"
Jul 28 21:04:45.357997 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.357981    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.360875 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.360855    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-fec7c6-openshift-default-dockercfg-xsgd7\""
Jul 28 21:04:45.390071 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.390037    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"]
Jul 28 21:04:45.489197 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.489158    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-workload-certs\") pod \"e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") " pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.489389 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.489227    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-workload-socket\") pod \"e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") " pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.489389 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.489246    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istio-envoy\") pod \"e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") " pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.489389 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.489263    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istio-data\") pod \"e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") " pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.489389 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.489280    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istiod-ca-cert\") pod \"e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") " pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.489389 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.489335    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6cv5\" (UniqueName: \"kubernetes.io/projected/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-kube-api-access-g6cv5\") pod \"e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") " pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.489389 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.489390    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istio-token\") pod \"e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") " pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.489615 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.489410    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istio-podinfo\") pod \"e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") " pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.489615 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.489430    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-credential-socket\") pod \"e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") " pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.590857 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.590810    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-workload-socket\") pod \"e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") " pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.590857 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.590858    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istio-envoy\") pod \"e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") " pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.591154 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.590887    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istio-data\") pod \"e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") " pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.591154 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.590915    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istiod-ca-cert\") pod \"e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") " pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.591154 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.590963    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6cv5\" (UniqueName: \"kubernetes.io/projected/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-kube-api-access-g6cv5\") pod \"e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") " pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.591154 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.590989    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istio-token\") pod \"e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") " pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.591154 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.591011    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istio-podinfo\") pod \"e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") " pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.591154 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.591040    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-credential-socket\") pod \"e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") " pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.591154 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.591077    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-workload-certs\") pod \"e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") " pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.591537 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.591402    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istio-data\") pod \"e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") " pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.591537 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.591508    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-workload-certs\") pod \"e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") " pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.591648 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.591614    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-workload-socket\") pod \"e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") " pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.591776 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.591700    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-credential-socket\") pod \"e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") " pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.591776 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.591725    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istiod-ca-cert\") pod \"e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") " pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.593189 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.593162    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istio-envoy\") pod \"e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") " pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.593480 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.593463    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istio-podinfo\") pod \"e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") " pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.599174 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.599151    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istio-token\") pod \"e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") " pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.599509 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.599487    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6cv5\" (UniqueName: \"kubernetes.io/projected/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-kube-api-access-g6cv5\") pod \"e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") " pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.669182 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.669099    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:45.803291 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.803259    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"]
Jul 28 21:04:45.806113 ip-10-0-136-118 kubenswrapper[2556]: W0728 21:04:45.806082    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5e4b3a4_e5e3_42d5_9525_706361c5d2b1.slice/crio-eae13c8680d0d58593a9b12c3bc151ef86b2a9fe47bd99e2a707962613b167f9 WatchSource:0}: Error finding container eae13c8680d0d58593a9b12c3bc151ef86b2a9fe47bd99e2a707962613b167f9: Status 404 returned error can't find the container with id eae13c8680d0d58593a9b12c3bc151ef86b2a9fe47bd99e2a707962613b167f9
Jul 28 21:04:45.808557 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.808526    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:04:45.808625 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.808591    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:04:45.808625 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:45.808621    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:04:46.664823 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:46.664790    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg" event={"ID":"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1","Type":"ContainerStarted","Data":"231c15f45325e89470199b5fe5861eb537eb8b7a7ff9bf38783142b60a003b09"}
Jul 28 21:04:46.665287 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:46.664838    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg" event={"ID":"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1","Type":"ContainerStarted","Data":"eae13c8680d0d58593a9b12c3bc151ef86b2a9fe47bd99e2a707962613b167f9"}
Jul 28 21:04:46.669459 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:46.669439    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:46.674330 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:46.674309    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:46.685759 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:46.685714    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg" podStartSLOduration=1.685700158 podStartE2EDuration="1.685700158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:04:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:04:46.684319977 +0000 UTC m=+2370.903708861" watchObservedRunningTime="2026-07-28 21:04:46.685700158 +0000 UTC m=+2370.905089042"
Jul 28 21:04:47.670708 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:47.670673    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:04:47.671735 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:04:47.671714    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:05:03.689999 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:03.689323    2556 patch_prober.go:28] interesting pod/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 21:05:03.689999 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:03.689408    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg" podUID="e5e4b3a4-e5e3-42d5-9525-706361c5d2b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 21:05:03.746853 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:03.746820    2556 generic.go:356] "Generic (PLEG): container finished" podID="e5e4b3a4-e5e3-42d5-9525-706361c5d2b1" containerID="231c15f45325e89470199b5fe5861eb537eb8b7a7ff9bf38783142b60a003b09" exitCode=0
Jul 28 21:05:03.746984 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:03.746889    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg" event={"ID":"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1","Type":"ContainerDied","Data":"231c15f45325e89470199b5fe5861eb537eb8b7a7ff9bf38783142b60a003b09"}
Jul 28 21:05:03.747270 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:03.747255    2556 scope.go:117] "RemoveContainer" containerID="231c15f45325e89470199b5fe5861eb537eb8b7a7ff9bf38783142b60a003b09"
Jul 28 21:05:03.748243 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:03.748219    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:05:03.748293 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:03.748280    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:05:03.748338 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:03.748311    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:05:04.752976 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:04.752945    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg" event={"ID":"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1","Type":"ContainerStarted","Data":"5b52cbf1a44cc39ed783f295e4f9076c73a77b947c3ab545cb694f629e2df7da"}
Jul 28 21:05:05.670230 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:05.670180    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:05:05.670482 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:05.670458    2556 patch_prober.go:28] interesting pod/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 28 21:05:05.670534 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:05.670517    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg" podUID="e5e4b3a4-e5e3-42d5-9525-706361c5d2b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 28 21:05:06.669962 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:06.669927    2556 patch_prober.go:28] interesting pod/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 28 21:05:06.670328 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:06.669976    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg" podUID="e5e4b3a4-e5e3-42d5-9525-706361c5d2b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 28 21:05:07.669402 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:07.669371    2556 patch_prober.go:28] interesting pod/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 28 21:05:07.669567 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:07.669419    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg" podUID="e5e4b3a4-e5e3-42d5-9525-706361c5d2b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 28 21:05:08.672868 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:08.672833    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:05:08.673328 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:08.673215    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:05:08.673765 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:08.673746    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:05:38.979074 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:38.978995    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"]
Jul 28 21:05:38.979581 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:38.979218    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6" podUID="373cca66-5bcc-49ca-bb3f-7ad16a56dd74" containerName="istio-proxy" containerID="cri-o://15909c2e302162fb9cc6b30f0326163901822d4903260f1fef59f8c985665c0d" gracePeriod=30
Jul 28 21:05:44.221772 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.221745    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:05:44.308481 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.308454    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istio-token\") pod \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") "
Jul 28 21:05:44.308645 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.308495    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-workload-certs\") pod \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") "
Jul 28 21:05:44.308645 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.308518    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-workload-socket\") pod \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") "
Jul 28 21:05:44.308645 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.308544    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istio-podinfo\") pod \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") "
Jul 28 21:05:44.308645 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.308592    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-credential-socket\") pod \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") "
Jul 28 21:05:44.308645 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.308616    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istio-data\") pod \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") "
Jul 28 21:05:44.308910 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.308662    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tx8tw\" (UniqueName: \"kubernetes.io/projected/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-kube-api-access-tx8tw\") pod \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") "
Jul 28 21:05:44.308910 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.308687    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istio-envoy\") pod \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") "
Jul 28 21:05:44.308910 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.308723    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istiod-ca-cert\") pod \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\" (UID: \"373cca66-5bcc-49ca-bb3f-7ad16a56dd74\") "
Jul 28 21:05:44.308910 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.308791    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "373cca66-5bcc-49ca-bb3f-7ad16a56dd74" (UID: "373cca66-5bcc-49ca-bb3f-7ad16a56dd74"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:05:44.308910 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.308821    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "373cca66-5bcc-49ca-bb3f-7ad16a56dd74" (UID: "373cca66-5bcc-49ca-bb3f-7ad16a56dd74"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:05:44.309402 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.308956    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "373cca66-5bcc-49ca-bb3f-7ad16a56dd74" (UID: "373cca66-5bcc-49ca-bb3f-7ad16a56dd74"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:05:44.309402 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.309076    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-workload-certs\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:05:44.309402 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.309097    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-workload-socket\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:05:44.309402 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.309139    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-credential-socket\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:05:44.309402 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.309322    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "373cca66-5bcc-49ca-bb3f-7ad16a56dd74" (UID: "373cca66-5bcc-49ca-bb3f-7ad16a56dd74"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:05:44.309752 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.309722    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istio-data" (OuterVolumeSpecName: "istio-data") pod "373cca66-5bcc-49ca-bb3f-7ad16a56dd74" (UID: "373cca66-5bcc-49ca-bb3f-7ad16a56dd74"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:05:44.310900 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.310871    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "373cca66-5bcc-49ca-bb3f-7ad16a56dd74" (UID: "373cca66-5bcc-49ca-bb3f-7ad16a56dd74"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:05:44.311369 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.311156    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istio-token" (OuterVolumeSpecName: "istio-token") pod "373cca66-5bcc-49ca-bb3f-7ad16a56dd74" (UID: "373cca66-5bcc-49ca-bb3f-7ad16a56dd74"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:05:44.311369 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.311282    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "373cca66-5bcc-49ca-bb3f-7ad16a56dd74" (UID: "373cca66-5bcc-49ca-bb3f-7ad16a56dd74"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 21:05:44.311369 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.311310    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-kube-api-access-tx8tw" (OuterVolumeSpecName: "kube-api-access-tx8tw") pod "373cca66-5bcc-49ca-bb3f-7ad16a56dd74" (UID: "373cca66-5bcc-49ca-bb3f-7ad16a56dd74"). InnerVolumeSpecName "kube-api-access-tx8tw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:05:44.409810 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.409777    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istio-token\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:05:44.409810 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.409803    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istio-podinfo\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:05:44.410003 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.409817    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istio-data\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:05:44.410003 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.409830    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx8tw\" (UniqueName: \"kubernetes.io/projected/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-kube-api-access-tx8tw\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:05:44.410003 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.409843    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istio-envoy\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:05:44.410003 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.409854    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/373cca66-5bcc-49ca-bb3f-7ad16a56dd74-istiod-ca-cert\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:05:44.932651 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.932616    2556 generic.go:356] "Generic (PLEG): container finished" podID="373cca66-5bcc-49ca-bb3f-7ad16a56dd74" containerID="15909c2e302162fb9cc6b30f0326163901822d4903260f1fef59f8c985665c0d" exitCode=0
Jul 28 21:05:44.932651 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.932653    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6" event={"ID":"373cca66-5bcc-49ca-bb3f-7ad16a56dd74","Type":"ContainerDied","Data":"15909c2e302162fb9cc6b30f0326163901822d4903260f1fef59f8c985665c0d"}
Jul 28 21:05:44.932832 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.932664    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"
Jul 28 21:05:44.932832 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.932695    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6" event={"ID":"373cca66-5bcc-49ca-bb3f-7ad16a56dd74","Type":"ContainerDied","Data":"d70a2a56ea44827a3227ea21562f0aae9a1012f860efa1521c60af1e8e47327e"}
Jul 28 21:05:44.932832 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.932717    2556 scope.go:117] "RemoveContainer" containerID="15909c2e302162fb9cc6b30f0326163901822d4903260f1fef59f8c985665c0d"
Jul 28 21:05:44.941514 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.941497    2556 scope.go:117] "RemoveContainer" containerID="ede758eda512d760f287c5ee74de471a9e6cdab92665e1da14c429af58786664"
Jul 28 21:05:44.949553 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.949530    2556 scope.go:117] "RemoveContainer" containerID="15909c2e302162fb9cc6b30f0326163901822d4903260f1fef59f8c985665c0d"
Jul 28 21:05:44.949826 ip-10-0-136-118 kubenswrapper[2556]: E0728 21:05:44.949798    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15909c2e302162fb9cc6b30f0326163901822d4903260f1fef59f8c985665c0d\": container with ID starting with 15909c2e302162fb9cc6b30f0326163901822d4903260f1fef59f8c985665c0d not found: ID does not exist" containerID="15909c2e302162fb9cc6b30f0326163901822d4903260f1fef59f8c985665c0d"
Jul 28 21:05:44.949918 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.949840    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15909c2e302162fb9cc6b30f0326163901822d4903260f1fef59f8c985665c0d"} err="failed to get container status \"15909c2e302162fb9cc6b30f0326163901822d4903260f1fef59f8c985665c0d\": rpc error: code = NotFound desc = could not find container \"15909c2e302162fb9cc6b30f0326163901822d4903260f1fef59f8c985665c0d\": container with ID starting with 15909c2e302162fb9cc6b30f0326163901822d4903260f1fef59f8c985665c0d not found: ID does not exist"
Jul 28 21:05:44.949918 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.949869    2556 scope.go:117] "RemoveContainer" containerID="ede758eda512d760f287c5ee74de471a9e6cdab92665e1da14c429af58786664"
Jul 28 21:05:44.950165 ip-10-0-136-118 kubenswrapper[2556]: E0728 21:05:44.950147    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ede758eda512d760f287c5ee74de471a9e6cdab92665e1da14c429af58786664\": container with ID starting with ede758eda512d760f287c5ee74de471a9e6cdab92665e1da14c429af58786664 not found: ID does not exist" containerID="ede758eda512d760f287c5ee74de471a9e6cdab92665e1da14c429af58786664"
Jul 28 21:05:44.950220 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.950172    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ede758eda512d760f287c5ee74de471a9e6cdab92665e1da14c429af58786664"} err="failed to get container status \"ede758eda512d760f287c5ee74de471a9e6cdab92665e1da14c429af58786664\": rpc error: code = NotFound desc = could not find container \"ede758eda512d760f287c5ee74de471a9e6cdab92665e1da14c429af58786664\": container with ID starting with ede758eda512d760f287c5ee74de471a9e6cdab92665e1da14c429af58786664 not found: ID does not exist"
Jul 28 21:05:44.950912 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.950893    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"]
Jul 28 21:05:44.954010 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:44.953989    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-8e6a5a-openshift-default-7c9b899fc6-jv5w6"]
Jul 28 21:05:46.313554 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:05:46.313521    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="373cca66-5bcc-49ca-bb3f-7ad16a56dd74" path="/var/lib/kubelet/pods/373cca66-5bcc-49ca-bb3f-7ad16a56dd74/volumes"
Jul 28 21:06:01.418208 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:01.418174    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"]
Jul 28 21:06:01.418634 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:01.418439    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg" podUID="e5e4b3a4-e5e3-42d5-9525-706361c5d2b1" containerName="istio-proxy" containerID="cri-o://5b52cbf1a44cc39ed783f295e4f9076c73a77b947c3ab545cb694f629e2df7da" gracePeriod=30
Jul 28 21:06:06.661641 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:06.661612    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:06:06.801153 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:06.801114    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istio-envoy\") pod \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") "
Jul 28 21:06:06.801338 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:06.801216    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-workload-socket\") pod \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") "
Jul 28 21:06:06.801338 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:06.801238    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-credential-socket\") pod \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") "
Jul 28 21:06:06.801338 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:06.801260    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istio-token\") pod \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") "
Jul 28 21:06:06.801338 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:06.801278    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-workload-certs\") pod \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") "
Jul 28 21:06:06.801338 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:06.801293    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istiod-ca-cert\") pod \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") "
Jul 28 21:06:06.801338 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:06.801310    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istio-data\") pod \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") "
Jul 28 21:06:06.801338 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:06.801329    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6cv5\" (UniqueName: \"kubernetes.io/projected/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-kube-api-access-g6cv5\") pod \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") "
Jul 28 21:06:06.801751 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:06.801380    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istio-podinfo\") pod \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\" (UID: \"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1\") "
Jul 28 21:06:06.801751 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:06.801603    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e5e4b3a4-e5e3-42d5-9525-706361c5d2b1" (UID: "e5e4b3a4-e5e3-42d5-9525-706361c5d2b1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:06:06.801751 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:06.801619    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e5e4b3a4-e5e3-42d5-9525-706361c5d2b1" (UID: "e5e4b3a4-e5e3-42d5-9525-706361c5d2b1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:06:06.801751 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:06.801733    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e5e4b3a4-e5e3-42d5-9525-706361c5d2b1" (UID: "e5e4b3a4-e5e3-42d5-9525-706361c5d2b1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:06:06.802085 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:06.802058    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e5e4b3a4-e5e3-42d5-9525-706361c5d2b1" (UID: "e5e4b3a4-e5e3-42d5-9525-706361c5d2b1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:06:06.802403 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:06.802364    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istio-data" (OuterVolumeSpecName: "istio-data") pod "e5e4b3a4-e5e3-42d5-9525-706361c5d2b1" (UID: "e5e4b3a4-e5e3-42d5-9525-706361c5d2b1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:06:06.803513 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:06.803485    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e5e4b3a4-e5e3-42d5-9525-706361c5d2b1" (UID: "e5e4b3a4-e5e3-42d5-9525-706361c5d2b1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:06:06.803605 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:06.803570    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e5e4b3a4-e5e3-42d5-9525-706361c5d2b1" (UID: "e5e4b3a4-e5e3-42d5-9525-706361c5d2b1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 21:06:06.803605 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:06.803585    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istio-token" (OuterVolumeSpecName: "istio-token") pod "e5e4b3a4-e5e3-42d5-9525-706361c5d2b1" (UID: "e5e4b3a4-e5e3-42d5-9525-706361c5d2b1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:06:06.803688 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:06.803659    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-kube-api-access-g6cv5" (OuterVolumeSpecName: "kube-api-access-g6cv5") pod "e5e4b3a4-e5e3-42d5-9525-706361c5d2b1" (UID: "e5e4b3a4-e5e3-42d5-9525-706361c5d2b1"). InnerVolumeSpecName "kube-api-access-g6cv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:06:06.902387 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:06.902329    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istio-envoy\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:06:06.902387 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:06.902385    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-workload-socket\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:06:06.902387 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:06.902396    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-credential-socket\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:06:06.902634 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:06.902408    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istio-token\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:06:06.902634 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:06.902418    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-workload-certs\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:06:06.902634 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:06.902425    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istiod-ca-cert\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:06:06.902634 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:06.902433    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istio-data\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:06:06.902634 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:06.902441    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6cv5\" (UniqueName: \"kubernetes.io/projected/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-kube-api-access-g6cv5\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:06:06.902634 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:06.902449    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1-istio-podinfo\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:06:07.032320 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:07.032286    2556 generic.go:356] "Generic (PLEG): container finished" podID="e5e4b3a4-e5e3-42d5-9525-706361c5d2b1" containerID="5b52cbf1a44cc39ed783f295e4f9076c73a77b947c3ab545cb694f629e2df7da" exitCode=0
Jul 28 21:06:07.032513 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:07.032336    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"
Jul 28 21:06:07.032513 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:07.032365    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg" event={"ID":"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1","Type":"ContainerDied","Data":"5b52cbf1a44cc39ed783f295e4f9076c73a77b947c3ab545cb694f629e2df7da"}
Jul 28 21:06:07.032513 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:07.032417    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg" event={"ID":"e5e4b3a4-e5e3-42d5-9525-706361c5d2b1","Type":"ContainerDied","Data":"eae13c8680d0d58593a9b12c3bc151ef86b2a9fe47bd99e2a707962613b167f9"}
Jul 28 21:06:07.032513 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:07.032439    2556 scope.go:117] "RemoveContainer" containerID="5b52cbf1a44cc39ed783f295e4f9076c73a77b947c3ab545cb694f629e2df7da"
Jul 28 21:06:07.041580 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:07.041563    2556 scope.go:117] "RemoveContainer" containerID="231c15f45325e89470199b5fe5861eb537eb8b7a7ff9bf38783142b60a003b09"
Jul 28 21:06:07.048971 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:07.048956    2556 scope.go:117] "RemoveContainer" containerID="5b52cbf1a44cc39ed783f295e4f9076c73a77b947c3ab545cb694f629e2df7da"
Jul 28 21:06:07.049207 ip-10-0-136-118 kubenswrapper[2556]: E0728 21:06:07.049183    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b52cbf1a44cc39ed783f295e4f9076c73a77b947c3ab545cb694f629e2df7da\": container with ID starting with 5b52cbf1a44cc39ed783f295e4f9076c73a77b947c3ab545cb694f629e2df7da not found: ID does not exist" containerID="5b52cbf1a44cc39ed783f295e4f9076c73a77b947c3ab545cb694f629e2df7da"
Jul 28 21:06:07.049275 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:07.049216    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b52cbf1a44cc39ed783f295e4f9076c73a77b947c3ab545cb694f629e2df7da"} err="failed to get container status \"5b52cbf1a44cc39ed783f295e4f9076c73a77b947c3ab545cb694f629e2df7da\": rpc error: code = NotFound desc = could not find container \"5b52cbf1a44cc39ed783f295e4f9076c73a77b947c3ab545cb694f629e2df7da\": container with ID starting with 5b52cbf1a44cc39ed783f295e4f9076c73a77b947c3ab545cb694f629e2df7da not found: ID does not exist"
Jul 28 21:06:07.049275 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:07.049243    2556 scope.go:117] "RemoveContainer" containerID="231c15f45325e89470199b5fe5861eb537eb8b7a7ff9bf38783142b60a003b09"
Jul 28 21:06:07.049489 ip-10-0-136-118 kubenswrapper[2556]: E0728 21:06:07.049472    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"231c15f45325e89470199b5fe5861eb537eb8b7a7ff9bf38783142b60a003b09\": container with ID starting with 231c15f45325e89470199b5fe5861eb537eb8b7a7ff9bf38783142b60a003b09 not found: ID does not exist" containerID="231c15f45325e89470199b5fe5861eb537eb8b7a7ff9bf38783142b60a003b09"
Jul 28 21:06:07.049529 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:07.049493    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"231c15f45325e89470199b5fe5861eb537eb8b7a7ff9bf38783142b60a003b09"} err="failed to get container status \"231c15f45325e89470199b5fe5861eb537eb8b7a7ff9bf38783142b60a003b09\": rpc error: code = NotFound desc = could not find container \"231c15f45325e89470199b5fe5861eb537eb8b7a7ff9bf38783142b60a003b09\": container with ID starting with 231c15f45325e89470199b5fe5861eb537eb8b7a7ff9bf38783142b60a003b09 not found: ID does not exist"
Jul 28 21:06:07.052398 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:07.052328    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"]
Jul 28 21:06:07.057335 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:07.057310    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-fec7c6-openshift-default-664855d7bb-gdpmg"]
Jul 28 21:06:08.313133 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:08.313100    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5e4b3a4-e5e3-42d5-9525-706361c5d2b1" path="/var/lib/kubelet/pods/e5e4b3a4-e5e3-42d5-9525-706361c5d2b1/volumes"
Jul 28 21:06:30.731719 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.731682    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"]
Jul 28 21:06:30.732192 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.732176    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="373cca66-5bcc-49ca-bb3f-7ad16a56dd74" containerName="istio-proxy"
Jul 28 21:06:30.732240 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.732196    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="373cca66-5bcc-49ca-bb3f-7ad16a56dd74" containerName="istio-proxy"
Jul 28 21:06:30.732240 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.732208    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5e4b3a4-e5e3-42d5-9525-706361c5d2b1" containerName="istio-proxy"
Jul 28 21:06:30.732240 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.732216    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5e4b3a4-e5e3-42d5-9525-706361c5d2b1" containerName="istio-proxy"
Jul 28 21:06:30.732333 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.732318    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5e4b3a4-e5e3-42d5-9525-706361c5d2b1" containerName="istio-proxy"
Jul 28 21:06:30.732333 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.732330    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="373cca66-5bcc-49ca-bb3f-7ad16a56dd74" containerName="istio-proxy"
Jul 28 21:06:30.732426 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.732357    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="373cca66-5bcc-49ca-bb3f-7ad16a56dd74" containerName="istio-proxy"
Jul 28 21:06:30.734530 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.734513    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:30.738170 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.738136    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-4e7a7a-openshift-default-dockercfg-ppbsn\""
Jul 28 21:06:30.752947 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.752924    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"]
Jul 28 21:06:30.810866 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.810823    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-istio-data\") pod \"e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") " pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:30.811063 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.810871    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9538d827-7f46-43bb-913d-751f9921125b-istiod-ca-cert\") pod \"e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") " pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:30.811063 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.810900    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9538d827-7f46-43bb-913d-751f9921125b-istio-token\") pod \"e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") " pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:30.811063 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.810938    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-workload-socket\") pod \"e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") " pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:30.811063 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.811011    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxcc4\" (UniqueName: \"kubernetes.io/projected/9538d827-7f46-43bb-913d-751f9921125b-kube-api-access-kxcc4\") pod \"e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") " pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:30.811063 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.811040    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-workload-certs\") pod \"e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") " pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:30.811295 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.811070    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9538d827-7f46-43bb-913d-751f9921125b-istio-podinfo\") pod \"e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") " pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:30.811295 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.811118    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-credential-socket\") pod \"e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") " pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:30.811295 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.811142    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-istio-envoy\") pod \"e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") " pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:30.912133 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.912095    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-istio-data\") pod \"e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") " pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:30.912133 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.912132    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9538d827-7f46-43bb-913d-751f9921125b-istiod-ca-cert\") pod \"e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") " pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:30.912438 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.912154    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9538d827-7f46-43bb-913d-751f9921125b-istio-token\") pod \"e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") " pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:30.912438 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.912172    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-workload-socket\") pod \"e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") " pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:30.912438 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.912223    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxcc4\" (UniqueName: \"kubernetes.io/projected/9538d827-7f46-43bb-913d-751f9921125b-kube-api-access-kxcc4\") pod \"e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") " pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:30.912438 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.912246    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-workload-certs\") pod \"e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") " pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:30.912438 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.912274    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9538d827-7f46-43bb-913d-751f9921125b-istio-podinfo\") pod \"e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") " pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:30.912438 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.912320    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-credential-socket\") pod \"e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") " pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:30.912767 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.912514    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-istio-envoy\") pod \"e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") " pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:30.912767 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.912646    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-workload-socket\") pod \"e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") " pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:30.912767 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.912694    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-workload-certs\") pod \"e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") " pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:30.912767 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.912712    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-istio-data\") pod \"e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") " pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:30.912767 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.912742    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-credential-socket\") pod \"e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") " pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:30.913108 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.913083    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9538d827-7f46-43bb-913d-751f9921125b-istiod-ca-cert\") pod \"e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") " pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:30.914596 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.914572    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-istio-envoy\") pod \"e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") " pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:30.914885 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.914867    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9538d827-7f46-43bb-913d-751f9921125b-istio-podinfo\") pod \"e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") " pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:30.920767 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.920746    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxcc4\" (UniqueName: \"kubernetes.io/projected/9538d827-7f46-43bb-913d-751f9921125b-kube-api-access-kxcc4\") pod \"e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") " pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:30.920955 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:30.920936    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9538d827-7f46-43bb-913d-751f9921125b-istio-token\") pod \"e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") " pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:31.044245 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:31.044214    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:31.178982 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:31.178959    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"]
Jul 28 21:06:31.181067 ip-10-0-136-118 kubenswrapper[2556]: W0728 21:06:31.181039    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9538d827_7f46_43bb_913d_751f9921125b.slice/crio-e0134fb3ddbb5ff97a8a6d6e187353db57d090bc762f5b6aec65b18c48a853a9 WatchSource:0}: Error finding container e0134fb3ddbb5ff97a8a6d6e187353db57d090bc762f5b6aec65b18c48a853a9: Status 404 returned error can't find the container with id e0134fb3ddbb5ff97a8a6d6e187353db57d090bc762f5b6aec65b18c48a853a9
Jul 28 21:06:31.183127 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:31.183092    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:06:31.183229 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:31.183166    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:06:31.183229 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:31.183209    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:06:32.145245 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:32.145209    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt" event={"ID":"9538d827-7f46-43bb-913d-751f9921125b","Type":"ContainerStarted","Data":"a3f2c482e8a77a25ec92a3d503f932f2fa7726c63f9fed18ae73997065c37f49"}
Jul 28 21:06:32.145688 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:32.145263    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt" event={"ID":"9538d827-7f46-43bb-913d-751f9921125b","Type":"ContainerStarted","Data":"e0134fb3ddbb5ff97a8a6d6e187353db57d090bc762f5b6aec65b18c48a853a9"}
Jul 28 21:06:32.165881 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:32.165834    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt" podStartSLOduration=2.165819913 podStartE2EDuration="2.165819913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:06:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:06:32.164789873 +0000 UTC m=+2476.384178758" watchObservedRunningTime="2026-07-28 21:06:32.165819913 +0000 UTC m=+2476.385208855"
Jul 28 21:06:33.045376 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:33.045320    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:33.050108 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:33.050085    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:33.149930 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:33.149898    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:33.150880 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:33.150862    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:49.191565 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:49.191520    2556 patch_prober.go:28] interesting pod/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 21:06:49.191998 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:49.191600    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt" podUID="9538d827-7f46-43bb-913d-751f9921125b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 21:06:50.231694 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:50.231658    2556 generic.go:356] "Generic (PLEG): container finished" podID="9538d827-7f46-43bb-913d-751f9921125b" containerID="a3f2c482e8a77a25ec92a3d503f932f2fa7726c63f9fed18ae73997065c37f49" exitCode=0
Jul 28 21:06:50.232221 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:50.231710    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt" event={"ID":"9538d827-7f46-43bb-913d-751f9921125b","Type":"ContainerDied","Data":"a3f2c482e8a77a25ec92a3d503f932f2fa7726c63f9fed18ae73997065c37f49"}
Jul 28 21:06:50.232287 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:50.232247    2556 scope.go:117] "RemoveContainer" containerID="a3f2c482e8a77a25ec92a3d503f932f2fa7726c63f9fed18ae73997065c37f49"
Jul 28 21:06:50.233365 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:50.233318    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:06:50.233445 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:50.233405    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:06:50.233487 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:50.233442    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:06:51.238041 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:51.238006    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt" event={"ID":"9538d827-7f46-43bb-913d-751f9921125b","Type":"ContainerStarted","Data":"ac52c39127d63efc9e26fe33e03e7b543adf2c29240f70b4a477886125386ed1"}
Jul 28 21:06:52.044584 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:52.044551    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:52.044790 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:52.044768    2556 patch_prober.go:28] interesting pod/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 28 21:06:52.044836 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:52.044815    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt" podUID="9538d827-7f46-43bb-913d-751f9921125b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 28 21:06:53.045560 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:53.045527    2556 patch_prober.go:28] interesting pod/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 28 21:06:53.045948 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:53.045585    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt" podUID="9538d827-7f46-43bb-913d-751f9921125b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 28 21:06:54.044670 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:54.044628    2556 patch_prober.go:28] interesting pod/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 28 21:06:54.044843 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:54.044697    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt" podUID="9538d827-7f46-43bb-913d-751f9921125b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 28 21:06:55.045608 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:55.045571    2556 patch_prober.go:28] interesting pod/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 28 21:06:55.046009 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:55.045639    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt" podUID="9538d827-7f46-43bb-913d-751f9921125b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 28 21:06:56.048236 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:56.048204    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:56.048633 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:56.048597    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:06:56.049260 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:06:56.049240    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:07:33.795864 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.795825    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"]
Jul 28 21:07:33.796273 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.796165    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="373cca66-5bcc-49ca-bb3f-7ad16a56dd74" containerName="istio-proxy"
Jul 28 21:07:33.796273 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.796178    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="373cca66-5bcc-49ca-bb3f-7ad16a56dd74" containerName="istio-proxy"
Jul 28 21:07:33.796273 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.796187    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5e4b3a4-e5e3-42d5-9525-706361c5d2b1" containerName="istio-proxy"
Jul 28 21:07:33.796273 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.796193    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5e4b3a4-e5e3-42d5-9525-706361c5d2b1" containerName="istio-proxy"
Jul 28 21:07:33.796473 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.796279    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5e4b3a4-e5e3-42d5-9525-706361c5d2b1" containerName="istio-proxy"
Jul 28 21:07:33.799294 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.799275    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"
Jul 28 21:07:33.803281 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.803250    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4e7a7a\"/\"kube-root-ca.crt\""
Jul 28 21:07:33.803409 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.803293    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4e7a7a\"/\"default-dockercfg-8c42n\""
Jul 28 21:07:33.803409 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.803294    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4e7a7a\"/\"auth-test-model-4e7a7a-kserve-self-signed-certs\""
Jul 28 21:07:33.803409 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.803294    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4e7a7a\"/\"openshift-service-ca.crt\""
Jul 28 21:07:33.808824 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.808806    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"]
Jul 28 21:07:33.872366 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.872321    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23f7628b-ee01-408c-80ca-5dc8d884c02d-model-cache\") pod \"auth-test-model-4e7a7a-kserve-8454c4df55-llxmx\" (UID: \"23f7628b-ee01-408c-80ca-5dc8d884c02d\") " pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"
Jul 28 21:07:33.872508 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.872395    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23f7628b-ee01-408c-80ca-5dc8d884c02d-tmp-dir\") pod \"auth-test-model-4e7a7a-kserve-8454c4df55-llxmx\" (UID: \"23f7628b-ee01-408c-80ca-5dc8d884c02d\") " pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"
Jul 28 21:07:33.872508 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.872448    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxxzr\" (UniqueName: \"kubernetes.io/projected/23f7628b-ee01-408c-80ca-5dc8d884c02d-kube-api-access-pxxzr\") pod \"auth-test-model-4e7a7a-kserve-8454c4df55-llxmx\" (UID: \"23f7628b-ee01-408c-80ca-5dc8d884c02d\") " pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"
Jul 28 21:07:33.872508 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.872468    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23f7628b-ee01-408c-80ca-5dc8d884c02d-home\") pod \"auth-test-model-4e7a7a-kserve-8454c4df55-llxmx\" (UID: \"23f7628b-ee01-408c-80ca-5dc8d884c02d\") " pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"
Jul 28 21:07:33.872657 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.872510    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23f7628b-ee01-408c-80ca-5dc8d884c02d-dshm\") pod \"auth-test-model-4e7a7a-kserve-8454c4df55-llxmx\" (UID: \"23f7628b-ee01-408c-80ca-5dc8d884c02d\") " pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"
Jul 28 21:07:33.872657 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.872544    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23f7628b-ee01-408c-80ca-5dc8d884c02d-tls-certs\") pod \"auth-test-model-4e7a7a-kserve-8454c4df55-llxmx\" (UID: \"23f7628b-ee01-408c-80ca-5dc8d884c02d\") " pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"
Jul 28 21:07:33.973139 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.973100    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23f7628b-ee01-408c-80ca-5dc8d884c02d-tmp-dir\") pod \"auth-test-model-4e7a7a-kserve-8454c4df55-llxmx\" (UID: \"23f7628b-ee01-408c-80ca-5dc8d884c02d\") " pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"
Jul 28 21:07:33.973485 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.973184    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxxzr\" (UniqueName: \"kubernetes.io/projected/23f7628b-ee01-408c-80ca-5dc8d884c02d-kube-api-access-pxxzr\") pod \"auth-test-model-4e7a7a-kserve-8454c4df55-llxmx\" (UID: \"23f7628b-ee01-408c-80ca-5dc8d884c02d\") " pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"
Jul 28 21:07:33.973485 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.973215    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23f7628b-ee01-408c-80ca-5dc8d884c02d-home\") pod \"auth-test-model-4e7a7a-kserve-8454c4df55-llxmx\" (UID: \"23f7628b-ee01-408c-80ca-5dc8d884c02d\") " pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"
Jul 28 21:07:33.973485 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.973245    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23f7628b-ee01-408c-80ca-5dc8d884c02d-dshm\") pod \"auth-test-model-4e7a7a-kserve-8454c4df55-llxmx\" (UID: \"23f7628b-ee01-408c-80ca-5dc8d884c02d\") " pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"
Jul 28 21:07:33.973485 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.973273    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23f7628b-ee01-408c-80ca-5dc8d884c02d-tls-certs\") pod \"auth-test-model-4e7a7a-kserve-8454c4df55-llxmx\" (UID: \"23f7628b-ee01-408c-80ca-5dc8d884c02d\") " pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"
Jul 28 21:07:33.973485 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.973325    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23f7628b-ee01-408c-80ca-5dc8d884c02d-model-cache\") pod \"auth-test-model-4e7a7a-kserve-8454c4df55-llxmx\" (UID: \"23f7628b-ee01-408c-80ca-5dc8d884c02d\") " pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"
Jul 28 21:07:33.973777 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.973598    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23f7628b-ee01-408c-80ca-5dc8d884c02d-tmp-dir\") pod \"auth-test-model-4e7a7a-kserve-8454c4df55-llxmx\" (UID: \"23f7628b-ee01-408c-80ca-5dc8d884c02d\") " pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"
Jul 28 21:07:33.973777 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.973640    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23f7628b-ee01-408c-80ca-5dc8d884c02d-home\") pod \"auth-test-model-4e7a7a-kserve-8454c4df55-llxmx\" (UID: \"23f7628b-ee01-408c-80ca-5dc8d884c02d\") " pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"
Jul 28 21:07:33.973777 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.973672    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23f7628b-ee01-408c-80ca-5dc8d884c02d-model-cache\") pod \"auth-test-model-4e7a7a-kserve-8454c4df55-llxmx\" (UID: \"23f7628b-ee01-408c-80ca-5dc8d884c02d\") " pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"
Jul 28 21:07:33.976013 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.975989    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23f7628b-ee01-408c-80ca-5dc8d884c02d-dshm\") pod \"auth-test-model-4e7a7a-kserve-8454c4df55-llxmx\" (UID: \"23f7628b-ee01-408c-80ca-5dc8d884c02d\") " pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"
Jul 28 21:07:33.976107 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.976076    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23f7628b-ee01-408c-80ca-5dc8d884c02d-tls-certs\") pod \"auth-test-model-4e7a7a-kserve-8454c4df55-llxmx\" (UID: \"23f7628b-ee01-408c-80ca-5dc8d884c02d\") " pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"
Jul 28 21:07:33.982462 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:33.982436    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxxzr\" (UniqueName: \"kubernetes.io/projected/23f7628b-ee01-408c-80ca-5dc8d884c02d-kube-api-access-pxxzr\") pod \"auth-test-model-4e7a7a-kserve-8454c4df55-llxmx\" (UID: \"23f7628b-ee01-408c-80ca-5dc8d884c02d\") " pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"
Jul 28 21:07:34.108965 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:34.108890    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"
Jul 28 21:07:34.239138 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:34.239104    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"]
Jul 28 21:07:34.241978 ip-10-0-136-118 kubenswrapper[2556]: W0728 21:07:34.241951    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23f7628b_ee01_408c_80ca_5dc8d884c02d.slice/crio-744ff782ffb7b26d22140127feb790ac1920c821ee3396c977584c96b3035f97 WatchSource:0}: Error finding container 744ff782ffb7b26d22140127feb790ac1920c821ee3396c977584c96b3035f97: Status 404 returned error can't find the container with id 744ff782ffb7b26d22140127feb790ac1920c821ee3396c977584c96b3035f97
Jul 28 21:07:34.432846 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:34.432753    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx" event={"ID":"23f7628b-ee01-408c-80ca-5dc8d884c02d","Type":"ContainerStarted","Data":"02c95c61d4ab87471e664826ff7e4e5831fc5d756c267c70aa54cdc097d5b859"}
Jul 28 21:07:34.432846 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:34.432805    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx" event={"ID":"23f7628b-ee01-408c-80ca-5dc8d884c02d","Type":"ContainerStarted","Data":"744ff782ffb7b26d22140127feb790ac1920c821ee3396c977584c96b3035f97"}
Jul 28 21:07:34.450319 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:34.450269    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx" podStartSLOduration=1.450253955 podStartE2EDuration="1.450253955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:07:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:07:34.448720013 +0000 UTC m=+2538.668108898" watchObservedRunningTime="2026-07-28 21:07:34.450253955 +0000 UTC m=+2538.669642839"
Jul 28 21:07:44.109886 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:44.109853    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"
Jul 28 21:07:44.109886 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:44.109903    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"
Jul 28 21:07:44.122150 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:44.122125    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"
Jul 28 21:07:44.495272 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:07:44.495194    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"
Jul 28 21:12:04.985766 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:04.985731    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"]
Jul 28 21:12:20.004855 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.004795    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx" podUID="23f7628b-ee01-408c-80ca-5dc8d884c02d" containerName="main" containerID="cri-o://02c95c61d4ab87471e664826ff7e4e5831fc5d756c267c70aa54cdc097d5b859" gracePeriod=45
Jul 28 21:12:20.257593 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.257530    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"
Jul 28 21:12:20.373583 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.373543    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxxzr\" (UniqueName: \"kubernetes.io/projected/23f7628b-ee01-408c-80ca-5dc8d884c02d-kube-api-access-pxxzr\") pod \"23f7628b-ee01-408c-80ca-5dc8d884c02d\" (UID: \"23f7628b-ee01-408c-80ca-5dc8d884c02d\") "
Jul 28 21:12:20.373583 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.373588    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23f7628b-ee01-408c-80ca-5dc8d884c02d-model-cache\") pod \"23f7628b-ee01-408c-80ca-5dc8d884c02d\" (UID: \"23f7628b-ee01-408c-80ca-5dc8d884c02d\") "
Jul 28 21:12:20.373811 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.373615    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23f7628b-ee01-408c-80ca-5dc8d884c02d-dshm\") pod \"23f7628b-ee01-408c-80ca-5dc8d884c02d\" (UID: \"23f7628b-ee01-408c-80ca-5dc8d884c02d\") "
Jul 28 21:12:20.373811 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.373689    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23f7628b-ee01-408c-80ca-5dc8d884c02d-tls-certs\") pod \"23f7628b-ee01-408c-80ca-5dc8d884c02d\" (UID: \"23f7628b-ee01-408c-80ca-5dc8d884c02d\") "
Jul 28 21:12:20.373903 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.373818    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23f7628b-ee01-408c-80ca-5dc8d884c02d-tmp-dir\") pod \"23f7628b-ee01-408c-80ca-5dc8d884c02d\" (UID: \"23f7628b-ee01-408c-80ca-5dc8d884c02d\") "
Jul 28 21:12:20.373903 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.373846    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23f7628b-ee01-408c-80ca-5dc8d884c02d-home\") pod \"23f7628b-ee01-408c-80ca-5dc8d884c02d\" (UID: \"23f7628b-ee01-408c-80ca-5dc8d884c02d\") "
Jul 28 21:12:20.373903 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.373878    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23f7628b-ee01-408c-80ca-5dc8d884c02d-model-cache" (OuterVolumeSpecName: "model-cache") pod "23f7628b-ee01-408c-80ca-5dc8d884c02d" (UID: "23f7628b-ee01-408c-80ca-5dc8d884c02d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:12:20.374079 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.374053    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23f7628b-ee01-408c-80ca-5dc8d884c02d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "23f7628b-ee01-408c-80ca-5dc8d884c02d" (UID: "23f7628b-ee01-408c-80ca-5dc8d884c02d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:12:20.374177 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.374150    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23f7628b-ee01-408c-80ca-5dc8d884c02d-home" (OuterVolumeSpecName: "home") pod "23f7628b-ee01-408c-80ca-5dc8d884c02d" (UID: "23f7628b-ee01-408c-80ca-5dc8d884c02d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:12:20.374312 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.374207    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23f7628b-ee01-408c-80ca-5dc8d884c02d-tmp-dir\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:12:20.374312 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.374223    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23f7628b-ee01-408c-80ca-5dc8d884c02d-model-cache\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:12:20.375914 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.375888    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23f7628b-ee01-408c-80ca-5dc8d884c02d-dshm" (OuterVolumeSpecName: "dshm") pod "23f7628b-ee01-408c-80ca-5dc8d884c02d" (UID: "23f7628b-ee01-408c-80ca-5dc8d884c02d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:12:20.376033 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.375932    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23f7628b-ee01-408c-80ca-5dc8d884c02d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "23f7628b-ee01-408c-80ca-5dc8d884c02d" (UID: "23f7628b-ee01-408c-80ca-5dc8d884c02d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 21:12:20.376033 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.376001    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23f7628b-ee01-408c-80ca-5dc8d884c02d-kube-api-access-pxxzr" (OuterVolumeSpecName: "kube-api-access-pxxzr") pod "23f7628b-ee01-408c-80ca-5dc8d884c02d" (UID: "23f7628b-ee01-408c-80ca-5dc8d884c02d"). InnerVolumeSpecName "kube-api-access-pxxzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:12:20.474989 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.474939    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23f7628b-ee01-408c-80ca-5dc8d884c02d-home\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:12:20.474989 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.474983    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxxzr\" (UniqueName: \"kubernetes.io/projected/23f7628b-ee01-408c-80ca-5dc8d884c02d-kube-api-access-pxxzr\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:12:20.474989 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.474993    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23f7628b-ee01-408c-80ca-5dc8d884c02d-dshm\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:12:20.474989 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.475004    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23f7628b-ee01-408c-80ca-5dc8d884c02d-tls-certs\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:12:20.723654 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.723618    2556 generic.go:356] "Generic (PLEG): container finished" podID="23f7628b-ee01-408c-80ca-5dc8d884c02d" containerID="02c95c61d4ab87471e664826ff7e4e5831fc5d756c267c70aa54cdc097d5b859" exitCode=0
Jul 28 21:12:20.723836 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.723668    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"
Jul 28 21:12:20.723836 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.723711    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx" event={"ID":"23f7628b-ee01-408c-80ca-5dc8d884c02d","Type":"ContainerDied","Data":"02c95c61d4ab87471e664826ff7e4e5831fc5d756c267c70aa54cdc097d5b859"}
Jul 28 21:12:20.723836 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.723756    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx" event={"ID":"23f7628b-ee01-408c-80ca-5dc8d884c02d","Type":"ContainerDied","Data":"744ff782ffb7b26d22140127feb790ac1920c821ee3396c977584c96b3035f97"}
Jul 28 21:12:20.723836 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.723774    2556 scope.go:117] "RemoveContainer" containerID="02c95c61d4ab87471e664826ff7e4e5831fc5d756c267c70aa54cdc097d5b859"
Jul 28 21:12:20.732537 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.732519    2556 scope.go:117] "RemoveContainer" containerID="02c95c61d4ab87471e664826ff7e4e5831fc5d756c267c70aa54cdc097d5b859"
Jul 28 21:12:20.732801 ip-10-0-136-118 kubenswrapper[2556]: E0728 21:12:20.732781    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02c95c61d4ab87471e664826ff7e4e5831fc5d756c267c70aa54cdc097d5b859\": container with ID starting with 02c95c61d4ab87471e664826ff7e4e5831fc5d756c267c70aa54cdc097d5b859 not found: ID does not exist" containerID="02c95c61d4ab87471e664826ff7e4e5831fc5d756c267c70aa54cdc097d5b859"
Jul 28 21:12:20.732867 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.732808    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02c95c61d4ab87471e664826ff7e4e5831fc5d756c267c70aa54cdc097d5b859"} err="failed to get container status \"02c95c61d4ab87471e664826ff7e4e5831fc5d756c267c70aa54cdc097d5b859\": rpc error: code = NotFound desc = could not find container \"02c95c61d4ab87471e664826ff7e4e5831fc5d756c267c70aa54cdc097d5b859\": container with ID starting with 02c95c61d4ab87471e664826ff7e4e5831fc5d756c267c70aa54cdc097d5b859 not found: ID does not exist"
Jul 28 21:12:20.743324 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.743290    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"]
Jul 28 21:12:20.745284 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:20.745267    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-4e7a7a/auth-test-model-4e7a7a-kserve-8454c4df55-llxmx"]
Jul 28 21:12:22.313053 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:12:22.313019    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23f7628b-ee01-408c-80ca-5dc8d884c02d" path="/var/lib/kubelet/pods/23f7628b-ee01-408c-80ca-5dc8d884c02d/volumes"
Jul 28 21:13:18.903367 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:18.903312    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"]
Jul 28 21:13:18.903917 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:18.903815    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23f7628b-ee01-408c-80ca-5dc8d884c02d" containerName="main"
Jul 28 21:13:18.903917 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:18.903834    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="23f7628b-ee01-408c-80ca-5dc8d884c02d" containerName="main"
Jul 28 21:13:18.904032 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:18.903951    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="23f7628b-ee01-408c-80ca-5dc8d884c02d" containerName="main"
Jul 28 21:13:18.908229 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:18.908206    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"
Jul 28 21:13:18.911748 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:18.911724    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4e7a7a\"/\"kube-root-ca.crt\""
Jul 28 21:13:18.911842 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:18.911729    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4e7a7a\"/\"sub-test-model-4e7a7a-kserve-self-signed-certs\""
Jul 28 21:13:18.911842 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:18.911760    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4e7a7a\"/\"default-dockercfg-8c42n\""
Jul 28 21:13:18.911932 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:18.911767    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4e7a7a\"/\"openshift-service-ca.crt\""
Jul 28 21:13:18.914933 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:18.914910    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"]
Jul 28 21:13:18.979960 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:18.979930    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fbdc720-bff6-4424-804f-f78bbb98f742-tls-certs\") pod \"sub-test-model-4e7a7a-kserve-64d9864885-flvtj\" (UID: \"0fbdc720-bff6-4424-804f-f78bbb98f742\") " pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"
Jul 28 21:13:18.980089 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:18.979969    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fbdc720-bff6-4424-804f-f78bbb98f742-tmp-dir\") pod \"sub-test-model-4e7a7a-kserve-64d9864885-flvtj\" (UID: \"0fbdc720-bff6-4424-804f-f78bbb98f742\") " pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"
Jul 28 21:13:18.980089 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:18.980048    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fbdc720-bff6-4424-804f-f78bbb98f742-home\") pod \"sub-test-model-4e7a7a-kserve-64d9864885-flvtj\" (UID: \"0fbdc720-bff6-4424-804f-f78bbb98f742\") " pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"
Jul 28 21:13:18.980181 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:18.980103    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fbdc720-bff6-4424-804f-f78bbb98f742-dshm\") pod \"sub-test-model-4e7a7a-kserve-64d9864885-flvtj\" (UID: \"0fbdc720-bff6-4424-804f-f78bbb98f742\") " pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"
Jul 28 21:13:18.980181 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:18.980133    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjlw8\" (UniqueName: \"kubernetes.io/projected/0fbdc720-bff6-4424-804f-f78bbb98f742-kube-api-access-vjlw8\") pod \"sub-test-model-4e7a7a-kserve-64d9864885-flvtj\" (UID: \"0fbdc720-bff6-4424-804f-f78bbb98f742\") " pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"
Jul 28 21:13:18.980258 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:18.980191    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fbdc720-bff6-4424-804f-f78bbb98f742-model-cache\") pod \"sub-test-model-4e7a7a-kserve-64d9864885-flvtj\" (UID: \"0fbdc720-bff6-4424-804f-f78bbb98f742\") " pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"
Jul 28 21:13:19.081146 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:19.081118    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fbdc720-bff6-4424-804f-f78bbb98f742-home\") pod \"sub-test-model-4e7a7a-kserve-64d9864885-flvtj\" (UID: \"0fbdc720-bff6-4424-804f-f78bbb98f742\") " pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"
Jul 28 21:13:19.081298 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:19.081158    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fbdc720-bff6-4424-804f-f78bbb98f742-dshm\") pod \"sub-test-model-4e7a7a-kserve-64d9864885-flvtj\" (UID: \"0fbdc720-bff6-4424-804f-f78bbb98f742\") " pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"
Jul 28 21:13:19.081298 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:19.081179    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjlw8\" (UniqueName: \"kubernetes.io/projected/0fbdc720-bff6-4424-804f-f78bbb98f742-kube-api-access-vjlw8\") pod \"sub-test-model-4e7a7a-kserve-64d9864885-flvtj\" (UID: \"0fbdc720-bff6-4424-804f-f78bbb98f742\") " pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"
Jul 28 21:13:19.081298 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:19.081216    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fbdc720-bff6-4424-804f-f78bbb98f742-model-cache\") pod \"sub-test-model-4e7a7a-kserve-64d9864885-flvtj\" (UID: \"0fbdc720-bff6-4424-804f-f78bbb98f742\") " pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"
Jul 28 21:13:19.081298 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:19.081248    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fbdc720-bff6-4424-804f-f78bbb98f742-tls-certs\") pod \"sub-test-model-4e7a7a-kserve-64d9864885-flvtj\" (UID: \"0fbdc720-bff6-4424-804f-f78bbb98f742\") " pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"
Jul 28 21:13:19.081298 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:19.081270    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fbdc720-bff6-4424-804f-f78bbb98f742-tmp-dir\") pod \"sub-test-model-4e7a7a-kserve-64d9864885-flvtj\" (UID: \"0fbdc720-bff6-4424-804f-f78bbb98f742\") " pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"
Jul 28 21:13:19.081644 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:19.081621    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fbdc720-bff6-4424-804f-f78bbb98f742-home\") pod \"sub-test-model-4e7a7a-kserve-64d9864885-flvtj\" (UID: \"0fbdc720-bff6-4424-804f-f78bbb98f742\") " pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"
Jul 28 21:13:19.081712 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:19.081657    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fbdc720-bff6-4424-804f-f78bbb98f742-model-cache\") pod \"sub-test-model-4e7a7a-kserve-64d9864885-flvtj\" (UID: \"0fbdc720-bff6-4424-804f-f78bbb98f742\") " pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"
Jul 28 21:13:19.081765 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:19.081707    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fbdc720-bff6-4424-804f-f78bbb98f742-tmp-dir\") pod \"sub-test-model-4e7a7a-kserve-64d9864885-flvtj\" (UID: \"0fbdc720-bff6-4424-804f-f78bbb98f742\") " pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"
Jul 28 21:13:19.083627 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:19.083603    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fbdc720-bff6-4424-804f-f78bbb98f742-dshm\") pod \"sub-test-model-4e7a7a-kserve-64d9864885-flvtj\" (UID: \"0fbdc720-bff6-4424-804f-f78bbb98f742\") " pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"
Jul 28 21:13:19.083743 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:19.083723    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fbdc720-bff6-4424-804f-f78bbb98f742-tls-certs\") pod \"sub-test-model-4e7a7a-kserve-64d9864885-flvtj\" (UID: \"0fbdc720-bff6-4424-804f-f78bbb98f742\") " pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"
Jul 28 21:13:19.089613 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:19.089587    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjlw8\" (UniqueName: \"kubernetes.io/projected/0fbdc720-bff6-4424-804f-f78bbb98f742-kube-api-access-vjlw8\") pod \"sub-test-model-4e7a7a-kserve-64d9864885-flvtj\" (UID: \"0fbdc720-bff6-4424-804f-f78bbb98f742\") " pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"
Jul 28 21:13:19.218816 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:19.218727    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"
Jul 28 21:13:19.345668 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:19.345638    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"]
Jul 28 21:13:19.348404 ip-10-0-136-118 kubenswrapper[2556]: W0728 21:13:19.348371    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0fbdc720_bff6_4424_804f_f78bbb98f742.slice/crio-fa3b72d7dc3ea37b929b9925ca0eaed6a0bab8ced7557f7f53f88a0a9ff3d345 WatchSource:0}: Error finding container fa3b72d7dc3ea37b929b9925ca0eaed6a0bab8ced7557f7f53f88a0a9ff3d345: Status 404 returned error can't find the container with id fa3b72d7dc3ea37b929b9925ca0eaed6a0bab8ced7557f7f53f88a0a9ff3d345
Jul 28 21:13:19.994894 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:19.994858    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj" event={"ID":"0fbdc720-bff6-4424-804f-f78bbb98f742","Type":"ContainerStarted","Data":"1efaad82928cf4d76889f11379f4804c3bd9a22ae26e70d8d2b0ee1c9a6a82fd"}
Jul 28 21:13:19.995244 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:19.994908    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj" event={"ID":"0fbdc720-bff6-4424-804f-f78bbb98f742","Type":"ContainerStarted","Data":"fa3b72d7dc3ea37b929b9925ca0eaed6a0bab8ced7557f7f53f88a0a9ff3d345"}
Jul 28 21:13:20.011285 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:20.011239    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj" podStartSLOduration=2.011224611 podStartE2EDuration="2.011224611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:13:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:13:20.01072503 +0000 UTC m=+2884.230113915" watchObservedRunningTime="2026-07-28 21:13:20.011224611 +0000 UTC m=+2884.230613496"
Jul 28 21:13:29.219764 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:29.219719    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"
Jul 28 21:13:29.219764 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:29.219770    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"
Jul 28 21:13:29.232160 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:29.232135    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"
Jul 28 21:13:30.048055 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:13:30.048025    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"
Jul 28 21:14:22.084494 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:22.084461    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"]
Jul 28 21:14:37.103250 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:37.103201    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj" podUID="0fbdc720-bff6-4424-804f-f78bbb98f742" containerName="main" containerID="cri-o://1efaad82928cf4d76889f11379f4804c3bd9a22ae26e70d8d2b0ee1c9a6a82fd" gracePeriod=45
Jul 28 21:14:37.332880 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:37.332844    2556 generic.go:356] "Generic (PLEG): container finished" podID="0fbdc720-bff6-4424-804f-f78bbb98f742" containerID="1efaad82928cf4d76889f11379f4804c3bd9a22ae26e70d8d2b0ee1c9a6a82fd" exitCode=0
Jul 28 21:14:37.333024 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:37.332890    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj" event={"ID":"0fbdc720-bff6-4424-804f-f78bbb98f742","Type":"ContainerDied","Data":"1efaad82928cf4d76889f11379f4804c3bd9a22ae26e70d8d2b0ee1c9a6a82fd"}
Jul 28 21:14:37.351642 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:37.351619    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"
Jul 28 21:14:37.442173 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:37.442102    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fbdc720-bff6-4424-804f-f78bbb98f742-home\") pod \"0fbdc720-bff6-4424-804f-f78bbb98f742\" (UID: \"0fbdc720-bff6-4424-804f-f78bbb98f742\") "
Jul 28 21:14:37.442173 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:37.442147    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fbdc720-bff6-4424-804f-f78bbb98f742-tls-certs\") pod \"0fbdc720-bff6-4424-804f-f78bbb98f742\" (UID: \"0fbdc720-bff6-4424-804f-f78bbb98f742\") "
Jul 28 21:14:37.442173 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:37.442166    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjlw8\" (UniqueName: \"kubernetes.io/projected/0fbdc720-bff6-4424-804f-f78bbb98f742-kube-api-access-vjlw8\") pod \"0fbdc720-bff6-4424-804f-f78bbb98f742\" (UID: \"0fbdc720-bff6-4424-804f-f78bbb98f742\") "
Jul 28 21:14:37.442446 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:37.442221    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fbdc720-bff6-4424-804f-f78bbb98f742-dshm\") pod \"0fbdc720-bff6-4424-804f-f78bbb98f742\" (UID: \"0fbdc720-bff6-4424-804f-f78bbb98f742\") "
Jul 28 21:14:37.442446 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:37.442263    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fbdc720-bff6-4424-804f-f78bbb98f742-tmp-dir\") pod \"0fbdc720-bff6-4424-804f-f78bbb98f742\" (UID: \"0fbdc720-bff6-4424-804f-f78bbb98f742\") "
Jul 28 21:14:37.442446 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:37.442400    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fbdc720-bff6-4424-804f-f78bbb98f742-home" (OuterVolumeSpecName: "home") pod "0fbdc720-bff6-4424-804f-f78bbb98f742" (UID: "0fbdc720-bff6-4424-804f-f78bbb98f742"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:14:37.442614 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:37.442434    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fbdc720-bff6-4424-804f-f78bbb98f742-model-cache\") pod \"0fbdc720-bff6-4424-804f-f78bbb98f742\" (UID: \"0fbdc720-bff6-4424-804f-f78bbb98f742\") "
Jul 28 21:14:37.442614 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:37.442501    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fbdc720-bff6-4424-804f-f78bbb98f742-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0fbdc720-bff6-4424-804f-f78bbb98f742" (UID: "0fbdc720-bff6-4424-804f-f78bbb98f742"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:14:37.442614 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:37.442599    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fbdc720-bff6-4424-804f-f78bbb98f742-model-cache" (OuterVolumeSpecName: "model-cache") pod "0fbdc720-bff6-4424-804f-f78bbb98f742" (UID: "0fbdc720-bff6-4424-804f-f78bbb98f742"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:14:37.442770 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:37.442750    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fbdc720-bff6-4424-804f-f78bbb98f742-tmp-dir\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:14:37.442811 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:37.442777    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fbdc720-bff6-4424-804f-f78bbb98f742-model-cache\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:14:37.442811 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:37.442791    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fbdc720-bff6-4424-804f-f78bbb98f742-home\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:14:37.444253 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:37.444231    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fbdc720-bff6-4424-804f-f78bbb98f742-dshm" (OuterVolumeSpecName: "dshm") pod "0fbdc720-bff6-4424-804f-f78bbb98f742" (UID: "0fbdc720-bff6-4424-804f-f78bbb98f742"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:14:37.444328 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:37.444304    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fbdc720-bff6-4424-804f-f78bbb98f742-kube-api-access-vjlw8" (OuterVolumeSpecName: "kube-api-access-vjlw8") pod "0fbdc720-bff6-4424-804f-f78bbb98f742" (UID: "0fbdc720-bff6-4424-804f-f78bbb98f742"). InnerVolumeSpecName "kube-api-access-vjlw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:14:37.444392 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:37.444361    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fbdc720-bff6-4424-804f-f78bbb98f742-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0fbdc720-bff6-4424-804f-f78bbb98f742" (UID: "0fbdc720-bff6-4424-804f-f78bbb98f742"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 21:14:37.543261 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:37.543235    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fbdc720-bff6-4424-804f-f78bbb98f742-tls-certs\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:14:37.543261 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:37.543256    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjlw8\" (UniqueName: \"kubernetes.io/projected/0fbdc720-bff6-4424-804f-f78bbb98f742-kube-api-access-vjlw8\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:14:37.543261 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:37.543266    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fbdc720-bff6-4424-804f-f78bbb98f742-dshm\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:14:38.338722 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:38.338694    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"
Jul 28 21:14:38.339117 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:38.338731    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj" event={"ID":"0fbdc720-bff6-4424-804f-f78bbb98f742","Type":"ContainerDied","Data":"fa3b72d7dc3ea37b929b9925ca0eaed6a0bab8ced7557f7f53f88a0a9ff3d345"}
Jul 28 21:14:38.339117 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:38.338793    2556 scope.go:117] "RemoveContainer" containerID="1efaad82928cf4d76889f11379f4804c3bd9a22ae26e70d8d2b0ee1c9a6a82fd"
Jul 28 21:14:38.357972 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:38.357949    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"]
Jul 28 21:14:38.362141 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:38.362120    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-4e7a7a/sub-test-model-4e7a7a-kserve-64d9864885-flvtj"]
Jul 28 21:14:40.313711 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:14:40.313676    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fbdc720-bff6-4424-804f-f78bbb98f742" path="/var/lib/kubelet/pods/0fbdc720-bff6-4424-804f-f78bbb98f742/volumes"
Jul 28 21:15:00.131332 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:00.131281    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754555-z449x"]
Jul 28 21:15:00.135157 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:00.132391    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fbdc720-bff6-4424-804f-f78bbb98f742" containerName="main"
Jul 28 21:15:00.135157 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:00.132425    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fbdc720-bff6-4424-804f-f78bbb98f742" containerName="main"
Jul 28 21:15:00.135157 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:00.132701    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fbdc720-bff6-4424-804f-f78bbb98f742" containerName="main"
Jul 28 21:15:00.137232 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:00.137205    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4e7a7a-29754555-56pbj"]
Jul 28 21:15:00.137389 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:00.137325    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754555-z449x"
Jul 28 21:15:00.142145 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:00.142119    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4e7a7a-29754555-56pbj"
Jul 28 21:15:00.142395 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:00.142375    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cxpsn\""
Jul 28 21:15:00.144228 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:00.144200    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4e7a7a-29754555-56pbj"]
Jul 28 21:15:00.146156 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:00.146133    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754555-z449x"]
Jul 28 21:15:00.153994 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:00.153704    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754555-z449x"
Jul 28 21:15:00.159968 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:00.159947    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4e7a7a-29754555-56pbj"
Jul 28 21:15:00.293667 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:00.293637    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754555-z449x"]
Jul 28 21:15:00.297025 ip-10-0-136-118 kubenswrapper[2556]: W0728 21:15:00.296987    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd77bdf6c_f65a_4bbf_bb09_c02f7cdb05bf.slice/crio-0d685afd0066b919ea1be2b27891f6f107e4c27cc83c2cc13ce036d925a509f2 WatchSource:0}: Error finding container 0d685afd0066b919ea1be2b27891f6f107e4c27cc83c2cc13ce036d925a509f2: Status 404 returned error can't find the container with id 0d685afd0066b919ea1be2b27891f6f107e4c27cc83c2cc13ce036d925a509f2
Jul 28 21:15:00.299117 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:00.299096    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 21:15:00.317004 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:00.316979    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4e7a7a-29754555-56pbj"]
Jul 28 21:15:00.320742 ip-10-0-136-118 kubenswrapper[2556]: W0728 21:15:00.320711    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e368fa5_602a_45a6_b3a3_4a910ae4bd71.slice/crio-2496643c9548f4235b058bbc9a7c19808ed9e6687213e642465dfad72ea74df6 WatchSource:0}: Error finding container 2496643c9548f4235b058bbc9a7c19808ed9e6687213e642465dfad72ea74df6: Status 404 returned error can't find the container with id 2496643c9548f4235b058bbc9a7c19808ed9e6687213e642465dfad72ea74df6
Jul 28 21:15:00.440895 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:00.440811    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754555-z449x" event={"ID":"d77bdf6c-f65a-4bbf-bb09-c02f7cdb05bf","Type":"ContainerStarted","Data":"0d685afd0066b919ea1be2b27891f6f107e4c27cc83c2cc13ce036d925a509f2"}
Jul 28 21:15:00.441872 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:00.441849    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4e7a7a-29754555-56pbj" event={"ID":"0e368fa5-602a-45a6-b3a3-4a910ae4bd71","Type":"ContainerStarted","Data":"2496643c9548f4235b058bbc9a7c19808ed9e6687213e642465dfad72ea74df6"}
Jul 28 21:15:03.458814 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:03.458742    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754555-z449x" event={"ID":"d77bdf6c-f65a-4bbf-bb09-c02f7cdb05bf","Type":"ContainerStarted","Data":"ff74097f326aee46e7322afdc932ce43fbb33dc00d101307ff39c35669755b6c"}
Jul 28 21:15:03.460419 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:03.460388    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4e7a7a-29754555-56pbj" event={"ID":"0e368fa5-602a-45a6-b3a3-4a910ae4bd71","Type":"ContainerStarted","Data":"c7e1df474073fd6793d3cd872d5e7e45fb4fedb7352379af475109b39c957735"}
Jul 28 21:15:03.500964 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:03.500912    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754555-z449x" podStartSLOduration=1.128230885 podStartE2EDuration="3.500896229s" totalImagesPullingTime="2.372665344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:15:03.486295302 +0000 UTC m=+2987.705684188" watchObservedRunningTime="2026-07-28 21:15:03.500896229 +0000 UTC m=+2987.720285113"
Jul 28 21:15:03.501660 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:03.501633    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4e7a7a-29754555-56pbj" podStartSLOduration=1.147811628 podStartE2EDuration="3.501625992s" totalImagesPullingTime="2.353814364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:15:03.49954127 +0000 UTC m=+2987.718930166" watchObservedRunningTime="2026-07-28 21:15:03.501625992 +0000 UTC m=+2987.721014876"
Jul 28 21:15:04.466190 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:04.466151    2556 generic.go:356] "Generic (PLEG): container finished" podID="d77bdf6c-f65a-4bbf-bb09-c02f7cdb05bf" containerID="ff74097f326aee46e7322afdc932ce43fbb33dc00d101307ff39c35669755b6c" exitCode=0
Jul 28 21:15:04.466635 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:04.466243    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754555-z449x" event={"ID":"d77bdf6c-f65a-4bbf-bb09-c02f7cdb05bf","Type":"ContainerDied","Data":"ff74097f326aee46e7322afdc932ce43fbb33dc00d101307ff39c35669755b6c"}
Jul 28 21:15:04.467964 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:04.467940    2556 generic.go:356] "Generic (PLEG): container finished" podID="0e368fa5-602a-45a6-b3a3-4a910ae4bd71" containerID="c7e1df474073fd6793d3cd872d5e7e45fb4fedb7352379af475109b39c957735" exitCode=0
Jul 28 21:15:04.468084 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:04.467998    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4e7a7a-29754555-56pbj" event={"ID":"0e368fa5-602a-45a6-b3a3-4a910ae4bd71","Type":"ContainerDied","Data":"c7e1df474073fd6793d3cd872d5e7e45fb4fedb7352379af475109b39c957735"}
Jul 28 21:15:05.595779 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:05.595752    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4e7a7a-29754555-56pbj"
Jul 28 21:15:05.631326 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:05.631300    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754555-z449x"
Jul 28 21:15:06.478327 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:06.478296    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4e7a7a-29754555-56pbj"
Jul 28 21:15:06.478327 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:06.478317    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4e7a7a-29754555-56pbj" event={"ID":"0e368fa5-602a-45a6-b3a3-4a910ae4bd71","Type":"ContainerDied","Data":"2496643c9548f4235b058bbc9a7c19808ed9e6687213e642465dfad72ea74df6"}
Jul 28 21:15:06.478580 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:06.478391    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2496643c9548f4235b058bbc9a7c19808ed9e6687213e642465dfad72ea74df6"
Jul 28 21:15:06.479596 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:06.479568    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754555-z449x" event={"ID":"d77bdf6c-f65a-4bbf-bb09-c02f7cdb05bf","Type":"ContainerDied","Data":"0d685afd0066b919ea1be2b27891f6f107e4c27cc83c2cc13ce036d925a509f2"}
Jul 28 21:15:06.479685 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:06.479595    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754555-z449x"
Jul 28 21:15:06.479685 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:06.479618    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d685afd0066b919ea1be2b27891f6f107e4c27cc83c2cc13ce036d925a509f2"
Jul 28 21:15:12.100431 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.100396    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"]
Jul 28 21:15:12.100807 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.100751    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d77bdf6c-f65a-4bbf-bb09-c02f7cdb05bf" containerName="cleanup"
Jul 28 21:15:12.100807 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.100763    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d77bdf6c-f65a-4bbf-bb09-c02f7cdb05bf" containerName="cleanup"
Jul 28 21:15:12.100807 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.100790    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e368fa5-602a-45a6-b3a3-4a910ae4bd71" containerName="cleanup"
Jul 28 21:15:12.100807 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.100797    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e368fa5-602a-45a6-b3a3-4a910ae4bd71" containerName="cleanup"
Jul 28 21:15:12.100968 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.100852    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d77bdf6c-f65a-4bbf-bb09-c02f7cdb05bf" containerName="cleanup"
Jul 28 21:15:12.100968 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.100864    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e368fa5-602a-45a6-b3a3-4a910ae4bd71" containerName="cleanup"
Jul 28 21:15:12.103901 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.103885    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"
Jul 28 21:15:12.106597 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.106576    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4e7a7a\"/\"kube-root-ca.crt\""
Jul 28 21:15:12.107545 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.107527    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4e7a7a\"/\"openshift-service-ca.crt\""
Jul 28 21:15:12.107623 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.107601    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4e7a7a\"/\"default-dockercfg-8c42n\""
Jul 28 21:15:12.107675 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.107657    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4e7a7a\"/\"rate-test-model-4e7a7a-kserve-self-signed-certs\""
Jul 28 21:15:12.113749 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.113727    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"]
Jul 28 21:15:12.237018 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.236985    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/951607c7-28e3-4269-9b91-a262e4f7d9c3-dshm\") pod \"rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8\" (UID: \"951607c7-28e3-4269-9b91-a262e4f7d9c3\") " pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"
Jul 28 21:15:12.237178 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.237035    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxdj8\" (UniqueName: \"kubernetes.io/projected/951607c7-28e3-4269-9b91-a262e4f7d9c3-kube-api-access-lxdj8\") pod \"rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8\" (UID: \"951607c7-28e3-4269-9b91-a262e4f7d9c3\") " pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"
Jul 28 21:15:12.237178 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.237086    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/951607c7-28e3-4269-9b91-a262e4f7d9c3-home\") pod \"rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8\" (UID: \"951607c7-28e3-4269-9b91-a262e4f7d9c3\") " pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"
Jul 28 21:15:12.237178 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.237109    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/951607c7-28e3-4269-9b91-a262e4f7d9c3-tmp-dir\") pod \"rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8\" (UID: \"951607c7-28e3-4269-9b91-a262e4f7d9c3\") " pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"
Jul 28 21:15:12.237178 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.237133    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/951607c7-28e3-4269-9b91-a262e4f7d9c3-model-cache\") pod \"rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8\" (UID: \"951607c7-28e3-4269-9b91-a262e4f7d9c3\") " pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"
Jul 28 21:15:12.237178 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.237147    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/951607c7-28e3-4269-9b91-a262e4f7d9c3-tls-certs\") pod \"rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8\" (UID: \"951607c7-28e3-4269-9b91-a262e4f7d9c3\") " pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"
Jul 28 21:15:12.338235 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.338201    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/951607c7-28e3-4269-9b91-a262e4f7d9c3-model-cache\") pod \"rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8\" (UID: \"951607c7-28e3-4269-9b91-a262e4f7d9c3\") " pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"
Jul 28 21:15:12.338235 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.338233    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/951607c7-28e3-4269-9b91-a262e4f7d9c3-tls-certs\") pod \"rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8\" (UID: \"951607c7-28e3-4269-9b91-a262e4f7d9c3\") " pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"
Jul 28 21:15:12.338467 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.338284    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/951607c7-28e3-4269-9b91-a262e4f7d9c3-dshm\") pod \"rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8\" (UID: \"951607c7-28e3-4269-9b91-a262e4f7d9c3\") " pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"
Jul 28 21:15:12.338467 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.338319    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxdj8\" (UniqueName: \"kubernetes.io/projected/951607c7-28e3-4269-9b91-a262e4f7d9c3-kube-api-access-lxdj8\") pod \"rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8\" (UID: \"951607c7-28e3-4269-9b91-a262e4f7d9c3\") " pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"
Jul 28 21:15:12.338467 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.338377    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/951607c7-28e3-4269-9b91-a262e4f7d9c3-home\") pod \"rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8\" (UID: \"951607c7-28e3-4269-9b91-a262e4f7d9c3\") " pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"
Jul 28 21:15:12.338467 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.338411    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/951607c7-28e3-4269-9b91-a262e4f7d9c3-tmp-dir\") pod \"rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8\" (UID: \"951607c7-28e3-4269-9b91-a262e4f7d9c3\") " pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"
Jul 28 21:15:12.338658 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.338637    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/951607c7-28e3-4269-9b91-a262e4f7d9c3-model-cache\") pod \"rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8\" (UID: \"951607c7-28e3-4269-9b91-a262e4f7d9c3\") " pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"
Jul 28 21:15:12.338722 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.338708    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/951607c7-28e3-4269-9b91-a262e4f7d9c3-tmp-dir\") pod \"rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8\" (UID: \"951607c7-28e3-4269-9b91-a262e4f7d9c3\") " pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"
Jul 28 21:15:12.338840 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.338819    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/951607c7-28e3-4269-9b91-a262e4f7d9c3-home\") pod \"rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8\" (UID: \"951607c7-28e3-4269-9b91-a262e4f7d9c3\") " pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"
Jul 28 21:15:12.340641 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.340609    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/951607c7-28e3-4269-9b91-a262e4f7d9c3-dshm\") pod \"rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8\" (UID: \"951607c7-28e3-4269-9b91-a262e4f7d9c3\") " pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"
Jul 28 21:15:12.340870 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.340855    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/951607c7-28e3-4269-9b91-a262e4f7d9c3-tls-certs\") pod \"rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8\" (UID: \"951607c7-28e3-4269-9b91-a262e4f7d9c3\") " pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"
Jul 28 21:15:12.346986 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.346964    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxdj8\" (UniqueName: \"kubernetes.io/projected/951607c7-28e3-4269-9b91-a262e4f7d9c3-kube-api-access-lxdj8\") pod \"rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8\" (UID: \"951607c7-28e3-4269-9b91-a262e4f7d9c3\") " pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"
Jul 28 21:15:12.413135 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.413048    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"
Jul 28 21:15:12.541154 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:12.541116    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"]
Jul 28 21:15:12.545093 ip-10-0-136-118 kubenswrapper[2556]: W0728 21:15:12.545066    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod951607c7_28e3_4269_9b91_a262e4f7d9c3.slice/crio-ffaf750411f9c8fe432e37f5394b546ca4c456256f1b8ed4e971ac6776f8f7ab WatchSource:0}: Error finding container ffaf750411f9c8fe432e37f5394b546ca4c456256f1b8ed4e971ac6776f8f7ab: Status 404 returned error can't find the container with id ffaf750411f9c8fe432e37f5394b546ca4c456256f1b8ed4e971ac6776f8f7ab
Jul 28 21:15:13.513764 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:13.513728    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8" event={"ID":"951607c7-28e3-4269-9b91-a262e4f7d9c3","Type":"ContainerStarted","Data":"c4b316934120c0bcaa09cdaa4fedf58712083ca0e3e3ad4ee73c71fe058f11e7"}
Jul 28 21:15:13.514131 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:13.513774    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8" event={"ID":"951607c7-28e3-4269-9b91-a262e4f7d9c3","Type":"ContainerStarted","Data":"ffaf750411f9c8fe432e37f5394b546ca4c456256f1b8ed4e971ac6776f8f7ab"}
Jul 28 21:15:13.530535 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:13.530473    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8" podStartSLOduration=1.530433837 podStartE2EDuration="1.530433837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:15:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:15:13.530043683 +0000 UTC m=+2997.749432569" watchObservedRunningTime="2026-07-28 21:15:13.530433837 +0000 UTC m=+2997.749822713"
Jul 28 21:15:22.413509 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:22.413471    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"
Jul 28 21:15:22.413867 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:22.413529    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"
Jul 28 21:15:22.426209 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:22.426185    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"
Jul 28 21:15:22.569256 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:15:22.569229    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"
Jul 28 21:16:35.792974 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:35.792938    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"]
Jul 28 21:16:50.811952 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:50.811910    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8" podUID="951607c7-28e3-4269-9b91-a262e4f7d9c3" containerName="main" containerID="cri-o://c4b316934120c0bcaa09cdaa4fedf58712083ca0e3e3ad4ee73c71fe058f11e7" gracePeriod=45
Jul 28 21:16:50.959130 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:50.959097    2556 generic.go:356] "Generic (PLEG): container finished" podID="951607c7-28e3-4269-9b91-a262e4f7d9c3" containerID="c4b316934120c0bcaa09cdaa4fedf58712083ca0e3e3ad4ee73c71fe058f11e7" exitCode=0
Jul 28 21:16:50.959288 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:50.959172    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8" event={"ID":"951607c7-28e3-4269-9b91-a262e4f7d9c3","Type":"ContainerDied","Data":"c4b316934120c0bcaa09cdaa4fedf58712083ca0e3e3ad4ee73c71fe058f11e7"}
Jul 28 21:16:51.059818 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:51.059795    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"
Jul 28 21:16:51.194378 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:51.194267    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/951607c7-28e3-4269-9b91-a262e4f7d9c3-tls-certs\") pod \"951607c7-28e3-4269-9b91-a262e4f7d9c3\" (UID: \"951607c7-28e3-4269-9b91-a262e4f7d9c3\") "
Jul 28 21:16:51.194378 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:51.194319    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxdj8\" (UniqueName: \"kubernetes.io/projected/951607c7-28e3-4269-9b91-a262e4f7d9c3-kube-api-access-lxdj8\") pod \"951607c7-28e3-4269-9b91-a262e4f7d9c3\" (UID: \"951607c7-28e3-4269-9b91-a262e4f7d9c3\") "
Jul 28 21:16:51.194378 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:51.194366    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/951607c7-28e3-4269-9b91-a262e4f7d9c3-home\") pod \"951607c7-28e3-4269-9b91-a262e4f7d9c3\" (UID: \"951607c7-28e3-4269-9b91-a262e4f7d9c3\") "
Jul 28 21:16:51.194654 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:51.194420    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/951607c7-28e3-4269-9b91-a262e4f7d9c3-model-cache\") pod \"951607c7-28e3-4269-9b91-a262e4f7d9c3\" (UID: \"951607c7-28e3-4269-9b91-a262e4f7d9c3\") "
Jul 28 21:16:51.194654 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:51.194461    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/951607c7-28e3-4269-9b91-a262e4f7d9c3-dshm\") pod \"951607c7-28e3-4269-9b91-a262e4f7d9c3\" (UID: \"951607c7-28e3-4269-9b91-a262e4f7d9c3\") "
Jul 28 21:16:51.194654 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:51.194512    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/951607c7-28e3-4269-9b91-a262e4f7d9c3-tmp-dir\") pod \"951607c7-28e3-4269-9b91-a262e4f7d9c3\" (UID: \"951607c7-28e3-4269-9b91-a262e4f7d9c3\") "
Jul 28 21:16:51.194820 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:51.194693    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/951607c7-28e3-4269-9b91-a262e4f7d9c3-home" (OuterVolumeSpecName: "home") pod "951607c7-28e3-4269-9b91-a262e4f7d9c3" (UID: "951607c7-28e3-4269-9b91-a262e4f7d9c3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:16:51.194820 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:51.194708    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/951607c7-28e3-4269-9b91-a262e4f7d9c3-model-cache" (OuterVolumeSpecName: "model-cache") pod "951607c7-28e3-4269-9b91-a262e4f7d9c3" (UID: "951607c7-28e3-4269-9b91-a262e4f7d9c3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:16:51.194918 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:51.194859    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/951607c7-28e3-4269-9b91-a262e4f7d9c3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "951607c7-28e3-4269-9b91-a262e4f7d9c3" (UID: "951607c7-28e3-4269-9b91-a262e4f7d9c3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:16:51.194964 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:51.194918    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/951607c7-28e3-4269-9b91-a262e4f7d9c3-home\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:16:51.194964 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:51.194933    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/951607c7-28e3-4269-9b91-a262e4f7d9c3-model-cache\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:16:51.196474 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:51.196448    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/951607c7-28e3-4269-9b91-a262e4f7d9c3-kube-api-access-lxdj8" (OuterVolumeSpecName: "kube-api-access-lxdj8") pod "951607c7-28e3-4269-9b91-a262e4f7d9c3" (UID: "951607c7-28e3-4269-9b91-a262e4f7d9c3"). InnerVolumeSpecName "kube-api-access-lxdj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:16:51.196909 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:51.196889    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/951607c7-28e3-4269-9b91-a262e4f7d9c3-dshm" (OuterVolumeSpecName: "dshm") pod "951607c7-28e3-4269-9b91-a262e4f7d9c3" (UID: "951607c7-28e3-4269-9b91-a262e4f7d9c3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:16:51.196909 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:51.196895    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/951607c7-28e3-4269-9b91-a262e4f7d9c3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "951607c7-28e3-4269-9b91-a262e4f7d9c3" (UID: "951607c7-28e3-4269-9b91-a262e4f7d9c3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 21:16:51.295633 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:51.295594    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/951607c7-28e3-4269-9b91-a262e4f7d9c3-dshm\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:16:51.295633 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:51.295625    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/951607c7-28e3-4269-9b91-a262e4f7d9c3-tmp-dir\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:16:51.295633 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:51.295636    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/951607c7-28e3-4269-9b91-a262e4f7d9c3-tls-certs\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:16:51.295861 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:51.295645    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxdj8\" (UniqueName: \"kubernetes.io/projected/951607c7-28e3-4269-9b91-a262e4f7d9c3-kube-api-access-lxdj8\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:16:51.965810 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:51.965781    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"
Jul 28 21:16:51.965810 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:51.965789    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8" event={"ID":"951607c7-28e3-4269-9b91-a262e4f7d9c3","Type":"ContainerDied","Data":"ffaf750411f9c8fe432e37f5394b546ca4c456256f1b8ed4e971ac6776f8f7ab"}
Jul 28 21:16:51.966333 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:51.965835    2556 scope.go:117] "RemoveContainer" containerID="c4b316934120c0bcaa09cdaa4fedf58712083ca0e3e3ad4ee73c71fe058f11e7"
Jul 28 21:16:51.986755 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:51.986728    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"]
Jul 28 21:16:51.989109 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:51.989082    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-4e7a7a/rate-test-model-4e7a7a-kserve-6595dd6c9-4z5c8"]
Jul 28 21:16:52.313867 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:52.313832    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="951607c7-28e3-4269-9b91-a262e4f7d9c3" path="/var/lib/kubelet/pods/951607c7-28e3-4269-9b91-a262e4f7d9c3/volumes"
Jul 28 21:16:55.825901 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:55.825869    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"]
Jul 28 21:16:55.826938 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:55.826916    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="951607c7-28e3-4269-9b91-a262e4f7d9c3" containerName="main"
Jul 28 21:16:55.827093 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:55.827083    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="951607c7-28e3-4269-9b91-a262e4f7d9c3" containerName="main"
Jul 28 21:16:55.827256 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:55.827246    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="951607c7-28e3-4269-9b91-a262e4f7d9c3" containerName="main"
Jul 28 21:16:55.832142 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:55.832120    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:55.834908 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:55.834883    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-d6ef24-openshift-default-dockercfg-28jsm\""
Jul 28 21:16:55.840889 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:55.840866    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"]
Jul 28 21:16:55.937568 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:55.937538    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istio-token\") pod \"e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") " pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:55.937568 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:55.937569    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss6kx\" (UniqueName: \"kubernetes.io/projected/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-kube-api-access-ss6kx\") pod \"e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") " pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:55.937773 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:55.937592    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-workload-socket\") pod \"e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") " pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:55.937773 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:55.937651    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istio-data\") pod \"e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") " pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:55.937773 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:55.937699    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-credential-socket\") pod \"e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") " pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:55.937773 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:55.937719    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istio-podinfo\") pod \"e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") " pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:55.937906 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:55.937797    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istiod-ca-cert\") pod \"e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") " pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:55.937906 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:55.937836    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istio-envoy\") pod \"e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") " pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:55.937906 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:55.937855    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-workload-certs\") pod \"e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") " pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:56.038956 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:56.038915    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istio-token\") pod \"e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") " pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:56.038956 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:56.038957    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss6kx\" (UniqueName: \"kubernetes.io/projected/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-kube-api-access-ss6kx\") pod \"e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") " pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:56.039214 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:56.038977    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-workload-socket\") pod \"e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") " pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:56.039214 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:56.038996    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istio-data\") pod \"e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") " pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:56.039214 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:56.039023    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-credential-socket\") pod \"e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") " pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:56.039214 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:56.039048    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istio-podinfo\") pod \"e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") " pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:56.039214 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:56.039114    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istiod-ca-cert\") pod \"e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") " pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:56.039214 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:56.039166    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istio-envoy\") pod \"e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") " pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:56.039214 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:56.039191    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-workload-certs\") pod \"e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") " pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:56.039596 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:56.039443    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istio-data\") pod \"e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") " pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:56.039596 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:56.039514    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-workload-socket\") pod \"e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") " pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:56.039596 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:56.039538    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-credential-socket\") pod \"e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") " pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:56.039596 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:56.039574    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-workload-certs\") pod \"e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") " pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:56.039874 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:56.039854    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istiod-ca-cert\") pod \"e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") " pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:56.041469 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:56.041449    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istio-envoy\") pod \"e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") " pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:56.041702 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:56.041684    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istio-podinfo\") pod \"e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") " pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:56.046673 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:56.046645    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istio-token\") pod \"e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") " pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:56.046914 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:56.046892    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss6kx\" (UniqueName: \"kubernetes.io/projected/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-kube-api-access-ss6kx\") pod \"e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") " pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:56.143374 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:56.143258    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:56.274811 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:56.274785    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"]
Jul 28 21:16:56.277308 ip-10-0-136-118 kubenswrapper[2556]: W0728 21:16:56.277276    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea76f54b_0a83_4be4_8a6f_a9e5be339e84.slice/crio-4a551447adcb9c446350274ee46d50658b8d0ad2383390371d06ad6f59551154 WatchSource:0}: Error finding container 4a551447adcb9c446350274ee46d50658b8d0ad2383390371d06ad6f59551154: Status 404 returned error can't find the container with id 4a551447adcb9c446350274ee46d50658b8d0ad2383390371d06ad6f59551154
Jul 28 21:16:56.279541 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:56.279511    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:16:56.279623 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:56.279574    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:16:56.279623 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:56.279609    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:16:56.991692 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:56.991659    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw" event={"ID":"ea76f54b-0a83-4be4-8a6f-a9e5be339e84","Type":"ContainerStarted","Data":"c41bcf85c54dff1bc17d393436de19aef49f219e6c270f73928a91c28c289bfd"}
Jul 28 21:16:56.992104 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:56.991716    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw" event={"ID":"ea76f54b-0a83-4be4-8a6f-a9e5be339e84","Type":"ContainerStarted","Data":"4a551447adcb9c446350274ee46d50658b8d0ad2383390371d06ad6f59551154"}
Jul 28 21:16:57.013936 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:57.013880    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw" podStartSLOduration=2.013861206 podStartE2EDuration="2.013861206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:16:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:16:57.011076302 +0000 UTC m=+3101.230465188" watchObservedRunningTime="2026-07-28 21:16:57.013861206 +0000 UTC m=+3101.233250092"
Jul 28 21:16:57.143912 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:57.143873    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:57.148525 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:57.148502    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:57.996177 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:57.996150    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:16:57.997184 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:16:57.997165    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:17:14.037498 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:14.037455    2556 patch_prober.go:28] interesting pod/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 21:17:14.037936 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:14.037523    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw" podUID="ea76f54b-0a83-4be4-8a6f-a9e5be339e84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 21:17:16.090475 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:16.090440    2556 generic.go:356] "Generic (PLEG): container finished" podID="ea76f54b-0a83-4be4-8a6f-a9e5be339e84" containerID="c41bcf85c54dff1bc17d393436de19aef49f219e6c270f73928a91c28c289bfd" exitCode=0
Jul 28 21:17:16.090888 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:16.090516    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw" event={"ID":"ea76f54b-0a83-4be4-8a6f-a9e5be339e84","Type":"ContainerDied","Data":"c41bcf85c54dff1bc17d393436de19aef49f219e6c270f73928a91c28c289bfd"}
Jul 28 21:17:16.090944 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:16.090902    2556 scope.go:117] "RemoveContainer" containerID="c41bcf85c54dff1bc17d393436de19aef49f219e6c270f73928a91c28c289bfd"
Jul 28 21:17:16.092067 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:16.092038    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:17:16.092134 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:16.092124    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:17:16.092174 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:16.092157    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:17:17.098540 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:17.098506    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw" event={"ID":"ea76f54b-0a83-4be4-8a6f-a9e5be339e84","Type":"ContainerStarted","Data":"12e24611a978075b7bf18ee41ceb01e77f431253c08591a3bbe36009c88caced"}
Jul 28 21:17:17.144391 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:17.144325    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:17:17.144591 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:17.144565    2556 patch_prober.go:28] interesting pod/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 28 21:17:17.144663 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:17.144627    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw" podUID="ea76f54b-0a83-4be4-8a6f-a9e5be339e84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 28 21:17:18.143913 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:18.143874    2556 patch_prober.go:28] interesting pod/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 28 21:17:18.144429 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:18.143935    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw" podUID="ea76f54b-0a83-4be4-8a6f-a9e5be339e84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 28 21:17:19.144506 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:19.144470    2556 patch_prober.go:28] interesting pod/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 28 21:17:19.144890 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:19.144520    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw" podUID="ea76f54b-0a83-4be4-8a6f-a9e5be339e84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 28 21:17:20.144137 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:20.144099    2556 patch_prober.go:28] interesting pod/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 28 21:17:20.144322 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:20.144152    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw" podUID="ea76f54b-0a83-4be4-8a6f-a9e5be339e84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 28 21:17:21.143770 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:21.143732    2556 patch_prober.go:28] interesting pod/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 28 21:17:21.144200 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:21.143789    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw" podUID="ea76f54b-0a83-4be4-8a6f-a9e5be339e84" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 28 21:17:22.147785 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:22.147746    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:17:22.148175 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:22.148008    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:17:22.148606 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:22.148590    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:17:25.026363 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.026309    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"]
Jul 28 21:17:25.029275 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.029258    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.032316 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.032291    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-590ada-openshift-default-dockercfg-22t79\""
Jul 28 21:17:25.041998 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.041976    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"]
Jul 28 21:17:25.119962 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.119264    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-workload-certs\") pod \"e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") " pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.119962 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.119311    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istiod-ca-cert\") pod \"e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") " pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.119962 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.119376    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-credential-socket\") pod \"e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") " pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.119962 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.119410    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istio-data\") pod \"e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") " pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.119962 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.119566    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istio-podinfo\") pod \"e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") " pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.119962 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.119605    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istio-token\") pod \"e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") " pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.119962 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.119660    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-workload-socket\") pod \"e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") " pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.119962 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.119685    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kbmv\" (UniqueName: \"kubernetes.io/projected/e2e8db3f-eb29-43c5-84a8-f8dee6479093-kube-api-access-7kbmv\") pod \"e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") " pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.119962 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.119722    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istio-envoy\") pod \"e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") " pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.220807 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.220779    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istio-podinfo\") pod \"e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") " pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.220807 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.220811    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istio-token\") pod \"e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") " pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.221031 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.220843    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-workload-socket\") pod \"e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") " pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.221031 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.220858    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kbmv\" (UniqueName: \"kubernetes.io/projected/e2e8db3f-eb29-43c5-84a8-f8dee6479093-kube-api-access-7kbmv\") pod \"e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") " pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.221109 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.221072    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istio-envoy\") pod \"e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") " pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.221218 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.221132    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-workload-certs\") pod \"e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") " pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.221218 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.221208    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istiod-ca-cert\") pod \"e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") " pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.221328 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.221229    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-workload-socket\") pod \"e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") " pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.221328 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.221247    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-credential-socket\") pod \"e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") " pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.221328 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.221298    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istio-data\") pod \"e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") " pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.221516 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.221455    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-workload-certs\") pod \"e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") " pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.221577 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.221557    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-credential-socket\") pod \"e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") " pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.221694 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.221674    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istio-data\") pod \"e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") " pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.221909 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.221887    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istiod-ca-cert\") pod \"e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") " pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.223304 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.223280    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istio-envoy\") pod \"e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") " pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.223489 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.223470    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istio-podinfo\") pod \"e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") " pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.232610 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.232576    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istio-token\") pod \"e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") " pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.232792 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.232773    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kbmv\" (UniqueName: \"kubernetes.io/projected/e2e8db3f-eb29-43c5-84a8-f8dee6479093-kube-api-access-7kbmv\") pod \"e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") " pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.339577 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.339544    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:25.468525 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.468499    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"]
Jul 28 21:17:25.470254 ip-10-0-136-118 kubenswrapper[2556]: W0728 21:17:25.470228    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2e8db3f_eb29_43c5_84a8_f8dee6479093.slice/crio-ae9e8ed8d02db136416e63e6c0818e590f956172d91890dae32c313dd02bd3aa WatchSource:0}: Error finding container ae9e8ed8d02db136416e63e6c0818e590f956172d91890dae32c313dd02bd3aa: Status 404 returned error can't find the container with id ae9e8ed8d02db136416e63e6c0818e590f956172d91890dae32c313dd02bd3aa
Jul 28 21:17:25.472547 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.472513    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:17:25.472624 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.472596    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:17:25.472667 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:25.472641    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:17:26.144992 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:26.144953    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg" event={"ID":"e2e8db3f-eb29-43c5-84a8-f8dee6479093","Type":"ContainerStarted","Data":"309bf88293ef6bd4ddf104b82b05c8396c49b82934622ff19bb2cc2ee0b2785f"}
Jul 28 21:17:26.145508 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:26.145007    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg" event={"ID":"e2e8db3f-eb29-43c5-84a8-f8dee6479093","Type":"ContainerStarted","Data":"ae9e8ed8d02db136416e63e6c0818e590f956172d91890dae32c313dd02bd3aa"}
Jul 28 21:17:26.173253 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:26.173211    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg" podStartSLOduration=1.173196842 podStartE2EDuration="1.173196842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:17:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:17:26.170528836 +0000 UTC m=+3130.389917781" watchObservedRunningTime="2026-07-28 21:17:26.173196842 +0000 UTC m=+3130.392585726"
Jul 28 21:17:26.340450 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:26.340410    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:26.345284 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:26.345256    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:27.149740 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:27.149698    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:27.150570 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:27.150551    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:46.236523 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:46.236488    2556 generic.go:356] "Generic (PLEG): container finished" podID="e2e8db3f-eb29-43c5-84a8-f8dee6479093" containerID="309bf88293ef6bd4ddf104b82b05c8396c49b82934622ff19bb2cc2ee0b2785f" exitCode=0
Jul 28 21:17:46.237054 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:46.236565    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg" event={"ID":"e2e8db3f-eb29-43c5-84a8-f8dee6479093","Type":"ContainerDied","Data":"309bf88293ef6bd4ddf104b82b05c8396c49b82934622ff19bb2cc2ee0b2785f"}
Jul 28 21:17:46.237132 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:46.237053    2556 scope.go:117] "RemoveContainer" containerID="309bf88293ef6bd4ddf104b82b05c8396c49b82934622ff19bb2cc2ee0b2785f"
Jul 28 21:17:46.238099 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:46.238075    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:17:46.238160 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:46.238145    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:17:46.238197 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:46.238175    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:17:47.243706 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:47.243664    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg" event={"ID":"e2e8db3f-eb29-43c5-84a8-f8dee6479093","Type":"ContainerStarted","Data":"c896cce10a34ab32d6c4a40a83310a0a12f463e7d0e5257b4a4ccf1f8f190f80"}
Jul 28 21:17:47.340115 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:47.340083    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:47.340318 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:47.340299    2556 patch_prober.go:28] interesting pod/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 28 21:17:47.340395 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:47.340364    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg" podUID="e2e8db3f-eb29-43c5-84a8-f8dee6479093" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 28 21:17:48.340277 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:48.340247    2556 patch_prober.go:28] interesting pod/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 28 21:17:48.340680 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:48.340300    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg" podUID="e2e8db3f-eb29-43c5-84a8-f8dee6479093" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 28 21:17:49.340240 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:49.340197    2556 patch_prober.go:28] interesting pod/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 28 21:17:49.340484 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:49.340263    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg" podUID="e2e8db3f-eb29-43c5-84a8-f8dee6479093" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 28 21:17:50.340038 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:50.339992    2556 patch_prober.go:28] interesting pod/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 28 21:17:50.340218 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:50.340088    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg" podUID="e2e8db3f-eb29-43c5-84a8-f8dee6479093" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 28 21:17:51.343658 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:51.343630    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:51.344107 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:51.343866    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:17:51.344452 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:17:51.344437    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:18:48.338184 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.338149    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"]
Jul 28 21:18:48.341783 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.341767    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.344651 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.344629    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-8951c6-openshift-default-dockercfg-btk4w\""
Jul 28 21:18:48.364521 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.364495    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"]
Jul 28 21:18:48.482000 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.481965    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0570baa-a0c2-4158-82d5-a9a73a108091-istiod-ca-cert\") pod \"e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") " pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.482000 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.482014    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-workload-certs\") pod \"e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") " pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.482233 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.482070    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-istio-envoy\") pod \"e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") " pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.482233 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.482120    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-credential-socket\") pod \"e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") " pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.482233 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.482157    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-istio-data\") pod \"e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") " pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.482233 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.482213    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0570baa-a0c2-4158-82d5-a9a73a108091-istio-token\") pod \"e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") " pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.482436 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.482253    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0570baa-a0c2-4158-82d5-a9a73a108091-istio-podinfo\") pod \"e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") " pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.482436 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.482271    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64jhh\" (UniqueName: \"kubernetes.io/projected/e0570baa-a0c2-4158-82d5-a9a73a108091-kube-api-access-64jhh\") pod \"e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") " pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.482436 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.482301    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-workload-socket\") pod \"e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") " pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.583776 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.583742    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0570baa-a0c2-4158-82d5-a9a73a108091-istio-token\") pod \"e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") " pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.583957 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.583797    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0570baa-a0c2-4158-82d5-a9a73a108091-istio-podinfo\") pod \"e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") " pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.583957 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.583829    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64jhh\" (UniqueName: \"kubernetes.io/projected/e0570baa-a0c2-4158-82d5-a9a73a108091-kube-api-access-64jhh\") pod \"e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") " pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.583957 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.583865    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-workload-socket\") pod \"e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") " pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.583957 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.583930    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0570baa-a0c2-4158-82d5-a9a73a108091-istiod-ca-cert\") pod \"e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") " pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.584192 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.583964    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-workload-certs\") pod \"e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") " pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.584192 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.583996    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-istio-envoy\") pod \"e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") " pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.584192 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.584031    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-credential-socket\") pod \"e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") " pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.584192 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.584060    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-istio-data\") pod \"e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") " pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.584486 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.584463    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-istio-data\") pod \"e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") " pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.584582 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.584553    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-credential-socket\") pod \"e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") " pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.584714 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.584612    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-workload-socket\") pod \"e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") " pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.584714 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.584631    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-workload-certs\") pod \"e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") " pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.584886 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.584865    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0570baa-a0c2-4158-82d5-a9a73a108091-istiod-ca-cert\") pod \"e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") " pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.586435 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.586410    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-istio-envoy\") pod \"e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") " pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.586569 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.586555    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0570baa-a0c2-4158-82d5-a9a73a108091-istio-podinfo\") pod \"e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") " pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.598524 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.598467    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0570baa-a0c2-4158-82d5-a9a73a108091-istio-token\") pod \"e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") " pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.598838 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.598820    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64jhh\" (UniqueName: \"kubernetes.io/projected/e0570baa-a0c2-4158-82d5-a9a73a108091-kube-api-access-64jhh\") pod \"e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") " pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.651909 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.651884    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:48.804756 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.804730    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"]
Jul 28 21:18:48.806307 ip-10-0-136-118 kubenswrapper[2556]: W0728 21:18:48.806284    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0570baa_a0c2_4158_82d5_a9a73a108091.slice/crio-6aaeefd8f195b9bed741012335e5320d19524269f48cf597ba7137f641ffdfa6 WatchSource:0}: Error finding container 6aaeefd8f195b9bed741012335e5320d19524269f48cf597ba7137f641ffdfa6: Status 404 returned error can't find the container with id 6aaeefd8f195b9bed741012335e5320d19524269f48cf597ba7137f641ffdfa6
Jul 28 21:18:48.808474 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.808438    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:18:48.808549 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.808507    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:18:48.808549 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:48.808534    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:18:49.529705 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:49.529674    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx" event={"ID":"e0570baa-a0c2-4158-82d5-a9a73a108091","Type":"ContainerStarted","Data":"a2de1007c2b72b70706b5ba07b2b59f13165971bd829531134a83b703c5b099a"}
Jul 28 21:18:49.530170 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:49.529731    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx" event={"ID":"e0570baa-a0c2-4158-82d5-a9a73a108091","Type":"ContainerStarted","Data":"6aaeefd8f195b9bed741012335e5320d19524269f48cf597ba7137f641ffdfa6"}
Jul 28 21:18:49.580061 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:49.580014    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx" podStartSLOduration=1.579997442 podStartE2EDuration="1.579997442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:18:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:18:49.577390598 +0000 UTC m=+3213.796779485" watchObservedRunningTime="2026-07-28 21:18:49.579997442 +0000 UTC m=+3213.799386326"
Jul 28 21:18:49.652243 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:49.652217    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:49.657133 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:49.657110    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:50.534654 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:50.534627    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:18:50.535618 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:18:50.535599    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:19:03.601308 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:03.601271    2556 generic.go:356] "Generic (PLEG): container finished" podID="e0570baa-a0c2-4158-82d5-a9a73a108091" containerID="a2de1007c2b72b70706b5ba07b2b59f13165971bd829531134a83b703c5b099a" exitCode=0
Jul 28 21:19:03.601730 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:03.601356    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx" event={"ID":"e0570baa-a0c2-4158-82d5-a9a73a108091","Type":"ContainerDied","Data":"a2de1007c2b72b70706b5ba07b2b59f13165971bd829531134a83b703c5b099a"}
Jul 28 21:19:03.601775 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:03.601746    2556 scope.go:117] "RemoveContainer" containerID="a2de1007c2b72b70706b5ba07b2b59f13165971bd829531134a83b703c5b099a"
Jul 28 21:19:03.602825 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:03.602801    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:19:03.602878 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:03.602864    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:19:03.602913 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:03.602894    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 21:19:04.608292 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:04.608255    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx" event={"ID":"e0570baa-a0c2-4158-82d5-a9a73a108091","Type":"ContainerStarted","Data":"7c74e104af25f5b0569f217c1b65df1248bfe85381242396464a307daaf85db5"}
Jul 28 21:19:04.652853 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:04.652827    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:19:04.653725 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:04.653702    2556 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 28 21:19:04.653857 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:04.653752    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx" podUID="e0570baa-a0c2-4158-82d5-a9a73a108091" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 28 21:19:05.535567 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:05.535531    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:19:05.652264 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:05.652231    2556 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 28 21:19:05.652681 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:05.652277    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx" podUID="e0570baa-a0c2-4158-82d5-a9a73a108091" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 28 21:19:06.652943 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:06.652909    2556 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 28 21:19:06.653326 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:06.652959    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx" podUID="e0570baa-a0c2-4158-82d5-a9a73a108091" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 28 21:19:07.653250 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:07.653217    2556 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 28 21:19:07.653663 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:07.653266    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx" podUID="e0570baa-a0c2-4158-82d5-a9a73a108091" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 28 21:19:08.656534 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:08.656504    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:19:08.657455 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:08.657425    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:19:17.356474 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:17.356436    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8951c6-2x85h"]
Jul 28 21:19:17.360185 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:17.360158    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8951c6-2x85h"
Jul 28 21:19:17.363781 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:17.363760    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cxpsn\""
Jul 28 21:19:17.363936 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:17.363809    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 21:19:17.371275 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:17.371249    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8951c6-2x85h"]
Jul 28 21:19:17.455980 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:17.455929    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b563d5f7-3b4c-4347-accd-a9b67c7d026f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-8951c6-2x85h\" (UID: \"b563d5f7-3b4c-4347-accd-a9b67c7d026f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8951c6-2x85h"
Jul 28 21:19:17.557766 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:17.557721    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b563d5f7-3b4c-4347-accd-a9b67c7d026f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-8951c6-2x85h\" (UID: \"b563d5f7-3b4c-4347-accd-a9b67c7d026f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8951c6-2x85h"
Jul 28 21:19:17.558325 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:17.558304    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b563d5f7-3b4c-4347-accd-a9b67c7d026f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-8951c6-2x85h\" (UID: \"b563d5f7-3b4c-4347-accd-a9b67c7d026f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8951c6-2x85h"
Jul 28 21:19:17.671632 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:17.671556    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8951c6-2x85h"
Jul 28 21:19:17.805490 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:17.805461    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8951c6-2x85h"]
Jul 28 21:19:17.808052 ip-10-0-136-118 kubenswrapper[2556]: W0728 21:19:17.808025    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb563d5f7_3b4c_4347_accd_a9b67c7d026f.slice/crio-77fbf4ba4a2ade5b22c6c678a0eee2971b810edee8cc15b79090209c81104fd2 WatchSource:0}: Error finding container 77fbf4ba4a2ade5b22c6c678a0eee2971b810edee8cc15b79090209c81104fd2: Status 404 returned error can't find the container with id 77fbf4ba4a2ade5b22c6c678a0eee2971b810edee8cc15b79090209c81104fd2
Jul 28 21:19:18.676369 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:18.676312    2556 generic.go:356] "Generic (PLEG): container finished" podID="b563d5f7-3b4c-4347-accd-a9b67c7d026f" containerID="679ce90c9782d1ce48c3e00c5ad1551a6af99bed5675ffacc01cc70aa0fbf475" exitCode=0
Jul 28 21:19:18.676750 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:18.676408    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8951c6-2x85h" event={"ID":"b563d5f7-3b4c-4347-accd-a9b67c7d026f","Type":"ContainerDied","Data":"679ce90c9782d1ce48c3e00c5ad1551a6af99bed5675ffacc01cc70aa0fbf475"}
Jul 28 21:19:18.676750 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:18.676465    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8951c6-2x85h" event={"ID":"b563d5f7-3b4c-4347-accd-a9b67c7d026f","Type":"ContainerStarted","Data":"77fbf4ba4a2ade5b22c6c678a0eee2971b810edee8cc15b79090209c81104fd2"}
Jul 28 21:19:19.810736 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:19.810713    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8951c6-2x85h"
Jul 28 21:19:19.981449 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:19.981373    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b563d5f7-3b4c-4347-accd-a9b67c7d026f-maas-api-service-ca\") pod \"b563d5f7-3b4c-4347-accd-a9b67c7d026f\" (UID: \"b563d5f7-3b4c-4347-accd-a9b67c7d026f\") "
Jul 28 21:19:19.981690 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:19.981670    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b563d5f7-3b4c-4347-accd-a9b67c7d026f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b563d5f7-3b4c-4347-accd-a9b67c7d026f" (UID: "b563d5f7-3b4c-4347-accd-a9b67c7d026f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:19:20.082366 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:20.082322    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b563d5f7-3b4c-4347-accd-a9b67c7d026f-maas-api-service-ca\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:19:20.686692 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:20.686617    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8951c6-2x85h"
Jul 28 21:19:20.686871 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:20.686617    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8951c6-2x85h" event={"ID":"b563d5f7-3b4c-4347-accd-a9b67c7d026f","Type":"ContainerDied","Data":"77fbf4ba4a2ade5b22c6c678a0eee2971b810edee8cc15b79090209c81104fd2"}
Jul 28 21:19:20.686871 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:20.686737    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="77fbf4ba4a2ade5b22c6c678a0eee2971b810edee8cc15b79090209c81104fd2"
Jul 28 21:19:22.625937 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:22.625905    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8951c6-2x85h"]
Jul 28 21:19:22.629120 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:22.629096    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8951c6-2x85h"]
Jul 28 21:19:24.313928 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:24.313896    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b563d5f7-3b4c-4347-accd-a9b67c7d026f" path="/var/lib/kubelet/pods/b563d5f7-3b4c-4347-accd-a9b67c7d026f/volumes"
Jul 28 21:19:29.668617 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:29.668583    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"]
Jul 28 21:19:29.669011 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:29.668776    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx" podUID="e0570baa-a0c2-4158-82d5-a9a73a108091" containerName="istio-proxy" containerID="cri-o://7c74e104af25f5b0569f217c1b65df1248bfe85381242396464a307daaf85db5" gracePeriod=30
Jul 28 21:19:33.481861 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:33.481832    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d6ef24-c7vqh"]
Jul 28 21:19:33.482226 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:33.482210    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b563d5f7-3b4c-4347-accd-a9b67c7d026f" containerName="revoke-keys"
Jul 28 21:19:33.482226 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:33.482222    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b563d5f7-3b4c-4347-accd-a9b67c7d026f" containerName="revoke-keys"
Jul 28 21:19:33.482301 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:33.482282    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b563d5f7-3b4c-4347-accd-a9b67c7d026f" containerName="revoke-keys"
Jul 28 21:19:33.485713 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:33.485696    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d6ef24-c7vqh"
Jul 28 21:19:33.488404 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:33.488372    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cxpsn\""
Jul 28 21:19:33.488526 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:33.488391    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 21:19:33.493529 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:33.493507    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d6ef24-c7vqh"]
Jul 28 21:19:33.509028 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:33.508997    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f86f8c8-5074-4bdc-89d3-2a24a9ef3a03-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-d6ef24-c7vqh\" (UID: \"9f86f8c8-5074-4bdc-89d3-2a24a9ef3a03\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d6ef24-c7vqh"
Jul 28 21:19:33.610523 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:33.610487    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f86f8c8-5074-4bdc-89d3-2a24a9ef3a03-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-d6ef24-c7vqh\" (UID: \"9f86f8c8-5074-4bdc-89d3-2a24a9ef3a03\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d6ef24-c7vqh"
Jul 28 21:19:33.611093 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:33.611076    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f86f8c8-5074-4bdc-89d3-2a24a9ef3a03-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-d6ef24-c7vqh\" (UID: \"9f86f8c8-5074-4bdc-89d3-2a24a9ef3a03\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d6ef24-c7vqh"
Jul 28 21:19:33.797281 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:33.797254    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d6ef24-c7vqh"
Jul 28 21:19:33.928560 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:33.928530    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d6ef24-c7vqh"]
Jul 28 21:19:33.930425 ip-10-0-136-118 kubenswrapper[2556]: W0728 21:19:33.930395    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f86f8c8_5074_4bdc_89d3_2a24a9ef3a03.slice/crio-84ae5e3c462e2062284c2d4e1504348da32ce96478ae6c1d83e9bb457795ba2c WatchSource:0}: Error finding container 84ae5e3c462e2062284c2d4e1504348da32ce96478ae6c1d83e9bb457795ba2c: Status 404 returned error can't find the container with id 84ae5e3c462e2062284c2d4e1504348da32ce96478ae6c1d83e9bb457795ba2c
Jul 28 21:19:34.752757 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:34.752679    2556 generic.go:356] "Generic (PLEG): container finished" podID="9f86f8c8-5074-4bdc-89d3-2a24a9ef3a03" containerID="21a4d8e87abefbfc3b2187176e98d2708e7008c778650bc6bee34bcc60e40011" exitCode=0
Jul 28 21:19:34.753102 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:34.752768    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d6ef24-c7vqh" event={"ID":"9f86f8c8-5074-4bdc-89d3-2a24a9ef3a03","Type":"ContainerDied","Data":"21a4d8e87abefbfc3b2187176e98d2708e7008c778650bc6bee34bcc60e40011"}
Jul 28 21:19:34.753102 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:34.752829    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d6ef24-c7vqh" event={"ID":"9f86f8c8-5074-4bdc-89d3-2a24a9ef3a03","Type":"ContainerStarted","Data":"84ae5e3c462e2062284c2d4e1504348da32ce96478ae6c1d83e9bb457795ba2c"}
Jul 28 21:19:34.922613 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:34.922587    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:19:35.022620 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.022528    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-istio-data\") pod \"e0570baa-a0c2-4158-82d5-a9a73a108091\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") "
Jul 28 21:19:35.022620 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.022567    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0570baa-a0c2-4158-82d5-a9a73a108091-istio-token\") pod \"e0570baa-a0c2-4158-82d5-a9a73a108091\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") "
Jul 28 21:19:35.022620 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.022605    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-credential-socket\") pod \"e0570baa-a0c2-4158-82d5-a9a73a108091\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") "
Jul 28 21:19:35.022620 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.022620    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-workload-socket\") pod \"e0570baa-a0c2-4158-82d5-a9a73a108091\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") "
Jul 28 21:19:35.022955 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.022673    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0570baa-a0c2-4158-82d5-a9a73a108091-istio-podinfo\") pod \"e0570baa-a0c2-4158-82d5-a9a73a108091\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") "
Jul 28 21:19:35.022955 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.022720    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64jhh\" (UniqueName: \"kubernetes.io/projected/e0570baa-a0c2-4158-82d5-a9a73a108091-kube-api-access-64jhh\") pod \"e0570baa-a0c2-4158-82d5-a9a73a108091\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") "
Jul 28 21:19:35.022955 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.022747    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-workload-certs\") pod \"e0570baa-a0c2-4158-82d5-a9a73a108091\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") "
Jul 28 21:19:35.022955 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.022793    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-istio-envoy\") pod \"e0570baa-a0c2-4158-82d5-a9a73a108091\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") "
Jul 28 21:19:35.022955 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.022827    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0570baa-a0c2-4158-82d5-a9a73a108091-istiod-ca-cert\") pod \"e0570baa-a0c2-4158-82d5-a9a73a108091\" (UID: \"e0570baa-a0c2-4158-82d5-a9a73a108091\") "
Jul 28 21:19:35.022955 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.022886    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e0570baa-a0c2-4158-82d5-a9a73a108091" (UID: "e0570baa-a0c2-4158-82d5-a9a73a108091"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:19:35.023207 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.023004    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e0570baa-a0c2-4158-82d5-a9a73a108091" (UID: "e0570baa-a0c2-4158-82d5-a9a73a108091"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:19:35.023207 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.023047    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e0570baa-a0c2-4158-82d5-a9a73a108091" (UID: "e0570baa-a0c2-4158-82d5-a9a73a108091"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:19:35.023207 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.023144    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-credential-socket\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:19:35.023207 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.023162    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-workload-socket\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:19:35.023207 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.023178    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-workload-certs\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:19:35.023207 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.023189    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0570baa-a0c2-4158-82d5-a9a73a108091-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e0570baa-a0c2-4158-82d5-a9a73a108091" (UID: "e0570baa-a0c2-4158-82d5-a9a73a108091"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:19:35.023577 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.023475    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-istio-data" (OuterVolumeSpecName: "istio-data") pod "e0570baa-a0c2-4158-82d5-a9a73a108091" (UID: "e0570baa-a0c2-4158-82d5-a9a73a108091"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:19:35.024978 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.024958    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e0570baa-a0c2-4158-82d5-a9a73a108091" (UID: "e0570baa-a0c2-4158-82d5-a9a73a108091"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:19:35.025171 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.025153    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0570baa-a0c2-4158-82d5-a9a73a108091-kube-api-access-64jhh" (OuterVolumeSpecName: "kube-api-access-64jhh") pod "e0570baa-a0c2-4158-82d5-a9a73a108091" (UID: "e0570baa-a0c2-4158-82d5-a9a73a108091"). InnerVolumeSpecName "kube-api-access-64jhh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:19:35.025264 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.025250    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e0570baa-a0c2-4158-82d5-a9a73a108091-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e0570baa-a0c2-4158-82d5-a9a73a108091" (UID: "e0570baa-a0c2-4158-82d5-a9a73a108091"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 21:19:35.025264 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.025252    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0570baa-a0c2-4158-82d5-a9a73a108091-istio-token" (OuterVolumeSpecName: "istio-token") pod "e0570baa-a0c2-4158-82d5-a9a73a108091" (UID: "e0570baa-a0c2-4158-82d5-a9a73a108091"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:19:35.124106 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.124071    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-istio-envoy\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:19:35.124106 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.124099    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0570baa-a0c2-4158-82d5-a9a73a108091-istiod-ca-cert\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:19:35.124106 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.124107    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0570baa-a0c2-4158-82d5-a9a73a108091-istio-data\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:19:35.124106 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.124117    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0570baa-a0c2-4158-82d5-a9a73a108091-istio-token\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:19:35.124396 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.124125    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0570baa-a0c2-4158-82d5-a9a73a108091-istio-podinfo\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:19:35.124396 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.124134    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64jhh\" (UniqueName: \"kubernetes.io/projected/e0570baa-a0c2-4158-82d5-a9a73a108091-kube-api-access-64jhh\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:19:35.761433 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.761392    2556 generic.go:356] "Generic (PLEG): container finished" podID="e0570baa-a0c2-4158-82d5-a9a73a108091" containerID="7c74e104af25f5b0569f217c1b65df1248bfe85381242396464a307daaf85db5" exitCode=0
Jul 28 21:19:35.761919 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.761447    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"
Jul 28 21:19:35.761919 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.761474    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx" event={"ID":"e0570baa-a0c2-4158-82d5-a9a73a108091","Type":"ContainerDied","Data":"7c74e104af25f5b0569f217c1b65df1248bfe85381242396464a307daaf85db5"}
Jul 28 21:19:35.761919 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.761527    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx" event={"ID":"e0570baa-a0c2-4158-82d5-a9a73a108091","Type":"ContainerDied","Data":"6aaeefd8f195b9bed741012335e5320d19524269f48cf597ba7137f641ffdfa6"}
Jul 28 21:19:35.761919 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.761549    2556 scope.go:117] "RemoveContainer" containerID="7c74e104af25f5b0569f217c1b65df1248bfe85381242396464a307daaf85db5"
Jul 28 21:19:35.771706 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.771689    2556 scope.go:117] "RemoveContainer" containerID="a2de1007c2b72b70706b5ba07b2b59f13165971bd829531134a83b703c5b099a"
Jul 28 21:19:35.781053 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.781035    2556 scope.go:117] "RemoveContainer" containerID="7c74e104af25f5b0569f217c1b65df1248bfe85381242396464a307daaf85db5"
Jul 28 21:19:35.781331 ip-10-0-136-118 kubenswrapper[2556]: E0728 21:19:35.781307    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c74e104af25f5b0569f217c1b65df1248bfe85381242396464a307daaf85db5\": container with ID starting with 7c74e104af25f5b0569f217c1b65df1248bfe85381242396464a307daaf85db5 not found: ID does not exist" containerID="7c74e104af25f5b0569f217c1b65df1248bfe85381242396464a307daaf85db5"
Jul 28 21:19:35.781434 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.781339    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c74e104af25f5b0569f217c1b65df1248bfe85381242396464a307daaf85db5"} err="failed to get container status \"7c74e104af25f5b0569f217c1b65df1248bfe85381242396464a307daaf85db5\": rpc error: code = NotFound desc = could not find container \"7c74e104af25f5b0569f217c1b65df1248bfe85381242396464a307daaf85db5\": container with ID starting with 7c74e104af25f5b0569f217c1b65df1248bfe85381242396464a307daaf85db5 not found: ID does not exist"
Jul 28 21:19:35.781434 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.781376    2556 scope.go:117] "RemoveContainer" containerID="a2de1007c2b72b70706b5ba07b2b59f13165971bd829531134a83b703c5b099a"
Jul 28 21:19:35.781642 ip-10-0-136-118 kubenswrapper[2556]: E0728 21:19:35.781624    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2de1007c2b72b70706b5ba07b2b59f13165971bd829531134a83b703c5b099a\": container with ID starting with a2de1007c2b72b70706b5ba07b2b59f13165971bd829531134a83b703c5b099a not found: ID does not exist" containerID="a2de1007c2b72b70706b5ba07b2b59f13165971bd829531134a83b703c5b099a"
Jul 28 21:19:35.781692 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.781649    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2de1007c2b72b70706b5ba07b2b59f13165971bd829531134a83b703c5b099a"} err="failed to get container status \"a2de1007c2b72b70706b5ba07b2b59f13165971bd829531134a83b703c5b099a\": rpc error: code = NotFound desc = could not find container \"a2de1007c2b72b70706b5ba07b2b59f13165971bd829531134a83b703c5b099a\": container with ID starting with a2de1007c2b72b70706b5ba07b2b59f13165971bd829531134a83b703c5b099a not found: ID does not exist"
Jul 28 21:19:35.787588 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.787564    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"]
Jul 28 21:19:35.791791 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.791766    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-8951c6-openshift-default-75d8f57556-8ntmx"]
Jul 28 21:19:35.890318 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.890292    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d6ef24-c7vqh"
Jul 28 21:19:35.931637 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.931606    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f86f8c8-5074-4bdc-89d3-2a24a9ef3a03-maas-api-service-ca\") pod \"9f86f8c8-5074-4bdc-89d3-2a24a9ef3a03\" (UID: \"9f86f8c8-5074-4bdc-89d3-2a24a9ef3a03\") "
Jul 28 21:19:35.931952 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:35.931931    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f86f8c8-5074-4bdc-89d3-2a24a9ef3a03-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9f86f8c8-5074-4bdc-89d3-2a24a9ef3a03" (UID: "9f86f8c8-5074-4bdc-89d3-2a24a9ef3a03"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:19:36.032908 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:36.032818    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f86f8c8-5074-4bdc-89d3-2a24a9ef3a03-maas-api-service-ca\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:19:36.320014 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:36.319978    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0570baa-a0c2-4158-82d5-a9a73a108091" path="/var/lib/kubelet/pods/e0570baa-a0c2-4158-82d5-a9a73a108091/volumes"
Jul 28 21:19:36.768082 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:36.768002    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d6ef24-c7vqh"
Jul 28 21:19:36.768500 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:36.768001    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d6ef24-c7vqh" event={"ID":"9f86f8c8-5074-4bdc-89d3-2a24a9ef3a03","Type":"ContainerDied","Data":"84ae5e3c462e2062284c2d4e1504348da32ce96478ae6c1d83e9bb457795ba2c"}
Jul 28 21:19:36.768500 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:36.768127    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84ae5e3c462e2062284c2d4e1504348da32ce96478ae6c1d83e9bb457795ba2c"
Jul 28 21:19:49.682332 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:49.682296    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d6ef24-c7vqh"]
Jul 28 21:19:49.684180 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:49.684159    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d6ef24-c7vqh"]
Jul 28 21:19:50.313585 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:19:50.313554    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f86f8c8-5074-4bdc-89d3-2a24a9ef3a03" path="/var/lib/kubelet/pods/9f86f8c8-5074-4bdc-89d3-2a24a9ef3a03/volumes"
Jul 28 21:20:53.849124 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:53.849043    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"]
Jul 28 21:20:53.849674 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:53.849270    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw" podUID="ea76f54b-0a83-4be4-8a6f-a9e5be339e84" containerName="istio-proxy" containerID="cri-o://12e24611a978075b7bf18ee41ceb01e77f431253c08591a3bbe36009c88caced" gracePeriod=30
Jul 28 21:20:54.267489 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:54.267401    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-590ada-xtg6c"]
Jul 28 21:20:54.267765 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:54.267753    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f86f8c8-5074-4bdc-89d3-2a24a9ef3a03" containerName="revoke-keys"
Jul 28 21:20:54.267808 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:54.267766    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f86f8c8-5074-4bdc-89d3-2a24a9ef3a03" containerName="revoke-keys"
Jul 28 21:20:54.267808 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:54.267784    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0570baa-a0c2-4158-82d5-a9a73a108091" containerName="istio-proxy"
Jul 28 21:20:54.267808 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:54.267790    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0570baa-a0c2-4158-82d5-a9a73a108091" containerName="istio-proxy"
Jul 28 21:20:54.267808 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:54.267799    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0570baa-a0c2-4158-82d5-a9a73a108091" containerName="istio-proxy"
Jul 28 21:20:54.267808 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:54.267807    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0570baa-a0c2-4158-82d5-a9a73a108091" containerName="istio-proxy"
Jul 28 21:20:54.267962 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:54.267868    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f86f8c8-5074-4bdc-89d3-2a24a9ef3a03" containerName="revoke-keys"
Jul 28 21:20:54.267962 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:54.267877    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0570baa-a0c2-4158-82d5-a9a73a108091" containerName="istio-proxy"
Jul 28 21:20:54.267962 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:54.267884    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0570baa-a0c2-4158-82d5-a9a73a108091" containerName="istio-proxy"
Jul 28 21:20:54.270890 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:54.270874    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-590ada-xtg6c"
Jul 28 21:20:54.274069 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:54.274051    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cxpsn\""
Jul 28 21:20:54.274162 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:54.274052    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 21:20:54.282373 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:54.282332    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-590ada-xtg6c"]
Jul 28 21:20:54.334304 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:54.334273    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/097398b0-6be4-40af-9993-7933b4a0ddd1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-590ada-xtg6c\" (UID: \"097398b0-6be4-40af-9993-7933b4a0ddd1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-590ada-xtg6c"
Jul 28 21:20:54.434863 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:54.434826    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/097398b0-6be4-40af-9993-7933b4a0ddd1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-590ada-xtg6c\" (UID: \"097398b0-6be4-40af-9993-7933b4a0ddd1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-590ada-xtg6c"
Jul 28 21:20:54.435527 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:54.435506    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/097398b0-6be4-40af-9993-7933b4a0ddd1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-590ada-xtg6c\" (UID: \"097398b0-6be4-40af-9993-7933b4a0ddd1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-590ada-xtg6c"
Jul 28 21:20:54.581186 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:54.581149    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-590ada-xtg6c"
Jul 28 21:20:54.723505 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:54.723471    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-590ada-xtg6c"]
Jul 28 21:20:54.724895 ip-10-0-136-118 kubenswrapper[2556]: W0728 21:20:54.724870    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod097398b0_6be4_40af_9993_7933b4a0ddd1.slice/crio-8e2929286034c6c8d4e2e8fe53d441c7bbfad4415a8d61ee34279b69b3ccd4b3 WatchSource:0}: Error finding container 8e2929286034c6c8d4e2e8fe53d441c7bbfad4415a8d61ee34279b69b3ccd4b3: Status 404 returned error can't find the container with id 8e2929286034c6c8d4e2e8fe53d441c7bbfad4415a8d61ee34279b69b3ccd4b3
Jul 28 21:20:55.132228 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:55.132194    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-590ada-xtg6c" event={"ID":"097398b0-6be4-40af-9993-7933b4a0ddd1","Type":"ContainerStarted","Data":"4f3969892d37177ad5ae246cfaff092691a6ef15be3128a4dc5cb58ca083f979"}
Jul 28 21:20:55.132676 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:55.132244    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-590ada-xtg6c" event={"ID":"097398b0-6be4-40af-9993-7933b4a0ddd1","Type":"ContainerStarted","Data":"8e2929286034c6c8d4e2e8fe53d441c7bbfad4415a8d61ee34279b69b3ccd4b3"}
Jul 28 21:20:55.150079 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:55.149994    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-590ada-xtg6c" podStartSLOduration=1.149981389 podStartE2EDuration="1.149981389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:20:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:20:55.147961285 +0000 UTC m=+3339.367350169" watchObservedRunningTime="2026-07-28 21:20:55.149981389 +0000 UTC m=+3339.369370273"
Jul 28 21:20:56.139077 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:56.139038    2556 generic.go:356] "Generic (PLEG): container finished" podID="097398b0-6be4-40af-9993-7933b4a0ddd1" containerID="4f3969892d37177ad5ae246cfaff092691a6ef15be3128a4dc5cb58ca083f979" exitCode=0
Jul 28 21:20:56.139518 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:56.139093    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-590ada-xtg6c" event={"ID":"097398b0-6be4-40af-9993-7933b4a0ddd1","Type":"ContainerDied","Data":"4f3969892d37177ad5ae246cfaff092691a6ef15be3128a4dc5cb58ca083f979"}
Jul 28 21:20:57.273244 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:57.273215    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-590ada-xtg6c"
Jul 28 21:20:57.359594 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:57.359561    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/097398b0-6be4-40af-9993-7933b4a0ddd1-maas-api-service-ca\") pod \"097398b0-6be4-40af-9993-7933b4a0ddd1\" (UID: \"097398b0-6be4-40af-9993-7933b4a0ddd1\") "
Jul 28 21:20:57.359877 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:57.359855    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/097398b0-6be4-40af-9993-7933b4a0ddd1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "097398b0-6be4-40af-9993-7933b4a0ddd1" (UID: "097398b0-6be4-40af-9993-7933b4a0ddd1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:20:57.359963 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:57.359946    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/097398b0-6be4-40af-9993-7933b4a0ddd1-maas-api-service-ca\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:20:58.149276 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:58.149248    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-590ada-xtg6c"
Jul 28 21:20:58.149276 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:58.149272    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-590ada-xtg6c" event={"ID":"097398b0-6be4-40af-9993-7933b4a0ddd1","Type":"ContainerDied","Data":"8e2929286034c6c8d4e2e8fe53d441c7bbfad4415a8d61ee34279b69b3ccd4b3"}
Jul 28 21:20:58.149503 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:58.149313    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e2929286034c6c8d4e2e8fe53d441c7bbfad4415a8d61ee34279b69b3ccd4b3"
Jul 28 21:20:59.094735 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.094704    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:20:59.155602 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.155519    2556 generic.go:356] "Generic (PLEG): container finished" podID="ea76f54b-0a83-4be4-8a6f-a9e5be339e84" containerID="12e24611a978075b7bf18ee41ceb01e77f431253c08591a3bbe36009c88caced" exitCode=0
Jul 28 21:20:59.155602 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.155572    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"
Jul 28 21:20:59.155768 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.155608    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw" event={"ID":"ea76f54b-0a83-4be4-8a6f-a9e5be339e84","Type":"ContainerDied","Data":"12e24611a978075b7bf18ee41ceb01e77f431253c08591a3bbe36009c88caced"}
Jul 28 21:20:59.155768 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.155664    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw" event={"ID":"ea76f54b-0a83-4be4-8a6f-a9e5be339e84","Type":"ContainerDied","Data":"4a551447adcb9c446350274ee46d50658b8d0ad2383390371d06ad6f59551154"}
Jul 28 21:20:59.155768 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.155688    2556 scope.go:117] "RemoveContainer" containerID="12e24611a978075b7bf18ee41ceb01e77f431253c08591a3bbe36009c88caced"
Jul 28 21:20:59.163989 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.163960    2556 scope.go:117] "RemoveContainer" containerID="c41bcf85c54dff1bc17d393436de19aef49f219e6c270f73928a91c28c289bfd"
Jul 28 21:20:59.171761 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.171742    2556 scope.go:117] "RemoveContainer" containerID="12e24611a978075b7bf18ee41ceb01e77f431253c08591a3bbe36009c88caced"
Jul 28 21:20:59.172013 ip-10-0-136-118 kubenswrapper[2556]: E0728 21:20:59.171993    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12e24611a978075b7bf18ee41ceb01e77f431253c08591a3bbe36009c88caced\": container with ID starting with 12e24611a978075b7bf18ee41ceb01e77f431253c08591a3bbe36009c88caced not found: ID does not exist" containerID="12e24611a978075b7bf18ee41ceb01e77f431253c08591a3bbe36009c88caced"
Jul 28 21:20:59.172083 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.172023    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12e24611a978075b7bf18ee41ceb01e77f431253c08591a3bbe36009c88caced"} err="failed to get container status \"12e24611a978075b7bf18ee41ceb01e77f431253c08591a3bbe36009c88caced\": rpc error: code = NotFound desc = could not find container \"12e24611a978075b7bf18ee41ceb01e77f431253c08591a3bbe36009c88caced\": container with ID starting with 12e24611a978075b7bf18ee41ceb01e77f431253c08591a3bbe36009c88caced not found: ID does not exist"
Jul 28 21:20:59.172083 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.172045    2556 scope.go:117] "RemoveContainer" containerID="c41bcf85c54dff1bc17d393436de19aef49f219e6c270f73928a91c28c289bfd"
Jul 28 21:20:59.172267 ip-10-0-136-118 kubenswrapper[2556]: E0728 21:20:59.172247    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c41bcf85c54dff1bc17d393436de19aef49f219e6c270f73928a91c28c289bfd\": container with ID starting with c41bcf85c54dff1bc17d393436de19aef49f219e6c270f73928a91c28c289bfd not found: ID does not exist" containerID="c41bcf85c54dff1bc17d393436de19aef49f219e6c270f73928a91c28c289bfd"
Jul 28 21:20:59.172303 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.172274    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c41bcf85c54dff1bc17d393436de19aef49f219e6c270f73928a91c28c289bfd"} err="failed to get container status \"c41bcf85c54dff1bc17d393436de19aef49f219e6c270f73928a91c28c289bfd\": rpc error: code = NotFound desc = could not find container \"c41bcf85c54dff1bc17d393436de19aef49f219e6c270f73928a91c28c289bfd\": container with ID starting with c41bcf85c54dff1bc17d393436de19aef49f219e6c270f73928a91c28c289bfd not found: ID does not exist"
Jul 28 21:20:59.173550 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.173535    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istiod-ca-cert\") pod \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") "
Jul 28 21:20:59.173599 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.173567    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ss6kx\" (UniqueName: \"kubernetes.io/projected/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-kube-api-access-ss6kx\") pod \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") "
Jul 28 21:20:59.173599 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.173590    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istio-envoy\") pod \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") "
Jul 28 21:20:59.173669 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.173656    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istio-token\") pod \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") "
Jul 28 21:20:59.173710 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.173678    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-workload-socket\") pod \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") "
Jul 28 21:20:59.173710 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.173697    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-credential-socket\") pod \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") "
Jul 28 21:20:59.173860 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.173733    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-workload-certs\") pod \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") "
Jul 28 21:20:59.173860 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.173758    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istio-data\") pod \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") "
Jul 28 21:20:59.173860 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.173790    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istio-podinfo\") pod \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\" (UID: \"ea76f54b-0a83-4be4-8a6f-a9e5be339e84\") "
Jul 28 21:20:59.174008 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.173982    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ea76f54b-0a83-4be4-8a6f-a9e5be339e84" (UID: "ea76f54b-0a83-4be4-8a6f-a9e5be339e84"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:20:59.174338 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.174136    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ea76f54b-0a83-4be4-8a6f-a9e5be339e84" (UID: "ea76f54b-0a83-4be4-8a6f-a9e5be339e84"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:20:59.174338 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.174152    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istiod-ca-cert\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:20:59.174338 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.174162    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ea76f54b-0a83-4be4-8a6f-a9e5be339e84" (UID: "ea76f54b-0a83-4be4-8a6f-a9e5be339e84"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:20:59.174338 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.174262    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ea76f54b-0a83-4be4-8a6f-a9e5be339e84" (UID: "ea76f54b-0a83-4be4-8a6f-a9e5be339e84"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:20:59.174933 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.174913    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istio-data" (OuterVolumeSpecName: "istio-data") pod "ea76f54b-0a83-4be4-8a6f-a9e5be339e84" (UID: "ea76f54b-0a83-4be4-8a6f-a9e5be339e84"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:20:59.175866 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.175841    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ea76f54b-0a83-4be4-8a6f-a9e5be339e84" (UID: "ea76f54b-0a83-4be4-8a6f-a9e5be339e84"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:20:59.175972 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.175880    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ea76f54b-0a83-4be4-8a6f-a9e5be339e84" (UID: "ea76f54b-0a83-4be4-8a6f-a9e5be339e84"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 21:20:59.176139 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.176115    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istio-token" (OuterVolumeSpecName: "istio-token") pod "ea76f54b-0a83-4be4-8a6f-a9e5be339e84" (UID: "ea76f54b-0a83-4be4-8a6f-a9e5be339e84"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:20:59.176236 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.176132    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-kube-api-access-ss6kx" (OuterVolumeSpecName: "kube-api-access-ss6kx") pod "ea76f54b-0a83-4be4-8a6f-a9e5be339e84" (UID: "ea76f54b-0a83-4be4-8a6f-a9e5be339e84"). InnerVolumeSpecName "kube-api-access-ss6kx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:20:59.275381 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.275337    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ss6kx\" (UniqueName: \"kubernetes.io/projected/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-kube-api-access-ss6kx\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:20:59.275381 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.275382    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istio-envoy\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:20:59.275545 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.275391    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istio-token\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:20:59.275545 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.275399    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-workload-socket\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:20:59.275545 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.275408    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-credential-socket\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:20:59.275545 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.275417    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-workload-certs\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:20:59.275545 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.275425    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istio-data\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:20:59.275545 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.275432    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea76f54b-0a83-4be4-8a6f-a9e5be339e84-istio-podinfo\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:20:59.480181 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.480151    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"]
Jul 28 21:20:59.486631 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:20:59.486605    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-d6ef24-openshift-default-865899766d-tdlxw"]
Jul 28 21:21:00.316059 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:00.316016    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea76f54b-0a83-4be4-8a6f-a9e5be339e84" path="/var/lib/kubelet/pods/ea76f54b-0a83-4be4-8a6f-a9e5be339e84/volumes"
Jul 28 21:21:05.598928 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:05.598895    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-590ada-xtg6c"]
Jul 28 21:21:05.603315 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:05.603285    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-590ada-xtg6c"]
Jul 28 21:21:06.314527 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:06.314494    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="097398b0-6be4-40af-9993-7933b4a0ddd1" path="/var/lib/kubelet/pods/097398b0-6be4-40af-9993-7933b4a0ddd1/volumes"
Jul 28 21:21:12.817686 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:12.817654    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"]
Jul 28 21:21:12.818100 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:12.817855    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg" podUID="e2e8db3f-eb29-43c5-84a8-f8dee6479093" containerName="istio-proxy" containerID="cri-o://c896cce10a34ab32d6c4a40a83310a0a12f463e7d0e5257b4a4ccf1f8f190f80" gracePeriod=30
Jul 28 21:21:13.226702 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:13.226616    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-96b3c5-8tdgl"]
Jul 28 21:21:13.227062 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:13.227044    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea76f54b-0a83-4be4-8a6f-a9e5be339e84" containerName="istio-proxy"
Jul 28 21:21:13.227151 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:13.227065    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea76f54b-0a83-4be4-8a6f-a9e5be339e84" containerName="istio-proxy"
Jul 28 21:21:13.227151 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:13.227087    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea76f54b-0a83-4be4-8a6f-a9e5be339e84" containerName="istio-proxy"
Jul 28 21:21:13.227151 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:13.227096    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea76f54b-0a83-4be4-8a6f-a9e5be339e84" containerName="istio-proxy"
Jul 28 21:21:13.227151 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:13.227114    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="097398b0-6be4-40af-9993-7933b4a0ddd1" containerName="revoke-keys"
Jul 28 21:21:13.227151 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:13.227123    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="097398b0-6be4-40af-9993-7933b4a0ddd1" containerName="revoke-keys"
Jul 28 21:21:13.227490 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:13.227237    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea76f54b-0a83-4be4-8a6f-a9e5be339e84" containerName="istio-proxy"
Jul 28 21:21:13.227490 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:13.227254    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="097398b0-6be4-40af-9993-7933b4a0ddd1" containerName="revoke-keys"
Jul 28 21:21:13.231637 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:13.231616    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-96b3c5-8tdgl"
Jul 28 21:21:13.235460 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:13.235441    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cxpsn\""
Jul 28 21:21:13.235576 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:13.235441    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 21:21:13.239566 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:13.239540    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-96b3c5-8tdgl"]
Jul 28 21:21:13.299984 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:13.299950    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9f9e672-c9c5-45a3-963d-930b82e348bb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-96b3c5-8tdgl\" (UID: \"b9f9e672-c9c5-45a3-963d-930b82e348bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-96b3c5-8tdgl"
Jul 28 21:21:13.401463 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:13.401427    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9f9e672-c9c5-45a3-963d-930b82e348bb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-96b3c5-8tdgl\" (UID: \"b9f9e672-c9c5-45a3-963d-930b82e348bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-96b3c5-8tdgl"
Jul 28 21:21:13.402061 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:13.402042    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9f9e672-c9c5-45a3-963d-930b82e348bb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-96b3c5-8tdgl\" (UID: \"b9f9e672-c9c5-45a3-963d-930b82e348bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-96b3c5-8tdgl"
Jul 28 21:21:13.543186 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:13.543149    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-96b3c5-8tdgl"
Jul 28 21:21:13.689025 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:13.688993    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-96b3c5-8tdgl"]
Jul 28 21:21:13.691028 ip-10-0-136-118 kubenswrapper[2556]: W0728 21:21:13.691003    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9f9e672_c9c5_45a3_963d_930b82e348bb.slice/crio-438560c6a2486ec3de1eada89fc7dce44482079e7d232a9efa7422f0fabc8220 WatchSource:0}: Error finding container 438560c6a2486ec3de1eada89fc7dce44482079e7d232a9efa7422f0fabc8220: Status 404 returned error can't find the container with id 438560c6a2486ec3de1eada89fc7dce44482079e7d232a9efa7422f0fabc8220
Jul 28 21:21:14.230884 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:14.230792    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-96b3c5-8tdgl" event={"ID":"b9f9e672-c9c5-45a3-963d-930b82e348bb","Type":"ContainerStarted","Data":"d22b40acb4282591df453b7e5b6421a074845132928e2f26d096cee9eeb596b2"}
Jul 28 21:21:14.230884 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:14.230855    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-96b3c5-8tdgl" event={"ID":"b9f9e672-c9c5-45a3-963d-930b82e348bb","Type":"ContainerStarted","Data":"438560c6a2486ec3de1eada89fc7dce44482079e7d232a9efa7422f0fabc8220"}
Jul 28 21:21:14.256917 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:14.256860    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-96b3c5-8tdgl" podStartSLOduration=1.256842998 podStartE2EDuration="1.256842998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:21:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:21:14.254481441 +0000 UTC m=+3358.473870325" watchObservedRunningTime="2026-07-28 21:21:14.256842998 +0000 UTC m=+3358.476231883"
Jul 28 21:21:15.237353 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:15.237304    2556 generic.go:356] "Generic (PLEG): container finished" podID="b9f9e672-c9c5-45a3-963d-930b82e348bb" containerID="d22b40acb4282591df453b7e5b6421a074845132928e2f26d096cee9eeb596b2" exitCode=0
Jul 28 21:21:15.237726 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:15.237370    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-96b3c5-8tdgl" event={"ID":"b9f9e672-c9c5-45a3-963d-930b82e348bb","Type":"ContainerDied","Data":"d22b40acb4282591df453b7e5b6421a074845132928e2f26d096cee9eeb596b2"}
Jul 28 21:21:16.370252 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:16.370226    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-96b3c5-8tdgl"
Jul 28 21:21:16.427895 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:16.427869    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9f9e672-c9c5-45a3-963d-930b82e348bb-maas-api-service-ca\") pod \"b9f9e672-c9c5-45a3-963d-930b82e348bb\" (UID: \"b9f9e672-c9c5-45a3-963d-930b82e348bb\") "
Jul 28 21:21:16.428195 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:16.428174    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9f9e672-c9c5-45a3-963d-930b82e348bb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b9f9e672-c9c5-45a3-963d-930b82e348bb" (UID: "b9f9e672-c9c5-45a3-963d-930b82e348bb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:21:16.529365 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:16.529282    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9f9e672-c9c5-45a3-963d-930b82e348bb-maas-api-service-ca\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:21:17.247744 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:17.247711    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-96b3c5-8tdgl" event={"ID":"b9f9e672-c9c5-45a3-963d-930b82e348bb","Type":"ContainerDied","Data":"438560c6a2486ec3de1eada89fc7dce44482079e7d232a9efa7422f0fabc8220"}
Jul 28 21:21:17.247744 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:17.247731    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-96b3c5-8tdgl"
Jul 28 21:21:17.247949 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:17.247762    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="438560c6a2486ec3de1eada89fc7dce44482079e7d232a9efa7422f0fabc8220"
Jul 28 21:21:18.074820 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.074796    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:21:18.144256 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.144184    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-credential-socket\") pod \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") "
Jul 28 21:21:18.144256 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.144215    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kbmv\" (UniqueName: \"kubernetes.io/projected/e2e8db3f-eb29-43c5-84a8-f8dee6479093-kube-api-access-7kbmv\") pod \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") "
Jul 28 21:21:18.144256 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.144247    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istio-data\") pod \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") "
Jul 28 21:21:18.144558 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.144263    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istio-token\") pod \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") "
Jul 28 21:21:18.144558 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.144295    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-workload-socket\") pod \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") "
Jul 28 21:21:18.144558 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.144313    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istiod-ca-cert\") pod \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") "
Jul 28 21:21:18.144558 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.144336    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-workload-certs\") pod \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") "
Jul 28 21:21:18.144558 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.144374    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istio-podinfo\") pod \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") "
Jul 28 21:21:18.144558 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.144420    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istio-envoy\") pod \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\" (UID: \"e2e8db3f-eb29-43c5-84a8-f8dee6479093\") "
Jul 28 21:21:18.144558 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.144492    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e2e8db3f-eb29-43c5-84a8-f8dee6479093" (UID: "e2e8db3f-eb29-43c5-84a8-f8dee6479093"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:21:18.144897 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.144654    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e2e8db3f-eb29-43c5-84a8-f8dee6479093" (UID: "e2e8db3f-eb29-43c5-84a8-f8dee6479093"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:21:18.144897 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.144728    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-credential-socket\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:21:18.144897 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.144787    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e2e8db3f-eb29-43c5-84a8-f8dee6479093" (UID: "e2e8db3f-eb29-43c5-84a8-f8dee6479093"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:21:18.145042 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.144934    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e2e8db3f-eb29-43c5-84a8-f8dee6479093" (UID: "e2e8db3f-eb29-43c5-84a8-f8dee6479093"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:21:18.145228 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.145202    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istio-data" (OuterVolumeSpecName: "istio-data") pod "e2e8db3f-eb29-43c5-84a8-f8dee6479093" (UID: "e2e8db3f-eb29-43c5-84a8-f8dee6479093"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:21:18.146922 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.146894    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2e8db3f-eb29-43c5-84a8-f8dee6479093-kube-api-access-7kbmv" (OuterVolumeSpecName: "kube-api-access-7kbmv") pod "e2e8db3f-eb29-43c5-84a8-f8dee6479093" (UID: "e2e8db3f-eb29-43c5-84a8-f8dee6479093"). InnerVolumeSpecName "kube-api-access-7kbmv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:21:18.147010 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.146939    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istio-token" (OuterVolumeSpecName: "istio-token") pod "e2e8db3f-eb29-43c5-84a8-f8dee6479093" (UID: "e2e8db3f-eb29-43c5-84a8-f8dee6479093"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:21:18.147078 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.147018    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e2e8db3f-eb29-43c5-84a8-f8dee6479093" (UID: "e2e8db3f-eb29-43c5-84a8-f8dee6479093"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:21:18.147078 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.147046    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e2e8db3f-eb29-43c5-84a8-f8dee6479093" (UID: "e2e8db3f-eb29-43c5-84a8-f8dee6479093"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 21:21:18.245742 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.245711    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istio-data\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:21:18.245742 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.245736    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istio-token\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:21:18.245742 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.245745    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-workload-socket\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:21:18.245925 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.245754    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istiod-ca-cert\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:21:18.245925 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.245763    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-workload-certs\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:21:18.245925 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.245771    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istio-podinfo\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:21:18.245925 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.245778    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2e8db3f-eb29-43c5-84a8-f8dee6479093-istio-envoy\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:21:18.245925 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.245786    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kbmv\" (UniqueName: \"kubernetes.io/projected/e2e8db3f-eb29-43c5-84a8-f8dee6479093-kube-api-access-7kbmv\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:21:18.254606 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.254580    2556 generic.go:356] "Generic (PLEG): container finished" podID="e2e8db3f-eb29-43c5-84a8-f8dee6479093" containerID="c896cce10a34ab32d6c4a40a83310a0a12f463e7d0e5257b4a4ccf1f8f190f80" exitCode=0
Jul 28 21:21:18.254708 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.254641    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"
Jul 28 21:21:18.254708 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.254654    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg" event={"ID":"e2e8db3f-eb29-43c5-84a8-f8dee6479093","Type":"ContainerDied","Data":"c896cce10a34ab32d6c4a40a83310a0a12f463e7d0e5257b4a4ccf1f8f190f80"}
Jul 28 21:21:18.254783 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.254721    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg" event={"ID":"e2e8db3f-eb29-43c5-84a8-f8dee6479093","Type":"ContainerDied","Data":"ae9e8ed8d02db136416e63e6c0818e590f956172d91890dae32c313dd02bd3aa"}
Jul 28 21:21:18.254783 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.254743    2556 scope.go:117] "RemoveContainer" containerID="c896cce10a34ab32d6c4a40a83310a0a12f463e7d0e5257b4a4ccf1f8f190f80"
Jul 28 21:21:18.263300 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.263283    2556 scope.go:117] "RemoveContainer" containerID="309bf88293ef6bd4ddf104b82b05c8396c49b82934622ff19bb2cc2ee0b2785f"
Jul 28 21:21:18.272927 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.272845    2556 scope.go:117] "RemoveContainer" containerID="c896cce10a34ab32d6c4a40a83310a0a12f463e7d0e5257b4a4ccf1f8f190f80"
Jul 28 21:21:18.273406 ip-10-0-136-118 kubenswrapper[2556]: E0728 21:21:18.273385    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c896cce10a34ab32d6c4a40a83310a0a12f463e7d0e5257b4a4ccf1f8f190f80\": container with ID starting with c896cce10a34ab32d6c4a40a83310a0a12f463e7d0e5257b4a4ccf1f8f190f80 not found: ID does not exist" containerID="c896cce10a34ab32d6c4a40a83310a0a12f463e7d0e5257b4a4ccf1f8f190f80"
Jul 28 21:21:18.273460 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.273413    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c896cce10a34ab32d6c4a40a83310a0a12f463e7d0e5257b4a4ccf1f8f190f80"} err="failed to get container status \"c896cce10a34ab32d6c4a40a83310a0a12f463e7d0e5257b4a4ccf1f8f190f80\": rpc error: code = NotFound desc = could not find container \"c896cce10a34ab32d6c4a40a83310a0a12f463e7d0e5257b4a4ccf1f8f190f80\": container with ID starting with c896cce10a34ab32d6c4a40a83310a0a12f463e7d0e5257b4a4ccf1f8f190f80 not found: ID does not exist"
Jul 28 21:21:18.273460 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.273431    2556 scope.go:117] "RemoveContainer" containerID="309bf88293ef6bd4ddf104b82b05c8396c49b82934622ff19bb2cc2ee0b2785f"
Jul 28 21:21:18.273694 ip-10-0-136-118 kubenswrapper[2556]: E0728 21:21:18.273677    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"309bf88293ef6bd4ddf104b82b05c8396c49b82934622ff19bb2cc2ee0b2785f\": container with ID starting with 309bf88293ef6bd4ddf104b82b05c8396c49b82934622ff19bb2cc2ee0b2785f not found: ID does not exist" containerID="309bf88293ef6bd4ddf104b82b05c8396c49b82934622ff19bb2cc2ee0b2785f"
Jul 28 21:21:18.273751 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.273703    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"309bf88293ef6bd4ddf104b82b05c8396c49b82934622ff19bb2cc2ee0b2785f"} err="failed to get container status \"309bf88293ef6bd4ddf104b82b05c8396c49b82934622ff19bb2cc2ee0b2785f\": rpc error: code = NotFound desc = could not find container \"309bf88293ef6bd4ddf104b82b05c8396c49b82934622ff19bb2cc2ee0b2785f\": container with ID starting with 309bf88293ef6bd4ddf104b82b05c8396c49b82934622ff19bb2cc2ee0b2785f not found: ID does not exist"
Jul 28 21:21:18.281056 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.281033    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"]
Jul 28 21:21:18.287004 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.286984    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-590ada-openshift-default-5c8ffdc856-fkvrg"]
Jul 28 21:21:18.314293 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:18.314265    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2e8db3f-eb29-43c5-84a8-f8dee6479093" path="/var/lib/kubelet/pods/e2e8db3f-eb29-43c5-84a8-f8dee6479093/volumes"
Jul 28 21:21:24.561834 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:24.561803    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-96b3c5-8tdgl"]
Jul 28 21:21:24.568003 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:24.567976    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-96b3c5-8tdgl"]
Jul 28 21:21:26.312649 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:26.312615    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9f9e672-c9c5-45a3-963d-930b82e348bb" path="/var/lib/kubelet/pods/b9f9e672-c9c5-45a3-963d-930b82e348bb/volumes"
Jul 28 21:21:32.313416 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:32.313384    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4e7a7a-f2shk"]
Jul 28 21:21:32.313811 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:32.313690    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2e8db3f-eb29-43c5-84a8-f8dee6479093" containerName="istio-proxy"
Jul 28 21:21:32.313811 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:32.313700    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2e8db3f-eb29-43c5-84a8-f8dee6479093" containerName="istio-proxy"
Jul 28 21:21:32.313811 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:32.313722    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9f9e672-c9c5-45a3-963d-930b82e348bb" containerName="revoke-keys"
Jul 28 21:21:32.313811 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:32.313727    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9f9e672-c9c5-45a3-963d-930b82e348bb" containerName="revoke-keys"
Jul 28 21:21:32.313811 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:32.313776    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2e8db3f-eb29-43c5-84a8-f8dee6479093" containerName="istio-proxy"
Jul 28 21:21:32.313811 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:32.313785    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2e8db3f-eb29-43c5-84a8-f8dee6479093" containerName="istio-proxy"
Jul 28 21:21:32.313811 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:32.313791    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea76f54b-0a83-4be4-8a6f-a9e5be339e84" containerName="istio-proxy"
Jul 28 21:21:32.313811 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:32.313798    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9f9e672-c9c5-45a3-963d-930b82e348bb" containerName="revoke-keys"
Jul 28 21:21:32.316750 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:32.316735    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4e7a7a-f2shk"
Jul 28 21:21:32.321042 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:32.321018    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cxpsn\""
Jul 28 21:21:32.321243 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:32.321222    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 21:21:32.339191 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:32.339166    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4e7a7a-f2shk"]
Jul 28 21:21:32.476653 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:32.476608    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d1acd21-2077-49c0-b233-5833cd633051-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-4e7a7a-f2shk\" (UID: \"8d1acd21-2077-49c0-b233-5833cd633051\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4e7a7a-f2shk"
Jul 28 21:21:32.577135 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:32.577044    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d1acd21-2077-49c0-b233-5833cd633051-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-4e7a7a-f2shk\" (UID: \"8d1acd21-2077-49c0-b233-5833cd633051\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4e7a7a-f2shk"
Jul 28 21:21:32.577690 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:32.577673    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d1acd21-2077-49c0-b233-5833cd633051-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-4e7a7a-f2shk\" (UID: \"8d1acd21-2077-49c0-b233-5833cd633051\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4e7a7a-f2shk"
Jul 28 21:21:32.626488 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:32.626452    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4e7a7a-f2shk"
Jul 28 21:21:32.765913 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:32.765885    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4e7a7a-f2shk"]
Jul 28 21:21:32.768260 ip-10-0-136-118 kubenswrapper[2556]: W0728 21:21:32.768231    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d1acd21_2077_49c0_b233_5833cd633051.slice/crio-12d5d3519a2a7d2eb3443fde6742a2da5c5e78d9b24ea8f543236f2ad8693ed5 WatchSource:0}: Error finding container 12d5d3519a2a7d2eb3443fde6742a2da5c5e78d9b24ea8f543236f2ad8693ed5: Status 404 returned error can't find the container with id 12d5d3519a2a7d2eb3443fde6742a2da5c5e78d9b24ea8f543236f2ad8693ed5
Jul 28 21:21:33.327951 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:33.327918    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4e7a7a-f2shk" event={"ID":"8d1acd21-2077-49c0-b233-5833cd633051","Type":"ContainerStarted","Data":"b6e6cf8e8cd58b1e9e60c171db1b627e0b7a47343c4fd48c6a5781de5dd00c60"}
Jul 28 21:21:33.328397 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:33.327972    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4e7a7a-f2shk" event={"ID":"8d1acd21-2077-49c0-b233-5833cd633051","Type":"ContainerStarted","Data":"12d5d3519a2a7d2eb3443fde6742a2da5c5e78d9b24ea8f543236f2ad8693ed5"}
Jul 28 21:21:33.347708 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:33.347663    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4e7a7a-f2shk" podStartSLOduration=1.3476484260000001 podStartE2EDuration="1.347648426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 21:21:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:21:33.347077551 +0000 UTC m=+3377.566466437" watchObservedRunningTime="2026-07-28 21:21:33.347648426 +0000 UTC m=+3377.567037310"
Jul 28 21:21:34.333974 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:34.333940    2556 generic.go:356] "Generic (PLEG): container finished" podID="8d1acd21-2077-49c0-b233-5833cd633051" containerID="b6e6cf8e8cd58b1e9e60c171db1b627e0b7a47343c4fd48c6a5781de5dd00c60" exitCode=0
Jul 28 21:21:34.334366 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:34.334025    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4e7a7a-f2shk" event={"ID":"8d1acd21-2077-49c0-b233-5833cd633051","Type":"ContainerDied","Data":"b6e6cf8e8cd58b1e9e60c171db1b627e0b7a47343c4fd48c6a5781de5dd00c60"}
Jul 28 21:21:35.463779 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:35.463751    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4e7a7a-f2shk"
Jul 28 21:21:35.496246 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:35.496224    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d1acd21-2077-49c0-b233-5833cd633051-maas-api-service-ca\") pod \"8d1acd21-2077-49c0-b233-5833cd633051\" (UID: \"8d1acd21-2077-49c0-b233-5833cd633051\") "
Jul 28 21:21:35.496567 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:35.496547    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d1acd21-2077-49c0-b233-5833cd633051-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8d1acd21-2077-49c0-b233-5833cd633051" (UID: "8d1acd21-2077-49c0-b233-5833cd633051"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:21:35.596729 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:35.596671    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d1acd21-2077-49c0-b233-5833cd633051-maas-api-service-ca\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:21:36.343582 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:36.343556    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4e7a7a-f2shk"
Jul 28 21:21:36.343720 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:36.343578    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4e7a7a-f2shk" event={"ID":"8d1acd21-2077-49c0-b233-5833cd633051","Type":"ContainerDied","Data":"12d5d3519a2a7d2eb3443fde6742a2da5c5e78d9b24ea8f543236f2ad8693ed5"}
Jul 28 21:21:36.343720 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:36.343621    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12d5d3519a2a7d2eb3443fde6742a2da5c5e78d9b24ea8f543236f2ad8693ed5"
Jul 28 21:21:37.197100 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:37.197063    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4e7a7a-29754555-56pbj"]
Jul 28 21:21:37.204597 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:37.204571    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-4e7a7a-29754555-56pbj"]
Jul 28 21:21:37.462323 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:37.462241    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4e7a7a-f2shk"]
Jul 28 21:21:37.465412 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:37.465388    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4e7a7a-f2shk"]
Jul 28 21:21:38.312889 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:38.312858    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e368fa5-602a-45a6-b3a3-4a910ae4bd71" path="/var/lib/kubelet/pods/0e368fa5-602a-45a6-b3a3-4a910ae4bd71/volumes"
Jul 28 21:21:38.313249 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:38.313154    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d1acd21-2077-49c0-b233-5833cd633051" path="/var/lib/kubelet/pods/8d1acd21-2077-49c0-b233-5833cd633051/volumes"
Jul 28 21:21:45.302123 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:45.302088    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"]
Jul 28 21:21:45.302712 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:45.302365    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt" podUID="9538d827-7f46-43bb-913d-751f9921125b" containerName="istio-proxy" containerID="cri-o://ac52c39127d63efc9e26fe33e03e7b543adf2c29240f70b4a477886125386ed1" gracePeriod=30
Jul 28 21:21:50.565981 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:50.565955    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:21:50.618524 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:50.618456    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9538d827-7f46-43bb-913d-751f9921125b-istiod-ca-cert\") pod \"9538d827-7f46-43bb-913d-751f9921125b\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") "
Jul 28 21:21:50.618524 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:50.618488    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9538d827-7f46-43bb-913d-751f9921125b-istio-token\") pod \"9538d827-7f46-43bb-913d-751f9921125b\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") "
Jul 28 21:21:50.618524 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:50.618522    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-credential-socket\") pod \"9538d827-7f46-43bb-913d-751f9921125b\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") "
Jul 28 21:21:50.618768 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:50.618582    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9538d827-7f46-43bb-913d-751f9921125b-istio-podinfo\") pod \"9538d827-7f46-43bb-913d-751f9921125b\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") "
Jul 28 21:21:50.618768 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:50.618628    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-istio-data\") pod \"9538d827-7f46-43bb-913d-751f9921125b\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") "
Jul 28 21:21:50.618768 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:50.618646    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-workload-certs\") pod \"9538d827-7f46-43bb-913d-751f9921125b\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") "
Jul 28 21:21:50.618768 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:50.618662    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-workload-socket\") pod \"9538d827-7f46-43bb-913d-751f9921125b\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") "
Jul 28 21:21:50.618768 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:50.618682    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-istio-envoy\") pod \"9538d827-7f46-43bb-913d-751f9921125b\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") "
Jul 28 21:21:50.618768 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:50.618719    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxcc4\" (UniqueName: \"kubernetes.io/projected/9538d827-7f46-43bb-913d-751f9921125b-kube-api-access-kxcc4\") pod \"9538d827-7f46-43bb-913d-751f9921125b\" (UID: \"9538d827-7f46-43bb-913d-751f9921125b\") "
Jul 28 21:21:50.619078 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:50.618928    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9538d827-7f46-43bb-913d-751f9921125b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9538d827-7f46-43bb-913d-751f9921125b" (UID: "9538d827-7f46-43bb-913d-751f9921125b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 21:21:50.619078 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:50.619006    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9538d827-7f46-43bb-913d-751f9921125b" (UID: "9538d827-7f46-43bb-913d-751f9921125b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:21:50.619078 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:50.619043    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9538d827-7f46-43bb-913d-751f9921125b" (UID: "9538d827-7f46-43bb-913d-751f9921125b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:21:50.619309 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:50.619281    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9538d827-7f46-43bb-913d-751f9921125b" (UID: "9538d827-7f46-43bb-913d-751f9921125b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:21:50.619726 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:50.619705    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-istio-data" (OuterVolumeSpecName: "istio-data") pod "9538d827-7f46-43bb-913d-751f9921125b" (UID: "9538d827-7f46-43bb-913d-751f9921125b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:21:50.620842 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:50.620813    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9538d827-7f46-43bb-913d-751f9921125b-istio-token" (OuterVolumeSpecName: "istio-token") pod "9538d827-7f46-43bb-913d-751f9921125b" (UID: "9538d827-7f46-43bb-913d-751f9921125b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:21:50.620959 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:50.620899    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9538d827-7f46-43bb-913d-751f9921125b" (UID: "9538d827-7f46-43bb-913d-751f9921125b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 21:21:50.621144 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:50.621124    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9538d827-7f46-43bb-913d-751f9921125b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9538d827-7f46-43bb-913d-751f9921125b" (UID: "9538d827-7f46-43bb-913d-751f9921125b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 21:21:50.621208 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:50.621176    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9538d827-7f46-43bb-913d-751f9921125b-kube-api-access-kxcc4" (OuterVolumeSpecName: "kube-api-access-kxcc4") pod "9538d827-7f46-43bb-913d-751f9921125b" (UID: "9538d827-7f46-43bb-913d-751f9921125b"). InnerVolumeSpecName "kube-api-access-kxcc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 21:21:50.719589 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:50.719553    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9538d827-7f46-43bb-913d-751f9921125b-istio-podinfo\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:21:50.719589 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:50.719585    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-istio-data\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:21:50.719589 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:50.719594    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-workload-certs\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:21:50.719589 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:50.719602    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-workload-socket\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:21:50.719797 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:50.719611    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-istio-envoy\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:21:50.719797 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:50.719619    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxcc4\" (UniqueName: \"kubernetes.io/projected/9538d827-7f46-43bb-913d-751f9921125b-kube-api-access-kxcc4\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:21:50.719797 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:50.719628    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9538d827-7f46-43bb-913d-751f9921125b-istiod-ca-cert\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:21:50.719797 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:50.719636    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9538d827-7f46-43bb-913d-751f9921125b-istio-token\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:21:50.719797 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:50.719644    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9538d827-7f46-43bb-913d-751f9921125b-credential-socket\") on node \"ip-10-0-136-118.ec2.internal\" DevicePath \"\""
Jul 28 21:21:51.420842 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:51.420802    2556 generic.go:356] "Generic (PLEG): container finished" podID="9538d827-7f46-43bb-913d-751f9921125b" containerID="ac52c39127d63efc9e26fe33e03e7b543adf2c29240f70b4a477886125386ed1" exitCode=0
Jul 28 21:21:51.421015 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:51.420852    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"
Jul 28 21:21:51.421015 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:51.420883    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt" event={"ID":"9538d827-7f46-43bb-913d-751f9921125b","Type":"ContainerDied","Data":"ac52c39127d63efc9e26fe33e03e7b543adf2c29240f70b4a477886125386ed1"}
Jul 28 21:21:51.421015 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:51.420934    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt" event={"ID":"9538d827-7f46-43bb-913d-751f9921125b","Type":"ContainerDied","Data":"e0134fb3ddbb5ff97a8a6d6e187353db57d090bc762f5b6aec65b18c48a853a9"}
Jul 28 21:21:51.421015 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:51.420955    2556 scope.go:117] "RemoveContainer" containerID="ac52c39127d63efc9e26fe33e03e7b543adf2c29240f70b4a477886125386ed1"
Jul 28 21:21:51.430682 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:51.430663    2556 scope.go:117] "RemoveContainer" containerID="a3f2c482e8a77a25ec92a3d503f932f2fa7726c63f9fed18ae73997065c37f49"
Jul 28 21:21:51.438576 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:51.438559    2556 scope.go:117] "RemoveContainer" containerID="ac52c39127d63efc9e26fe33e03e7b543adf2c29240f70b4a477886125386ed1"
Jul 28 21:21:51.438818 ip-10-0-136-118 kubenswrapper[2556]: E0728 21:21:51.438799    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac52c39127d63efc9e26fe33e03e7b543adf2c29240f70b4a477886125386ed1\": container with ID starting with ac52c39127d63efc9e26fe33e03e7b543adf2c29240f70b4a477886125386ed1 not found: ID does not exist" containerID="ac52c39127d63efc9e26fe33e03e7b543adf2c29240f70b4a477886125386ed1"
Jul 28 21:21:51.438869 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:51.438827    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac52c39127d63efc9e26fe33e03e7b543adf2c29240f70b4a477886125386ed1"} err="failed to get container status \"ac52c39127d63efc9e26fe33e03e7b543adf2c29240f70b4a477886125386ed1\": rpc error: code = NotFound desc = could not find container \"ac52c39127d63efc9e26fe33e03e7b543adf2c29240f70b4a477886125386ed1\": container with ID starting with ac52c39127d63efc9e26fe33e03e7b543adf2c29240f70b4a477886125386ed1 not found: ID does not exist"
Jul 28 21:21:51.438869 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:51.438843    2556 scope.go:117] "RemoveContainer" containerID="a3f2c482e8a77a25ec92a3d503f932f2fa7726c63f9fed18ae73997065c37f49"
Jul 28 21:21:51.439060 ip-10-0-136-118 kubenswrapper[2556]: E0728 21:21:51.439041    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3f2c482e8a77a25ec92a3d503f932f2fa7726c63f9fed18ae73997065c37f49\": container with ID starting with a3f2c482e8a77a25ec92a3d503f932f2fa7726c63f9fed18ae73997065c37f49 not found: ID does not exist" containerID="a3f2c482e8a77a25ec92a3d503f932f2fa7726c63f9fed18ae73997065c37f49"
Jul 28 21:21:51.439114 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:51.439069    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3f2c482e8a77a25ec92a3d503f932f2fa7726c63f9fed18ae73997065c37f49"} err="failed to get container status \"a3f2c482e8a77a25ec92a3d503f932f2fa7726c63f9fed18ae73997065c37f49\": rpc error: code = NotFound desc = could not find container \"a3f2c482e8a77a25ec92a3d503f932f2fa7726c63f9fed18ae73997065c37f49\": container with ID starting with a3f2c482e8a77a25ec92a3d503f932f2fa7726c63f9fed18ae73997065c37f49 not found: ID does not exist"
Jul 28 21:21:51.455639 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:51.455612    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"]
Jul 28 21:21:51.458243 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:51.458217    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-4e7a7a-openshift-default-79c48d6c7b-dmqxt"]
Jul 28 21:21:52.313055 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:52.313024    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9538d827-7f46-43bb-913d-751f9921125b" path="/var/lib/kubelet/pods/9538d827-7f46-43bb-913d-751f9921125b/volumes"
Jul 28 21:21:52.649417 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:52.649330    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56794f8cc8-66phd_48ba4dcd-704d-4c9f-9462-a105f9e330e8/copy-manifests/0.log"
Jul 28 21:21:52.661754 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:52.661734    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56794f8cc8-66phd_48ba4dcd-704d-4c9f-9462-a105f9e330e8/manager/0.log"
Jul 28 21:21:53.761707 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:53.761676    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754555-z449x_d77bdf6c-f65a-4bbf-bb09-c02f7cdb05bf/cleanup/0.log"
Jul 28 21:21:56.767019 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:56.766992    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-6t45r_611c7c97-fef9-4a19-90fc-7977d1410ca0/discovery/0.log"
Jul 28 21:21:57.021143 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:57.021059    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d6cc5795b-kvhql_989d2fe6-53ba-48a5-b571-2aa024fa5384/kube-auth-proxy/0.log"
Jul 28 21:21:58.027978 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:21:58.027949    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-cwwp6_70ff8c0a-b860-4a20-a962-8d6b7a2e16f9/main/0.log"
Jul 28 21:22:08.238591 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:08.238512    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vg2dj_57cc3100-f7ce-4374-ae22-73b79eb8db6a/global-pull-secret-syncer/0.log"
Jul 28 21:22:08.447212 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:08.447183    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nzzb2_7c198bb1-4a1e-4292-ab80-8d7a2560e1d0/konnectivity-agent/0.log"
Jul 28 21:22:08.481308 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:08.481281    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-118.ec2.internal_6f550312f83763fae04905f9587ee14d/haproxy/0.log"
Jul 28 21:22:15.519047 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:15.518997    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba3b98f6-76d6-45ea-9f20-477d846b277a/alertmanager/0.log"
Jul 28 21:22:15.551944 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:15.551915    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba3b98f6-76d6-45ea-9f20-477d846b277a/config-reloader/0.log"
Jul 28 21:22:15.580896 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:15.580872    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba3b98f6-76d6-45ea-9f20-477d846b277a/kube-rbac-proxy-web/0.log"
Jul 28 21:22:15.604233 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:15.604205    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba3b98f6-76d6-45ea-9f20-477d846b277a/kube-rbac-proxy/0.log"
Jul 28 21:22:15.639756 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:15.639730    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba3b98f6-76d6-45ea-9f20-477d846b277a/kube-rbac-proxy-metric/0.log"
Jul 28 21:22:15.666095 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:15.666068    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba3b98f6-76d6-45ea-9f20-477d846b277a/prom-label-proxy/0.log"
Jul 28 21:22:15.694384 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:15.694307    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba3b98f6-76d6-45ea-9f20-477d846b277a/init-config-reloader/0.log"
Jul 28 21:22:15.883411 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:15.883381    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-x6kqb_38317c49-b1d3-4f74-a662-f2844ed25d02/monitoring-plugin/0.log"
Jul 28 21:22:15.923677 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:15.923643    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2nn72_0b969541-d385-4066-8ee1-828c8d0061a9/node-exporter/0.log"
Jul 28 21:22:15.947680 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:15.947612    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2nn72_0b969541-d385-4066-8ee1-828c8d0061a9/kube-rbac-proxy/0.log"
Jul 28 21:22:15.970436 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:15.970407    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2nn72_0b969541-d385-4066-8ee1-828c8d0061a9/init-textfile/0.log"
Jul 28 21:22:16.203690 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:16.203610    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-f6grl_aa1dc898-d392-4ddc-bd75-99a262d99768/kube-rbac-proxy-main/0.log"
Jul 28 21:22:16.230041 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:16.230011    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-f6grl_aa1dc898-d392-4ddc-bd75-99a262d99768/kube-rbac-proxy-self/0.log"
Jul 28 21:22:16.255015 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:16.254992    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-f6grl_aa1dc898-d392-4ddc-bd75-99a262d99768/openshift-state-metrics/0.log"
Jul 28 21:22:16.300622 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:16.300587    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca/prometheus/0.log"
Jul 28 21:22:16.327366 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:16.327321    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca/config-reloader/0.log"
Jul 28 21:22:16.350068 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:16.350043    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca/thanos-sidecar/0.log"
Jul 28 21:22:16.373654 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:16.373630    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca/kube-rbac-proxy-web/0.log"
Jul 28 21:22:16.401208 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:16.401180    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca/kube-rbac-proxy/0.log"
Jul 28 21:22:16.426646 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:16.426625    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca/kube-rbac-proxy-thanos/0.log"
Jul 28 21:22:16.455052 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:16.454968    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3ed0f2d0-7bf7-4a7e-936d-9968dea6f6ca/init-config-reloader/0.log"
Jul 28 21:22:16.484215 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:16.484186    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-lgrjh_94fe3867-767d-4ec5-884d-4ec1a95ed009/prometheus-operator/0.log"
Jul 28 21:22:16.511225 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:16.511198    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-lgrjh_94fe3867-767d-4ec5-884d-4ec1a95ed009/kube-rbac-proxy/0.log"
Jul 28 21:22:16.545799 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:16.545774    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-tdc8t_9bce3dda-9996-47be-b976-f1e5e91d5e00/prometheus-operator-admission-webhook/0.log"
Jul 28 21:22:16.576992 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:16.576966    2556 scope.go:117] "RemoveContainer" containerID="c7e1df474073fd6793d3cd872d5e7e45fb4fedb7352379af475109b39c957735"
Jul 28 21:22:16.672081 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:16.672033    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-668d64b687-bvpl9_cdac1ff8-87d8-4d02-97e1-fbf74ea2e163/thanos-query/0.log"
Jul 28 21:22:16.697192 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:16.697165    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-668d64b687-bvpl9_cdac1ff8-87d8-4d02-97e1-fbf74ea2e163/kube-rbac-proxy-web/0.log"
Jul 28 21:22:16.723064 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:16.722993    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-668d64b687-bvpl9_cdac1ff8-87d8-4d02-97e1-fbf74ea2e163/kube-rbac-proxy/0.log"
Jul 28 21:22:16.754953 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:16.754928    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-668d64b687-bvpl9_cdac1ff8-87d8-4d02-97e1-fbf74ea2e163/prom-label-proxy/0.log"
Jul 28 21:22:16.805679 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:16.805653    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-668d64b687-bvpl9_cdac1ff8-87d8-4d02-97e1-fbf74ea2e163/kube-rbac-proxy-rules/0.log"
Jul 28 21:22:16.841578 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:16.841554    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-668d64b687-bvpl9_cdac1ff8-87d8-4d02-97e1-fbf74ea2e163/kube-rbac-proxy-metrics/0.log"
Jul 28 21:22:17.990559 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:17.990526    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hqh9t/perf-node-gather-daemonset-nmnct"]
Jul 28 21:22:17.991038 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:17.991016    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9538d827-7f46-43bb-913d-751f9921125b" containerName="istio-proxy"
Jul 28 21:22:17.991038 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:17.991033    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9538d827-7f46-43bb-913d-751f9921125b" containerName="istio-proxy"
Jul 28 21:22:17.991160 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:17.991053    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2e8db3f-eb29-43c5-84a8-f8dee6479093" containerName="istio-proxy"
Jul 28 21:22:17.991160 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:17.991062    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2e8db3f-eb29-43c5-84a8-f8dee6479093" containerName="istio-proxy"
Jul 28 21:22:17.991160 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:17.991079    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9538d827-7f46-43bb-913d-751f9921125b" containerName="istio-proxy"
Jul 28 21:22:17.991160 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:17.991089    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9538d827-7f46-43bb-913d-751f9921125b" containerName="istio-proxy"
Jul 28 21:22:17.991160 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:17.991102    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d1acd21-2077-49c0-b233-5833cd633051" containerName="revoke-keys"
Jul 28 21:22:17.991160 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:17.991112    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d1acd21-2077-49c0-b233-5833cd633051" containerName="revoke-keys"
Jul 28 21:22:17.991491 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:17.991190    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d1acd21-2077-49c0-b233-5833cd633051" containerName="revoke-keys"
Jul 28 21:22:17.991491 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:17.991203    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9538d827-7f46-43bb-913d-751f9921125b" containerName="istio-proxy"
Jul 28 21:22:17.991491 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:17.991212    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9538d827-7f46-43bb-913d-751f9921125b" containerName="istio-proxy"
Jul 28 21:22:17.996101 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:17.996079    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-nmnct"
Jul 28 21:22:17.999388 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:17.999360    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hqh9t\"/\"kube-root-ca.crt\""
Jul 28 21:22:17.999495 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:17.999441    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hqh9t\"/\"default-dockercfg-7vqqt\""
Jul 28 21:22:18.000362 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:18.000328    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hqh9t\"/\"openshift-service-ca.crt\""
Jul 28 21:22:18.005303 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:18.005281    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hqh9t/perf-node-gather-daemonset-nmnct"]
Jul 28 21:22:18.152303 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:18.152268    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jftch\" (UniqueName: \"kubernetes.io/projected/90a4cdfd-3bd3-4173-88b4-89f682f5c506-kube-api-access-jftch\") pod \"perf-node-gather-daemonset-nmnct\" (UID: \"90a4cdfd-3bd3-4173-88b4-89f682f5c506\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-nmnct"
Jul 28 21:22:18.152303 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:18.152306    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/90a4cdfd-3bd3-4173-88b4-89f682f5c506-podres\") pod \"perf-node-gather-daemonset-nmnct\" (UID: \"90a4cdfd-3bd3-4173-88b4-89f682f5c506\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-nmnct"
Jul 28 21:22:18.152544 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:18.152410    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90a4cdfd-3bd3-4173-88b4-89f682f5c506-sys\") pod \"perf-node-gather-daemonset-nmnct\" (UID: \"90a4cdfd-3bd3-4173-88b4-89f682f5c506\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-nmnct"
Jul 28 21:22:18.152544 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:18.152444    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90a4cdfd-3bd3-4173-88b4-89f682f5c506-lib-modules\") pod \"perf-node-gather-daemonset-nmnct\" (UID: \"90a4cdfd-3bd3-4173-88b4-89f682f5c506\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-nmnct"
Jul 28 21:22:18.152544 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:18.152477    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/90a4cdfd-3bd3-4173-88b4-89f682f5c506-proc\") pod \"perf-node-gather-daemonset-nmnct\" (UID: \"90a4cdfd-3bd3-4173-88b4-89f682f5c506\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-nmnct"
Jul 28 21:22:18.253812 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:18.253726    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/90a4cdfd-3bd3-4173-88b4-89f682f5c506-proc\") pod \"perf-node-gather-daemonset-nmnct\" (UID: \"90a4cdfd-3bd3-4173-88b4-89f682f5c506\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-nmnct"
Jul 28 21:22:18.253812 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:18.253779    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jftch\" (UniqueName: \"kubernetes.io/projected/90a4cdfd-3bd3-4173-88b4-89f682f5c506-kube-api-access-jftch\") pod \"perf-node-gather-daemonset-nmnct\" (UID: \"90a4cdfd-3bd3-4173-88b4-89f682f5c506\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-nmnct"
Jul 28 21:22:18.254015 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:18.253856    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/90a4cdfd-3bd3-4173-88b4-89f682f5c506-proc\") pod \"perf-node-gather-daemonset-nmnct\" (UID: \"90a4cdfd-3bd3-4173-88b4-89f682f5c506\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-nmnct"
Jul 28 21:22:18.254015 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:18.253891    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/90a4cdfd-3bd3-4173-88b4-89f682f5c506-podres\") pod \"perf-node-gather-daemonset-nmnct\" (UID: \"90a4cdfd-3bd3-4173-88b4-89f682f5c506\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-nmnct"
Jul 28 21:22:18.254015 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:18.253969    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90a4cdfd-3bd3-4173-88b4-89f682f5c506-sys\") pod \"perf-node-gather-daemonset-nmnct\" (UID: \"90a4cdfd-3bd3-4173-88b4-89f682f5c506\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-nmnct"
Jul 28 21:22:18.254015 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:18.253999    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90a4cdfd-3bd3-4173-88b4-89f682f5c506-lib-modules\") pod \"perf-node-gather-daemonset-nmnct\" (UID: \"90a4cdfd-3bd3-4173-88b4-89f682f5c506\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-nmnct"
Jul 28 21:22:18.254164 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:18.254012    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/90a4cdfd-3bd3-4173-88b4-89f682f5c506-podres\") pod \"perf-node-gather-daemonset-nmnct\" (UID: \"90a4cdfd-3bd3-4173-88b4-89f682f5c506\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-nmnct"
Jul 28 21:22:18.254164 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:18.254070    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90a4cdfd-3bd3-4173-88b4-89f682f5c506-sys\") pod \"perf-node-gather-daemonset-nmnct\" (UID: \"90a4cdfd-3bd3-4173-88b4-89f682f5c506\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-nmnct"
Jul 28 21:22:18.254164 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:18.254105    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90a4cdfd-3bd3-4173-88b4-89f682f5c506-lib-modules\") pod \"perf-node-gather-daemonset-nmnct\" (UID: \"90a4cdfd-3bd3-4173-88b4-89f682f5c506\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-nmnct"
Jul 28 21:22:18.262519 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:18.262500    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jftch\" (UniqueName: \"kubernetes.io/projected/90a4cdfd-3bd3-4173-88b4-89f682f5c506-kube-api-access-jftch\") pod \"perf-node-gather-daemonset-nmnct\" (UID: \"90a4cdfd-3bd3-4173-88b4-89f682f5c506\") " pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-nmnct"
Jul 28 21:22:18.306597 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:18.306556    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-nmnct"
Jul 28 21:22:18.439186 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:18.439161    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hqh9t/perf-node-gather-daemonset-nmnct"]
Jul 28 21:22:18.441232 ip-10-0-136-118 kubenswrapper[2556]: W0728 21:22:18.441208    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod90a4cdfd_3bd3_4173_88b4_89f682f5c506.slice/crio-cb6749f2b2e7d10a461a748255d85234ba7c56d387fc03418aabaacbf6f5b2a4 WatchSource:0}: Error finding container cb6749f2b2e7d10a461a748255d85234ba7c56d387fc03418aabaacbf6f5b2a4: Status 404 returned error can't find the container with id cb6749f2b2e7d10a461a748255d85234ba7c56d387fc03418aabaacbf6f5b2a4
Jul 28 21:22:18.547426 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:18.547393    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-nmnct" event={"ID":"90a4cdfd-3bd3-4173-88b4-89f682f5c506","Type":"ContainerStarted","Data":"cb6749f2b2e7d10a461a748255d85234ba7c56d387fc03418aabaacbf6f5b2a4"}
Jul 28 21:22:19.554300 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:19.554261    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-nmnct" event={"ID":"90a4cdfd-3bd3-4173-88b4-89f682f5c506","Type":"ContainerStarted","Data":"8466d21347adc75fdb3765c1562f38cbd3ab3c8c7c3bf2bed6b453394c529dc9"}
Jul 28 21:22:19.554710 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:19.554389    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-nmnct"
Jul 28 21:22:21.307606 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:21.307548    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sqfxj_4bc5bd36-13ec-423b-aa68-678576b19935/dns/0.log"
Jul 28 21:22:21.353278 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:21.353252    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sqfxj_4bc5bd36-13ec-423b-aa68-678576b19935/kube-rbac-proxy/0.log"
Jul 28 21:22:21.553757 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:21.553722    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bdgqd_780efb8a-2479-40d2-84d3-ff6e99a90d36/dns-node-resolver/0.log"
Jul 28 21:22:22.378551 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:22.378521    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g6f47_fa72c226-5d99-455b-a62e-5a6cb0082abc/node-ca/0.log"
Jul 28 21:22:23.665323 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:23.665285    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-6t45r_611c7c97-fef9-4a19-90fc-7977d1410ca0/discovery/0.log"
Jul 28 21:22:23.749205 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:23.749174    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d6cc5795b-kvhql_989d2fe6-53ba-48a5-b571-2aa024fa5384/kube-auth-proxy/0.log"
Jul 28 21:22:25.073079 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:25.073050    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jfw94_4763f7ae-9a72-4b99-8cca-2560cb34a4ba/serve-healthcheck-canary/0.log"
Jul 28 21:22:25.569064 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:25.569036    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-nmnct"
Jul 28 21:22:25.610504 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:25.610458    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hqh9t/perf-node-gather-daemonset-nmnct" podStartSLOduration=8.610443207 podStartE2EDuration="8.610443207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 21:22:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 21:22:19.576514735 +0000 UTC m=+3423.795903619" watchObservedRunningTime="2026-07-28 21:22:25.610443207 +0000 UTC m=+3429.829832093"
Jul 28 21:22:25.842216 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:25.842128    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mcb5x_cc92053b-0c0e-42f3-988f-4e3b612e8d4a/kube-rbac-proxy/0.log"
Jul 28 21:22:25.885279 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:25.885249    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mcb5x_cc92053b-0c0e-42f3-988f-4e3b612e8d4a/exporter/0.log"
Jul 28 21:22:25.950081 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:25.950042    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mcb5x_cc92053b-0c0e-42f3-988f-4e3b612e8d4a/extractor/0.log"
Jul 28 21:22:29.234294 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:29.234263    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-6t45r_611c7c97-fef9-4a19-90fc-7977d1410ca0/discovery/0.log"
Jul 28 21:22:29.269961 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:29.269929    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d6cc5795b-kvhql_989d2fe6-53ba-48a5-b571-2aa024fa5384/kube-auth-proxy/0.log"
Jul 28 21:22:29.420375 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:29.420335    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56794f8cc8-66phd_48ba4dcd-704d-4c9f-9462-a105f9e330e8/manager/0.log"
Jul 28 21:22:29.448314 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:29.448241    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56794f8cc8-66phd_48ba4dcd-704d-4c9f-9462-a105f9e330e8/copy-manifests/0.log"
Jul 28 21:22:30.938630 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:30.938602    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-6t45r_611c7c97-fef9-4a19-90fc-7977d1410ca0/discovery/0.log"
Jul 28 21:22:30.941007 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:30.940987    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-54dcc5fbb6-j68vq_9e805fbc-5abd-481f-be38-1c38aedb1575/manager/0.log"
Jul 28 21:22:30.977027 ip-10-0-136-118 kubenswrapper[2556]: I0728 21:22:30.976996    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d6cc5795b-kvhql_989d2fe6-53ba-48a5-b571-2aa024fa5384/kube-auth-proxy/0.log"