Jul 21 20:14:08.948975 ip-10-0-128-201 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 20:14:09.325620 ip-10-0-128-201 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 20:14:09.325620 ip-10-0-128-201 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 20:14:09.325620 ip-10-0-128-201 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 20:14:09.325620 ip-10-0-128-201 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 20:14:09.325620 ip-10-0-128-201 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 20:14:09.327403 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.327176    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 20:14:09.428140 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331301    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 20:14:09.428140 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331315    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 20:14:09.428140 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331319    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 20:14:09.428140 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331322    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 20:14:09.428140 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331325    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 20:14:09.428140 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331328    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 20:14:09.428140 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331330    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 20:14:09.428140 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331333    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 20:14:09.428140 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331336    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 20:14:09.428140 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331338    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 20:14:09.428140 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331348    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 20:14:09.428140 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331352    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 20:14:09.428140 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331354    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 20:14:09.428140 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331357    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 20:14:09.428140 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331361    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 20:14:09.428140 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331364    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 20:14:09.428140 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331367    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 20:14:09.428140 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331370    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 20:14:09.428140 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331373    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 20:14:09.428140 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331376    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 20:14:09.403750 ip-10-0-128-201 systemd[1]: Started Kubernetes Kubelet.
Jul 21 20:14:09.429384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331378    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 20:14:09.429384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331381    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 20:14:09.429384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331383    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 20:14:09.429384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331386    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 20:14:09.429384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331388    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 20:14:09.429384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331391    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 20:14:09.429384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331394    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 20:14:09.429384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331397    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 20:14:09.429384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331399    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 20:14:09.429384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331402    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 20:14:09.429384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331405    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 20:14:09.429384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331408    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 20:14:09.429384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331411    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 20:14:09.429384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331414    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 20:14:09.429384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331416    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 20:14:09.429384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331419    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 20:14:09.429384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331422    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 20:14:09.429384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331425    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 20:14:09.429384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331427    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 20:14:09.429384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331430    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 20:14:09.430362 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331433    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 20:14:09.430362 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331436    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 20:14:09.430362 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331439    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 20:14:09.430362 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331444    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 20:14:09.430362 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331448    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 20:14:09.430362 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331451    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 20:14:09.430362 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331453    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 20:14:09.430362 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331456    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 20:14:09.430362 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331459    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 20:14:09.430362 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331461    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 20:14:09.430362 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331464    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 20:14:09.430362 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331468    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 20:14:09.430362 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331472    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 20:14:09.430362 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331475    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 20:14:09.430362 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331478    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 20:14:09.430362 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331481    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 20:14:09.430362 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331484    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 20:14:09.430362 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331486    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 20:14:09.430362 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331489    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 20:14:09.431381 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331491    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 20:14:09.431381 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331494    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 20:14:09.431381 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331496    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 20:14:09.431381 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331500    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 20:14:09.431381 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331504    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 20:14:09.431381 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331507    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 20:14:09.431381 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331510    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 20:14:09.431381 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331512    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 20:14:09.431381 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331515    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 20:14:09.431381 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331518    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 20:14:09.431381 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331520    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 20:14:09.431381 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331524    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 20:14:09.431381 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331526    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 20:14:09.431381 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331529    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 20:14:09.431381 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331531    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 20:14:09.431381 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331535    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 20:14:09.431381 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331538    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 20:14:09.431381 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331541    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 20:14:09.431381 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331543    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 20:14:09.432227 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331547    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 20:14:09.432227 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331549    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 20:14:09.432227 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331552    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 20:14:09.432227 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331555    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 20:14:09.432227 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331557    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 20:14:09.432227 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331560    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 20:14:09.432227 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331563    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 20:14:09.432227 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331565    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 20:14:09.432227 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331568    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 20:14:09.432227 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331570    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 20:14:09.432227 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331573    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 20:14:09.432227 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331575    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 20:14:09.432227 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331578    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 20:14:09.432227 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331580    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 20:14:09.432227 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331583    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 20:14:09.432227 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331585    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 20:14:09.432227 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331588    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 20:14:09.432227 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331591    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 20:14:09.432227 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331593    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 20:14:09.432227 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331596    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 20:14:09.433461 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.331598    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 20:14:09.433461 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332365    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 20:14:09.433461 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332372    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 20:14:09.433461 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332375    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 20:14:09.433461 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332378    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 20:14:09.433461 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332381    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 20:14:09.433461 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332384    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 20:14:09.433461 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332387    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 20:14:09.433461 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332391    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 20:14:09.433461 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332393    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 20:14:09.433461 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332397    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 20:14:09.433461 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332399    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 20:14:09.433461 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332402    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 20:14:09.433461 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332405    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 20:14:09.433461 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332407    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 20:14:09.433461 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332410    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 20:14:09.433461 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332412    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 20:14:09.433461 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332415    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 20:14:09.433461 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332417    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 20:14:09.433461 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332420    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 20:14:09.434483 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332422    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 20:14:09.434483 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332425    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 20:14:09.434483 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332428    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 20:14:09.434483 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332431    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 20:14:09.434483 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332434    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 20:14:09.434483 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332436    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 20:14:09.434483 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332439    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 20:14:09.434483 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332442    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 20:14:09.434483 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332444    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 20:14:09.434483 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332449    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 20:14:09.434483 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332452    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 20:14:09.434483 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332455    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 20:14:09.434483 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332458    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 20:14:09.434483 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332461    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 20:14:09.434483 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332465    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 20:14:09.434483 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332468    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 20:14:09.434483 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332471    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 20:14:09.434483 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332474    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 20:14:09.434483 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332477    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 20:14:09.435719 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332480    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 20:14:09.435719 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332483    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 20:14:09.435719 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332486    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 20:14:09.435719 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332489    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 20:14:09.435719 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332492    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 20:14:09.435719 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332495    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 20:14:09.435719 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332498    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 20:14:09.435719 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332501    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 20:14:09.435719 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332504    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 20:14:09.435719 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332506    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 20:14:09.435719 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332509    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 20:14:09.435719 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332512    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 20:14:09.435719 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332514    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 20:14:09.435719 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332517    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 20:14:09.435719 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332520    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 20:14:09.435719 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332522    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 20:14:09.435719 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332525    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 20:14:09.435719 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332527    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 20:14:09.435719 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332530    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 20:14:09.435719 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332533    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 20:14:09.436525 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332535    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 20:14:09.436525 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332538    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 20:14:09.436525 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332540    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 20:14:09.436525 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332543    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 20:14:09.436525 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332546    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 20:14:09.436525 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332548    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 20:14:09.436525 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332551    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 20:14:09.436525 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332554    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 20:14:09.436525 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332557    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 20:14:09.436525 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332561    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 20:14:09.436525 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332565    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 20:14:09.436525 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332568    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 20:14:09.436525 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332571    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 20:14:09.436525 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332574    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 20:14:09.436525 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332577    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 20:14:09.436525 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332579    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 20:14:09.436525 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332583    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 20:14:09.436525 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332586    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 20:14:09.436525 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332589    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 20:14:09.437384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332591    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 20:14:09.437384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332594    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 20:14:09.437384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332597    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 20:14:09.437384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332600    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 20:14:09.437384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332603    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 20:14:09.437384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332605    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 20:14:09.437384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332608    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 20:14:09.437384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332610    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 20:14:09.437384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332613    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 20:14:09.437384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332616    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 20:14:09.437384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332618    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 20:14:09.437384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332620    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 20:14:09.437384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332624    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 20:14:09.437384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332627    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 20:14:09.437384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332630    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 20:14:09.437384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332632    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 20:14:09.437384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332635    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 20:14:09.437384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332637    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 20:14:09.437384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332640    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 20:14:09.437384 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332643    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 20:14:09.438413 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332646    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 20:14:09.438413 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.332649    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 20:14:09.438413 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333040    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 20:14:09.438413 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333045    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 20:14:09.438413 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333048    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 20:14:09.438413 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333051    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 20:14:09.438413 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333054    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 20:14:09.438413 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333057    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 20:14:09.438413 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333060    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 20:14:09.438413 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333063    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 20:14:09.438413 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333066    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 20:14:09.438413 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333069    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 20:14:09.438413 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333071    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 20:14:09.438413 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333074    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 20:14:09.438413 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333077    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 20:14:09.438413 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333079    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 20:14:09.438413 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333082    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 20:14:09.438413 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333084    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 20:14:09.438413 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333087    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 20:14:09.438413 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333089    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 20:14:09.439469 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333092    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 20:14:09.439469 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333095    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 20:14:09.439469 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333098    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 20:14:09.439469 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333100    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 20:14:09.439469 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333103    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 20:14:09.439469 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333106    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 20:14:09.439469 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333109    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 20:14:09.439469 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333112    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 20:14:09.439469 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333114    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 20:14:09.439469 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333117    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 20:14:09.439469 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333120    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 20:14:09.439469 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333123    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 20:14:09.439469 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333126    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 20:14:09.439469 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333128    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 20:14:09.439469 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333131    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 20:14:09.439469 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333134    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 20:14:09.439469 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333137    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 20:14:09.439469 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333140    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 20:14:09.439469 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333142    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 20:14:09.439469 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333145    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 20:14:09.440332 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333148    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 20:14:09.440332 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333152    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 20:14:09.440332 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333156    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 20:14:09.440332 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333160    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 20:14:09.440332 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333169    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 20:14:09.440332 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333172    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 20:14:09.440332 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333174    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 20:14:09.440332 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333177    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 20:14:09.440332 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333180    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 20:14:09.440332 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333183    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 20:14:09.440332 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333185    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 20:14:09.440332 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333188    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 20:14:09.440332 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333191    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 20:14:09.440332 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333194    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 20:14:09.440332 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333196    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 20:14:09.440332 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333199    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 20:14:09.440332 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333202    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 20:14:09.440332 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333204    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 20:14:09.440332 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333207    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 20:14:09.441674 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333209    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 20:14:09.441674 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333212    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 20:14:09.441674 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333215    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 20:14:09.441674 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333217    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 20:14:09.441674 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333220    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 20:14:09.441674 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333224    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 20:14:09.441674 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333227    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 20:14:09.441674 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333230    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 20:14:09.441674 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333233    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 20:14:09.441674 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333236    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 20:14:09.441674 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333239    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 20:14:09.441674 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333241    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 20:14:09.441674 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333244    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 20:14:09.441674 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333247    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 20:14:09.441674 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333250    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 20:14:09.441674 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333252    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 20:14:09.441674 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333255    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 20:14:09.441674 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333260    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 20:14:09.441674 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333262    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 20:14:09.442971 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333265    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 20:14:09.442971 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333267    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 20:14:09.442971 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333270    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 20:14:09.442971 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333272    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 20:14:09.442971 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333275    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 20:14:09.442971 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333281    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 20:14:09.442971 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333284    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 20:14:09.442971 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333287    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 20:14:09.442971 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333289    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 20:14:09.442971 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333292    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 20:14:09.442971 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333294    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 20:14:09.442971 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333297    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 20:14:09.442971 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333300    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 20:14:09.442971 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333302    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 20:14:09.442971 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333305    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 20:14:09.442971 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333307    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 20:14:09.442971 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333310    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 20:14:09.442971 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333313    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 20:14:09.442971 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333315    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 20:14:09.442971 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333318    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 20:14:09.444254 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333321    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 20:14:09.444254 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333325    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 20:14:09.444254 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.333328    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 20:14:09.444254 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333404    2576 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 20:14:09.444254 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333414    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 20:14:09.444254 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333424    2576 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 20:14:09.444254 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333430    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 20:14:09.444254 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333436    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 20:14:09.444254 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333440    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 20:14:09.444254 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333445    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 20:14:09.444254 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333451    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 20:14:09.444254 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333466    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 20:14:09.444254 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333470    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 20:14:09.444254 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333474    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 20:14:09.444254 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333477    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 20:14:09.444254 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333480    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 20:14:09.444254 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333483    2576 flags.go:64] FLAG: --cgroup-root=""
Jul 21 20:14:09.444254 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333487    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 20:14:09.444254 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333490    2576 flags.go:64] FLAG: --client-ca-file=""
Jul 21 20:14:09.444254 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333493    2576 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 20:14:09.444254 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333496    2576 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 20:14:09.444254 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333502    2576 flags.go:64] FLAG: --cluster-domain=""
Jul 21 20:14:09.444254 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333505    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 20:14:09.445319 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333508    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 20:14:09.445319 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333511    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 20:14:09.445319 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333515    2576 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 20:14:09.445319 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333523    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 20:14:09.445319 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333526    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 20:14:09.445319 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333529    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 20:14:09.445319 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333533    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 20:14:09.445319 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333536    2576 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 20:14:09.445319 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333539    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 20:14:09.445319 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333542    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 20:14:09.445319 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333545    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 20:14:09.445319 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333548    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 20:14:09.445319 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333553    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 20:14:09.445319 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333556    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 20:14:09.445319 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333559    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 20:14:09.445319 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333562    2576 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 20:14:09.445319 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333565    2576 flags.go:64] FLAG: --enable-server="true"
Jul 21 20:14:09.445319 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333568    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 20:14:09.445319 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333572    2576 flags.go:64] FLAG: --event-burst="100"
Jul 21 20:14:09.445319 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333577    2576 flags.go:64] FLAG: --event-qps="50"
Jul 21 20:14:09.445319 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333580    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 20:14:09.445319 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333583    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 20:14:09.445319 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333587    2576 flags.go:64] FLAG: --eviction-hard=""
Jul 21 20:14:09.445319 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333590    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 20:14:09.446179 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333593    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 20:14:09.446179 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333596    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 20:14:09.446179 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333601    2576 flags.go:64] FLAG: --eviction-soft=""
Jul 21 20:14:09.446179 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333604    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 20:14:09.446179 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333607    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 20:14:09.446179 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333610    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 20:14:09.446179 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333613    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 20:14:09.446179 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333616    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 20:14:09.446179 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333619    2576 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 20:14:09.446179 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333622    2576 flags.go:64] FLAG: --feature-gates=""
Jul 21 20:14:09.446179 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333626    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 20:14:09.446179 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333629    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 20:14:09.446179 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333633    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 20:14:09.446179 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333637    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 20:14:09.446179 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333640    2576 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 20:14:09.446179 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333643    2576 flags.go:64] FLAG: --help="false"
Jul 21 20:14:09.446179 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333646    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-128-201.ec2.internal"
Jul 21 20:14:09.446179 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333650    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 20:14:09.446179 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333652    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 20:14:09.446179 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333655    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 20:14:09.446179 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333659    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 20:14:09.446179 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333662    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 20:14:09.446179 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333665    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 20:14:09.446179 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333668    2576 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 20:14:09.447064 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333671    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 20:14:09.447064 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333674    2576 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 20:14:09.447064 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333676    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 20:14:09.447064 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333681    2576 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 20:14:09.447064 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333684    2576 flags.go:64] FLAG: --kube-reserved=""
Jul 21 20:14:09.447064 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333704    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 20:14:09.447064 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333709    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 20:14:09.447064 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333714    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 20:14:09.447064 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333718    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 20:14:09.447064 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333721    2576 flags.go:64] FLAG: --lock-file=""
Jul 21 20:14:09.447064 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333725    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 20:14:09.447064 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333728    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 20:14:09.447064 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333731    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 20:14:09.447064 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333737    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 20:14:09.447064 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333740    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 20:14:09.447064 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333743    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 20:14:09.447064 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333746    2576 flags.go:64] FLAG: --logging-format="text"
Jul 21 20:14:09.447064 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333749    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 20:14:09.447064 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333753    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 20:14:09.447064 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333756    2576 flags.go:64] FLAG: --manifest-url=""
Jul 21 20:14:09.447064 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333758    2576 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 20:14:09.447064 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333763    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 20:14:09.447064 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333766    2576 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 20:14:09.447064 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333770    2576 flags.go:64] FLAG: --max-pods="110"
Jul 21 20:14:09.447064 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333773    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 20:14:09.448123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333776    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 20:14:09.448123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333779    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 20:14:09.448123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333782    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 20:14:09.448123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333785    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 20:14:09.448123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333788    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 20:14:09.448123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333791    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 20:14:09.448123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333799    2576 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 20:14:09.448123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333802    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 20:14:09.448123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333805    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 20:14:09.448123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333808    2576 flags.go:64] FLAG: --pod-cidr=""
Jul 21 20:14:09.448123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333812    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 20:14:09.448123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333819    2576 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 20:14:09.448123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333822    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 20:14:09.448123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333825    2576 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 20:14:09.448123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333830    2576 flags.go:64] FLAG: --port="10250"
Jul 21 20:14:09.448123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333833    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 20:14:09.448123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333836    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01959299cedce5145"
Jul 21 20:14:09.448123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333839    2576 flags.go:64] FLAG: --qos-reserved=""
Jul 21 20:14:09.448123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333844    2576 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 20:14:09.448123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333847    2576 flags.go:64] FLAG: --register-node="true"
Jul 21 20:14:09.448123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333850    2576 flags.go:64] FLAG: --register-with-taints=""
Jul 21 20:14:09.448123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333853    2576 flags.go:64] FLAG: --registry-burst="10"
Jul 21 20:14:09.448123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333856    2576 flags.go:64] FLAG: --registry-qps="5"
Jul 21 20:14:09.448123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333859    2576 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 20:14:09.449220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333862    2576 flags.go:64] FLAG: --reserved-memory=""
Jul 21 20:14:09.449220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333866    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 20:14:09.449220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333869    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 20:14:09.449220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333872    2576 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 20:14:09.449220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333875    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 20:14:09.449220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333878    2576 flags.go:64] FLAG: --runonce="false"
Jul 21 20:14:09.449220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333881    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 20:14:09.449220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333884    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 20:14:09.449220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333887    2576 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 20:14:09.449220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333890    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 20:14:09.449220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333892    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 20:14:09.449220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333895    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 20:14:09.449220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333898    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 20:14:09.449220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333902    2576 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 20:14:09.449220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333905    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 20:14:09.449220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333908    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 20:14:09.449220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333911    2576 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 20:14:09.449220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333914    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 20:14:09.449220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333919    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 20:14:09.449220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333922    2576 flags.go:64] FLAG: --system-cgroups=""
Jul 21 20:14:09.449220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333924    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 20:14:09.449220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333930    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 20:14:09.449220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333933    2576 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 20:14:09.449220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333936    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 20:14:09.449220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333940    2576 flags.go:64] FLAG: --tls-min-version=""
Jul 21 20:14:09.450032 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333943    2576 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 20:14:09.450032 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333948    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 20:14:09.450032 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333951    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 20:14:09.450032 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333954    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 20:14:09.450032 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333957    2576 flags.go:64] FLAG: --v="2"
Jul 21 20:14:09.450032 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333961    2576 flags.go:64] FLAG: --version="false"
Jul 21 20:14:09.450032 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333966    2576 flags.go:64] FLAG: --vmodule=""
Jul 21 20:14:09.450032 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333969    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 20:14:09.450032 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.333973    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 20:14:09.450032 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334096    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 20:14:09.450032 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334100    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 20:14:09.450032 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334103    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 20:14:09.450032 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334106    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 20:14:09.450032 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334109    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 20:14:09.450032 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334112    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 20:14:09.450032 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334115    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 20:14:09.450032 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334118    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 20:14:09.450032 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334121    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 20:14:09.450032 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334123    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 20:14:09.450032 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334126    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 20:14:09.450032 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334129    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 20:14:09.450032 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334131    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 20:14:09.451065 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334134    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 20:14:09.451065 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334137    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 20:14:09.451065 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334139    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 20:14:09.451065 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334143    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 20:14:09.451065 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334146    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 20:14:09.451065 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334150    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 20:14:09.451065 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334154    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 20:14:09.451065 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334157    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 20:14:09.451065 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334159    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 20:14:09.451065 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334163    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 20:14:09.451065 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334166    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 20:14:09.451065 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334170    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 20:14:09.451065 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334173    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 20:14:09.451065 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334175    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 20:14:09.451065 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334178    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 20:14:09.451065 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334180    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 20:14:09.451065 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334183    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 20:14:09.451065 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334186    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 20:14:09.451065 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334188    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 20:14:09.451065 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334191    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 20:14:09.453510 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334193    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 20:14:09.453510 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334196    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 20:14:09.453510 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334198    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 20:14:09.453510 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334201    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 20:14:09.453510 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334204    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 20:14:09.453510 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334206    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 20:14:09.453510 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334209    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 20:14:09.453510 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334211    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 20:14:09.453510 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334214    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 20:14:09.453510 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334217    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 20:14:09.453510 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334219    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 20:14:09.453510 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334222    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 20:14:09.453510 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334225    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 20:14:09.453510 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334229    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 20:14:09.453510 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334232    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 20:14:09.453510 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334236    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 20:14:09.453510 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334239    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 20:14:09.453510 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334242    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 20:14:09.453510 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334245    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 20:14:09.454163 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334248    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 20:14:09.454163 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334251    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 20:14:09.454163 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334253    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 20:14:09.454163 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334258    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 20:14:09.454163 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334263    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 20:14:09.454163 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334266    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 20:14:09.454163 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334268    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 20:14:09.454163 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334271    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 20:14:09.454163 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334273    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 20:14:09.454163 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334276    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 20:14:09.454163 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334278    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 20:14:09.454163 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334281    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 20:14:09.454163 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334284    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 20:14:09.454163 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334286    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 20:14:09.454163 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334289    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 20:14:09.454163 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334291    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 20:14:09.454163 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334294    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 20:14:09.454163 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334296    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 20:14:09.454163 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334299    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 20:14:09.454794 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334302    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 20:14:09.454794 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334304    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 20:14:09.454794 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334307    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 20:14:09.454794 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334310    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 20:14:09.454794 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334312    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 20:14:09.454794 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334315    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 20:14:09.454794 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334317    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 20:14:09.454794 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334320    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 20:14:09.454794 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334323    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 20:14:09.454794 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334327    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 20:14:09.454794 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334329    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 20:14:09.454794 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334332    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 20:14:09.454794 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334334    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 20:14:09.454794 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334336    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 20:14:09.454794 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334339    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 20:14:09.454794 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334342    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 20:14:09.454794 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334344    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 20:14:09.454794 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334349    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 20:14:09.454794 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334351    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 20:14:09.456169 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334354    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 20:14:09.456169 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334356    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 20:14:09.456169 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334359    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 20:14:09.456169 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334361    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 20:14:09.456169 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334364    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 20:14:09.456169 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334366    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 20:14:09.456169 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334369    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 20:14:09.456169 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334372    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 20:14:09.456169 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.334374    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 20:14:09.456169 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.335148    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 20:14:09.456169 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.349057    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 20:14:09.456169 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.349078    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 20:14:09.456169 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.349099    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 20:14:09.456169 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.349109    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 20:14:09.457051 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349170    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 20:14:09.457051 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349175    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 20:14:09.457051 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349179    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 20:14:09.457051 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349183    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 20:14:09.457051 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349186    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 20:14:09.457051 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349188    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 20:14:09.457051 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349191    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 20:14:09.457051 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349194    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 20:14:09.457051 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349196    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 20:14:09.457051 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349201    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 20:14:09.457051 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349204    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 20:14:09.457051 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349207    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 20:14:09.457051 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349210    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 20:14:09.457051 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349213    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 20:14:09.457051 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349215    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 20:14:09.457051 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349218    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 20:14:09.457051 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349225    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 20:14:09.457051 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349228    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 20:14:09.457051 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349230    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 20:14:09.457051 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349233    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 20:14:09.457881 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349236    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 20:14:09.457881 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349240    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 20:14:09.457881 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349244    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 20:14:09.457881 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349248    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 20:14:09.457881 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349251    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 20:14:09.457881 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349254    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 20:14:09.457881 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349257    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 20:14:09.457881 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349261    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 20:14:09.457881 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349264    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 20:14:09.457881 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349266    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 20:14:09.457881 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349269    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 20:14:09.457881 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349272    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 20:14:09.457881 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349275    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 20:14:09.457881 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349278    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 20:14:09.457881 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349280    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 20:14:09.457881 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349283    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 20:14:09.457881 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349286    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 20:14:09.457881 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349289    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 20:14:09.457881 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349291    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 20:14:09.458726 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349294    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 20:14:09.458726 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349297    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 20:14:09.458726 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349300    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 20:14:09.458726 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349302    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 20:14:09.458726 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349305    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 20:14:09.458726 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349307    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 20:14:09.458726 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349310    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 20:14:09.458726 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349313    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 20:14:09.458726 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349315    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 20:14:09.458726 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349320    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 20:14:09.458726 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349323    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 20:14:09.458726 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349326    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 20:14:09.458726 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349328    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 20:14:09.458726 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349331    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 20:14:09.458726 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349334    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 20:14:09.458726 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349337    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 20:14:09.458726 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349339    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 20:14:09.458726 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349342    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 20:14:09.458726 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349344    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 20:14:09.458726 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349347    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 20:14:09.459329 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349350    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 20:14:09.459329 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349352    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 20:14:09.459329 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349355    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 20:14:09.459329 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349357    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 20:14:09.459329 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349360    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 20:14:09.459329 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349363    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 20:14:09.459329 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349366    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 20:14:09.459329 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349368    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 20:14:09.459329 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349371    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 20:14:09.459329 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349373    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 20:14:09.459329 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349376    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 20:14:09.459329 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349378    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 20:14:09.459329 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349381    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 20:14:09.459329 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349383    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 20:14:09.459329 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349386    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 20:14:09.459329 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349388    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 20:14:09.459329 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349392    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 20:14:09.459329 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349395    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 20:14:09.459329 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349399    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 20:14:09.459329 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349402    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 20:14:09.460387 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349406    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 20:14:09.460387 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349411    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 20:14:09.460387 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349414    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 20:14:09.460387 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349416    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 20:14:09.460387 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349419    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 20:14:09.460387 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349422    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 20:14:09.460387 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349425    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 20:14:09.460387 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349427    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 20:14:09.460387 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349430    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 20:14:09.460387 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349432    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 20:14:09.460387 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349435    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 20:14:09.460387 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349438    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 20:14:09.460387 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349441    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 20:14:09.460387 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349444    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 20:14:09.460387 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349446    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 20:14:09.460387 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349448    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 20:14:09.460387 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349451    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 20:14:09.460387 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349454    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 20:14:09.460387 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349456    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 20:14:09.460387 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349459    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 20:14:09.461003 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.349464    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 20:14:09.461003 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349591    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 20:14:09.461003 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349596    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 20:14:09.461003 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349599    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 20:14:09.461003 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349602    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 20:14:09.461003 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349604    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 20:14:09.461003 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349607    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 20:14:09.461003 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349610    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 20:14:09.461003 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349612    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 20:14:09.461003 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349615    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 20:14:09.461003 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349618    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 20:14:09.461003 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349621    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 20:14:09.461003 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349623    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 20:14:09.461003 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349630    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 20:14:09.461003 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349633    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 20:14:09.462046 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349636    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 20:14:09.462046 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349639    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 20:14:09.462046 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349643    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 20:14:09.462046 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349647    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 20:14:09.462046 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349650    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 20:14:09.462046 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349653    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 20:14:09.462046 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349655    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 20:14:09.462046 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349658    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 20:14:09.462046 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349661    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 20:14:09.462046 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349665    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 20:14:09.462046 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349668    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 20:14:09.462046 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349671    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 20:14:09.462046 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349673    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 20:14:09.462046 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349677    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 20:14:09.462046 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349679    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 20:14:09.462046 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349682    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 20:14:09.462046 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349684    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 20:14:09.462046 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349703    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 20:14:09.462046 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349706    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 20:14:09.462655 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349709    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 20:14:09.462655 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349712    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 20:14:09.462655 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349714    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 20:14:09.462655 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349717    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 20:14:09.462655 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349719    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 20:14:09.462655 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349722    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 20:14:09.462655 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349725    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 20:14:09.462655 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349727    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 20:14:09.462655 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349730    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 20:14:09.462655 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349733    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 20:14:09.462655 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349735    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 20:14:09.462655 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349739    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 20:14:09.462655 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349744    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 20:14:09.462655 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349747    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 20:14:09.462655 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349750    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 20:14:09.462655 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349753    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 20:14:09.462655 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349755    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 20:14:09.462655 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349758    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 20:14:09.462655 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349761    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 20:14:09.462655 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349764    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 20:14:09.463921 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349766    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 20:14:09.463921 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349769    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 20:14:09.463921 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349772    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 20:14:09.463921 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349774    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 20:14:09.463921 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349777    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 20:14:09.463921 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349779    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 20:14:09.463921 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349782    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 20:14:09.463921 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349785    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 20:14:09.463921 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349787    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 20:14:09.463921 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349790    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 20:14:09.463921 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349793    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 20:14:09.463921 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349795    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 20:14:09.463921 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349798    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 20:14:09.463921 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349800    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 20:14:09.463921 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349803    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 20:14:09.463921 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349805    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 20:14:09.463921 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349808    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 20:14:09.463921 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349810    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 20:14:09.463921 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349813    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 20:14:09.463921 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349815    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 20:14:09.464817 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349818    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 20:14:09.464817 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349820    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 20:14:09.464817 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349823    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 20:14:09.464817 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349827    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 20:14:09.464817 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349831    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 20:14:09.464817 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349834    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 20:14:09.464817 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349837    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 20:14:09.464817 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349840    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 20:14:09.464817 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349843    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 20:14:09.464817 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349845    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 20:14:09.464817 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349848    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 20:14:09.464817 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349851    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 20:14:09.464817 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349853    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 20:14:09.464817 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349856    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 20:14:09.464817 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349859    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 20:14:09.464817 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349861    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 20:14:09.464817 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349864    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 20:14:09.464817 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349867    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 20:14:09.464817 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349871    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 20:14:09.465401 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349874    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 20:14:09.465401 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349878    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 20:14:09.465401 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349881    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 20:14:09.465401 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349884    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 20:14:09.465401 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349887    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 20:14:09.465401 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349890    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 20:14:09.465401 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:09.349892    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 20:14:09.465401 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.349898    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 20:14:09.465401 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.350034    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 20:14:09.465401 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.353666    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 20:14:09.465401 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.355169    2576 server.go:1019] "Starting client certificate rotation"
Jul 21 20:14:09.465401 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.357267    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 20:14:09.465401 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.358237    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 20:14:09.465870 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.358297    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 20:14:09.465870 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.360654    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 20:14:09.465870 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.368144    2576 log.go:25] "Validated CRI v1 runtime API"
Jul 21 20:14:09.465870 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.371970    2576 log.go:25] "Validated CRI v1 image API"
Jul 21 20:14:09.465870 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.374165    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 20:14:09.465870 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.377113    2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 afe170bb-9e36-4bac-9bd5-13aaf94f10cf:/dev/nvme0n1p3 cb3405ab-efbf-438d-9d6a-90f8f080f4f6:/dev/nvme0n1p4]
Jul 21 20:14:09.465870 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.377132    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 20:14:09.572831 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.383803    2576 manager.go:216] Machine: {Timestamp:2026-07-21 20:14:09.382708538 +0000 UTC m=+0.315106685 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101323 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29048f3ea1db3786c748ca406ddf62 SystemUUID:ec29048f-3ea1-db37-86c7-48ca406ddf62 BootID:588a54df-9311-4128-8ca2-03f92ec2e8c1 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d5:c9:30:10:17 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d5:c9:30:10:17 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:52:a7:99:17:84 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 20:14:09.572831 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.383905    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 20:14:09.572831 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.383996    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 20:14:09.572831 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.385340    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 20:14:09.572831 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.385387    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-201.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 20:14:09.572831 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.385985    2576 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 20:14:09.572831 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.385998    2576 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 20:14:09.572831 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.386007    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 20:14:09.572831 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.387194    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 20:14:09.572831 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.387530    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 20:14:09.572831 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.388739    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 20:14:09.572831 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.391950    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 20:14:09.572831 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.392078    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 20:14:09.572831 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.392107    2576 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 20:14:09.572831 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.392117    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 20:14:09.572831 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.392130    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 20:14:09.572831 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.392139    2576 kubelet.go:398] "Adding apiserver pod source"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.392148    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.392529    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.392551    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.394757    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.396945    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.396992    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.398132    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.398150    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.398156    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.398162    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.398170    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.398176    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.398183    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.398191    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.398203    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.398210    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.398219    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.398225    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.399004    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.399015    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:09.402072    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-201.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.402161    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-201.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:09.402369    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.402821    2576 server.go:1268] "Started kubelet"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.403669    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.405335    2576 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.406223    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.406264    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.407424    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-csmlt"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.408083    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:09.409285    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-201.ec2.internal.18c4673997c79f63  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-201.ec2.internal,UID:ip-10-0-128-201.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-201.ec2.internal,},FirstTimestamp:2026-07-21 20:14:09.402797923 +0000 UTC m=+0.335196112,LastTimestamp:2026-07-21 20:14:09.402797923 +0000 UTC m=+0.335196112,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-201.ec2.internal,}"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.417463    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.417490    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:09.417758    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-201.ec2.internal\" not found"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.418170    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.418201    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.418210    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.418405    2576 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.418421    2576 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 20:14:09.591304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.428480    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-csmlt"
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:09.429433    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-201.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:09.429679    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.429732    2576 factory.go:55] Registering systemd factory
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.429749    2576 factory.go:223] Registration of the systemd container factory successfully
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.430250    2576 factory.go:153] Registering CRI-O factory
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.430268    2576 factory.go:223] Registration of the crio container factory successfully
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.430329    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.430362    2576 factory.go:103] Registering Raw factory
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.430380    2576 manager.go:1196] Started watching for new ooms in manager
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.430869    2576 manager.go:349] Starting recovery of all containers
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:09.437734    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.449247    2576 manager.go:354] Recovery completed
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.454252    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.456355    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-201.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.456389    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-201.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.456401    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-201.ec2.internal" event="NodeHasSufficientPID"
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.457068    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.457080    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.457099    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.457213    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.458091    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-201.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.458122    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-201.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.458137    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-201.ec2.internal" event="NodeHasSufficientPID"
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.458277    2576 policy_none.go:49] "None policy: Start"
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.458292    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.458305    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.459411    2576 policy_none.go:47] "Start"
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.500657    2576 manager.go:337] "Starting Device Plugin manager"
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:09.500703    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.500718    2576 server.go:87] "Starting device plugin registration server"
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.501488    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.501504    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.501636    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.501755    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.501764    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:09.502204    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 20:14:09.592690 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:09.502252    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-201.ec2.internal\" not found"
Jul 21 20:14:09.747119 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.601957    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 20:14:09.747119 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.603170    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-201.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 20:14:09.747119 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.603202    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-201.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 20:14:09.747119 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.603214    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-201.ec2.internal" event="NodeHasSufficientPID"
Jul 21 20:14:09.747119 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.603246    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-201.ec2.internal"
Jul 21 20:14:09.747119 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.620417    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-201.ec2.internal"
Jul 21 20:14:09.747119 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:09.620442    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-201.ec2.internal\": node \"ip-10-0-128-201.ec2.internal\" not found"
Jul 21 20:14:09.747119 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:09.641602    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-201.ec2.internal\" not found"
Jul 21 20:14:09.747119 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.643140    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 20:14:09.747119 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.644696    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 20:14:09.747119 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.644735    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 20:14:09.747119 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.644756    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 20:14:09.747119 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:09.644811    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 20:14:09.747119 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.655143    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 20:14:09.747119 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:09.742536    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-201.ec2.internal\" not found"
Jul 21 20:14:09.747119 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.745963    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-201.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-201.ec2.internal"]
Jul 21 20:14:09.747119 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.746049    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 20:14:09.748955 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.747969    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-201.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 20:14:09.748955 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.747996    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-201.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 20:14:09.748955 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.748006    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-201.ec2.internal" event="NodeHasSufficientPID"
Jul 21 20:14:09.750289 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.749356    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 20:14:09.750289 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.749542    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-201.ec2.internal"
Jul 21 20:14:09.750289 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.749572    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 20:14:09.751638 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.750365    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-201.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 20:14:09.751638 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.750391    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-201.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 20:14:09.751638 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.750405    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-201.ec2.internal" event="NodeHasSufficientPID"
Jul 21 20:14:09.751638 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.750842    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-201.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 20:14:09.751638 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.750865    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-201.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 20:14:09.751638 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.750878    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-201.ec2.internal" event="NodeHasSufficientPID"
Jul 21 20:14:09.751638 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.751614    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-201.ec2.internal"
Jul 21 20:14:09.751638 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.751642    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 20:14:09.753953 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.752368    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-201.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 20:14:09.753953 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.752387    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-201.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 20:14:09.753953 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.752398    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-201.ec2.internal" event="NodeHasSufficientPID"
Jul 21 20:14:09.897836 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:09.789642    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-201.ec2.internal\" not found" node="ip-10-0-128-201.ec2.internal"
Jul 21 20:14:09.897836 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:09.794946    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-201.ec2.internal\" not found" node="ip-10-0-128-201.ec2.internal"
Jul 21 20:14:09.897836 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.823778    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c92ea5607a4c49d38cbe93e974df244d-config\") pod \"kube-apiserver-proxy-ip-10-0-128-201.ec2.internal\" (UID: \"c92ea5607a4c49d38cbe93e974df244d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-201.ec2.internal"
Jul 21 20:14:09.897836 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.823810    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6aaf5d7e58116369463822b045e52d90-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-201.ec2.internal\" (UID: \"6aaf5d7e58116369463822b045e52d90\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-201.ec2.internal"
Jul 21 20:14:09.897836 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.823830    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6aaf5d7e58116369463822b045e52d90-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-201.ec2.internal\" (UID: \"6aaf5d7e58116369463822b045e52d90\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-201.ec2.internal"
Jul 21 20:14:09.897836 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:09.846246    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-201.ec2.internal\" not found"
Jul 21 20:14:09.997507 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.924538    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c92ea5607a4c49d38cbe93e974df244d-config\") pod \"kube-apiserver-proxy-ip-10-0-128-201.ec2.internal\" (UID: \"c92ea5607a4c49d38cbe93e974df244d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-201.ec2.internal"
Jul 21 20:14:09.997507 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.924588    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6aaf5d7e58116369463822b045e52d90-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-201.ec2.internal\" (UID: \"6aaf5d7e58116369463822b045e52d90\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-201.ec2.internal"
Jul 21 20:14:09.997507 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.924610    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6aaf5d7e58116369463822b045e52d90-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-201.ec2.internal\" (UID: \"6aaf5d7e58116369463822b045e52d90\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-201.ec2.internal"
Jul 21 20:14:09.997507 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.924656    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6aaf5d7e58116369463822b045e52d90-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-201.ec2.internal\" (UID: \"6aaf5d7e58116369463822b045e52d90\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-201.ec2.internal"
Jul 21 20:14:09.997507 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.924660    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c92ea5607a4c49d38cbe93e974df244d-config\") pod \"kube-apiserver-proxy-ip-10-0-128-201.ec2.internal\" (UID: \"c92ea5607a4c49d38cbe93e974df244d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-201.ec2.internal"
Jul 21 20:14:09.997507 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:09.924669    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6aaf5d7e58116369463822b045e52d90-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-201.ec2.internal\" (UID: \"6aaf5d7e58116369463822b045e52d90\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-201.ec2.internal"
Jul 21 20:14:09.997507 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:09.947347    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-201.ec2.internal\" not found"
Jul 21 20:14:10.108676 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:10.048360    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-201.ec2.internal\" not found"
Jul 21 20:14:10.108676 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.096158    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-201.ec2.internal"
Jul 21 20:14:10.108676 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.098372    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-201.ec2.internal"
Jul 21 20:14:10.213656 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:10.149388    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-201.ec2.internal\" not found"
Jul 21 20:14:10.250088 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:10.250055    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-201.ec2.internal\" not found"
Jul 21 20:14:10.291235 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.291209    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 20:14:10.294595 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.294580    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 20:14:10.319261 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.319229    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-201.ec2.internal"
Jul 21 20:14:10.332489 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.332463    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 20:14:10.334282 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.334265    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-201.ec2.internal"
Jul 21 20:14:10.346345 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.346319    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 20:14:10.359029 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.359004    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 20:14:10.359164 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.359146    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 20:14:10.359206 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.359189    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 20:14:10.359240 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.359189    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 20:14:10.394378 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.394342    2576 apiserver.go:52] "Watching apiserver"
Jul 21 20:14:10.412418 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.412386    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 20:14:10.412791 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.412767    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-201.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z","openshift-dns/node-resolver-tttht","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-201.ec2.internal","openshift-multus/network-metrics-daemon-q9fp4","openshift-network-diagnostics/network-check-target-5ls7f","openshift-ovn-kubernetes/ovnkube-node-54f9x","kube-system/global-pull-secret-syncer-7fmhc","kube-system/konnectivity-agent-46pn7","openshift-cluster-node-tuning-operator/tuned-sxdjr","openshift-image-registry/node-ca-j55fg","openshift-multus/multus-additional-cni-plugins-bdpzc","openshift-multus/multus-tc85m","openshift-network-operator/iptables-alerter-7pgtc"]
Jul 21 20:14:10.414600 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.414578    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bdpzc"
Jul 21 20:14:10.415786 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.415759    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z"
Jul 21 20:14:10.417059 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.417035    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.417357 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.417204    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mgd2v\""
Jul 21 20:14:10.417703 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.417680    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 20:14:10.417875 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.417855    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 20:14:10.418028 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.417860    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 20:14:10.418028 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.417925    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 20:14:10.418028 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.417860    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 20:14:10.418028 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.417969    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 20:14:10.418320 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.418202    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 20:14:10.418388 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.418369    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 20:14:10.418481 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.418459    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:10.418595 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:10.418532    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9fp4" podUID="3712cffa-e355-4c1e-9d88-b133a9eec5b4"
Jul 21 20:14:10.418651 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.418611    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4fm8r\""
Jul 21 20:14:10.418693 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.418651    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 20:14:10.419560 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.419546    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6lnsg\""
Jul 21 20:14:10.419635 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.419621    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:14:10.419697 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:10.419675    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ls7f" podUID="4e6c7adb-e703-4f33-af51-22fc05e06d23"
Jul 21 20:14:10.419918 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.419905    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 20:14:10.419986 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.419971    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 20:14:10.420085 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.419983    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 20:14:10.420085 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.420018    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 20:14:10.420085 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.420028    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 20:14:10.420557 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.420534    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 20:14:10.421123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.421110    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:10.421772 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:10.421711    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7fmhc" podUID="329479f3-ad8b-4d55-8902-fd524ced9b32"
Jul 21 20:14:10.423766 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.423507    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-46pn7"
Jul 21 20:14:10.425474 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.425454    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.426645 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.426592    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 20:14:10.426645 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.426627    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-g694g\""
Jul 21 20:14:10.426848 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.426762    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 20:14:10.426914 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.426869    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j55fg"
Jul 21 20:14:10.427124 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.426998    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/adf41cf7-7a06-4eb9-9e21-a2a861e137f6-cni-binary-copy\") pod \"multus-additional-cni-plugins-bdpzc\" (UID: \"adf41cf7-7a06-4eb9-9e21-a2a861e137f6\") " pod="openshift-multus/multus-additional-cni-plugins-bdpzc"
Jul 21 20:14:10.427124 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427034    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-log-socket\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.427124 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427065    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/adf41cf7-7a06-4eb9-9e21-a2a861e137f6-system-cni-dir\") pod \"multus-additional-cni-plugins-bdpzc\" (UID: \"adf41cf7-7a06-4eb9-9e21-a2a861e137f6\") " pod="openshift-multus/multus-additional-cni-plugins-bdpzc"
Jul 21 20:14:10.427124 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427089    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/adf41cf7-7a06-4eb9-9e21-a2a861e137f6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bdpzc\" (UID: \"adf41cf7-7a06-4eb9-9e21-a2a861e137f6\") " pod="openshift-multus/multus-additional-cni-plugins-bdpzc"
Jul 21 20:14:10.427124 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427115    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7-socket-dir\") pod \"aws-ebs-csi-driver-node-ntf8z\" (UID: \"c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z"
Jul 21 20:14:10.427455 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427166    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-host-kubelet\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.427455 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427202    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-host-cni-bin\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.427455 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427228    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/55f51c26-71cd-4e1b-84f2-32f2de4138d5-ovnkube-config\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.427455 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427252    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/adf41cf7-7a06-4eb9-9e21-a2a861e137f6-os-release\") pod \"multus-additional-cni-plugins-bdpzc\" (UID: \"adf41cf7-7a06-4eb9-9e21-a2a861e137f6\") " pod="openshift-multus/multus-additional-cni-plugins-bdpzc"
Jul 21 20:14:10.427455 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427303    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f965\" (UniqueName: \"kubernetes.io/projected/adf41cf7-7a06-4eb9-9e21-a2a861e137f6-kube-api-access-9f965\") pod \"multus-additional-cni-plugins-bdpzc\" (UID: \"adf41cf7-7a06-4eb9-9e21-a2a861e137f6\") " pod="openshift-multus/multus-additional-cni-plugins-bdpzc"
Jul 21 20:14:10.427455 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427339    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.427455 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427392    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-var-lib-openvswitch\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.427455 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427422    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q72jr\" (UniqueName: \"kubernetes.io/projected/4e6c7adb-e703-4f33-af51-22fc05e06d23-kube-api-access-q72jr\") pod \"network-check-target-5ls7f\" (UID: \"4e6c7adb-e703-4f33-af51-22fc05e06d23\") " pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:14:10.427882 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427461    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/adf41cf7-7a06-4eb9-9e21-a2a861e137f6-cnibin\") pod \"multus-additional-cni-plugins-bdpzc\" (UID: \"adf41cf7-7a06-4eb9-9e21-a2a861e137f6\") " pod="openshift-multus/multus-additional-cni-plugins-bdpzc"
Jul 21 20:14:10.427882 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427486    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7-etc-selinux\") pod \"aws-ebs-csi-driver-node-ntf8z\" (UID: \"c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z"
Jul 21 20:14:10.427882 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427525    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-systemd-units\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.427882 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427531    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kt2f2\""
Jul 21 20:14:10.427882 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427563    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-host-slash\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.427882 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427586    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-run-systemd\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.427882 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427601    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-run-openvswitch\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.427882 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427624    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7-sys-fs\") pod \"aws-ebs-csi-driver-node-ntf8z\" (UID: \"c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z"
Jul 21 20:14:10.427882 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427646    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t6hn\" (UniqueName: \"kubernetes.io/projected/c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7-kube-api-access-9t6hn\") pod \"aws-ebs-csi-driver-node-ntf8z\" (UID: \"c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z"
Jul 21 20:14:10.427882 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427672    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-host-run-netns\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.427882 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427734    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-run-ovn\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.427882 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427815    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/55f51c26-71cd-4e1b-84f2-32f2de4138d5-env-overrides\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.427882 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427835    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 20:14:10.427882 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427855    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdz59\" (UniqueName: \"kubernetes.io/projected/3712cffa-e355-4c1e-9d88-b133a9eec5b4-kube-api-access-sdz59\") pod \"network-metrics-daemon-q9fp4\" (UID: \"3712cffa-e355-4c1e-9d88-b133a9eec5b4\") " pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:10.427882 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427889    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8xpp\" (UniqueName: \"kubernetes.io/projected/55f51c26-71cd-4e1b-84f2-32f2de4138d5-kube-api-access-w8xpp\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.428526 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427907    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs\") pod \"network-metrics-daemon-q9fp4\" (UID: \"3712cffa-e355-4c1e-9d88-b133a9eec5b4\") " pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:10.428526 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427923    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7-registration-dir\") pod \"aws-ebs-csi-driver-node-ntf8z\" (UID: \"c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z"
Jul 21 20:14:10.428526 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427944    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-etc-openvswitch\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.428526 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427961    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.428526 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.427980    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-host-cni-netd\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.428526 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.428012    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/55f51c26-71cd-4e1b-84f2-32f2de4138d5-ovnkube-script-lib\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.428526 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.428045    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/adf41cf7-7a06-4eb9-9e21-a2a861e137f6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bdpzc\" (UID: \"adf41cf7-7a06-4eb9-9e21-a2a861e137f6\") " pod="openshift-multus/multus-additional-cni-plugins-bdpzc"
Jul 21 20:14:10.428526 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.428064    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/adf41cf7-7a06-4eb9-9e21-a2a861e137f6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bdpzc\" (UID: \"adf41cf7-7a06-4eb9-9e21-a2a861e137f6\") " pod="openshift-multus/multus-additional-cni-plugins-bdpzc"
Jul 21 20:14:10.428526 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.428079    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ntf8z\" (UID: \"c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z"
Jul 21 20:14:10.428526 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.428125    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7-device-dir\") pod \"aws-ebs-csi-driver-node-ntf8z\" (UID: \"c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z"
Jul 21 20:14:10.428526 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.428149    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-node-log\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.428526 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.428199    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/55f51c26-71cd-4e1b-84f2-32f2de4138d5-ovn-node-metrics-cert\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.428526 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.428316    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tttht"
Jul 21 20:14:10.428526 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.428360    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 20:14:10.429335 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.428992    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 20:14:10.429335 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.429138    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 20:14:10.429335 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.429221    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 20:14:10.429492 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.429377    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8p957\""
Jul 21 20:14:10.429692 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.429674    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.430255 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.430235    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 20:14:10.430936 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.430920    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7pgtc"
Jul 21 20:14:10.431179 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.431161    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-c6nth\""
Jul 21 20:14:10.431350 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.431334    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 20:14:10.431580 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.431565    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 20:14:10.431810 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.431796    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 20:14:10.432037 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.432024    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-j77wv\""
Jul 21 20:14:10.433209 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.433195    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 20:14:10.433246 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.433222    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 20:14:10.433512 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.433498    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 20:14:10.433574 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.433560    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-k69kk\""
Jul 21 20:14:10.441376 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.441338    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 20:09:09 +0000 UTC" deadline="2028-01-21 17:08:33.502709457 +0000 UTC"
Jul 21 20:14:10.441431 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.441379    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13172h54m23.061336196s"
Jul 21 20:14:10.457457 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.457435    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7bspc"
Jul 21 20:14:10.466182 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.466120    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7bspc"
Jul 21 20:14:10.467838 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.467819    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 20:14:10.518928 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.518901    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 20:14:10.528686 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.528666    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/329479f3-ad8b-4d55-8902-fd524ced9b32-dbus\") pod \"global-pull-secret-syncer-7fmhc\" (UID: \"329479f3-ad8b-4d55-8902-fd524ced9b32\") " pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:10.528814 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.528692    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-sys\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.528814 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.528725    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-etc-kubernetes\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.528814 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.528743    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d32959ad-b973-4850-8f1f-9c135930cbdb-iptables-alerter-script\") pod \"iptables-alerter-7pgtc\" (UID: \"d32959ad-b973-4850-8f1f-9c135930cbdb\") " pod="openshift-network-operator/iptables-alerter-7pgtc"
Jul 21 20:14:10.528814 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.528767    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/adf41cf7-7a06-4eb9-9e21-a2a861e137f6-system-cni-dir\") pod \"multus-additional-cni-plugins-bdpzc\" (UID: \"adf41cf7-7a06-4eb9-9e21-a2a861e137f6\") " pod="openshift-multus/multus-additional-cni-plugins-bdpzc"
Jul 21 20:14:10.528814 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.528791    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/adf41cf7-7a06-4eb9-9e21-a2a861e137f6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bdpzc\" (UID: \"adf41cf7-7a06-4eb9-9e21-a2a861e137f6\") " pod="openshift-multus/multus-additional-cni-plugins-bdpzc"
Jul 21 20:14:10.528814 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.528807    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7-socket-dir\") pod \"aws-ebs-csi-driver-node-ntf8z\" (UID: \"c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z"
Jul 21 20:14:10.529093 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.528863    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/adf41cf7-7a06-4eb9-9e21-a2a861e137f6-system-cni-dir\") pod \"multus-additional-cni-plugins-bdpzc\" (UID: \"adf41cf7-7a06-4eb9-9e21-a2a861e137f6\") " pod="openshift-multus/multus-additional-cni-plugins-bdpzc"
Jul 21 20:14:10.529093 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.528913    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-host-kubelet\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.529093 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.528932    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7-socket-dir\") pod \"aws-ebs-csi-driver-node-ntf8z\" (UID: \"c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z"
Jul 21 20:14:10.529093 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.528936    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/55f51c26-71cd-4e1b-84f2-32f2de4138d5-ovnkube-config\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.529093 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.528969    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-etc-sysconfig\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.529093 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529001    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/adf41cf7-7a06-4eb9-9e21-a2a861e137f6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bdpzc\" (UID: \"adf41cf7-7a06-4eb9-9e21-a2a861e137f6\") " pod="openshift-multus/multus-additional-cni-plugins-bdpzc"
Jul 21 20:14:10.529093 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529011    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-host-kubelet\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.529093 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529040    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-tmp\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.529093 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529064    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-host-var-lib-cni-bin\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.529093 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529091    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.529548 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529110    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/abe5ed79-25df-4e07-a3b4-c8014119e03e-agent-certs\") pod \"konnectivity-agent-46pn7\" (UID: \"abe5ed79-25df-4e07-a3b4-c8014119e03e\") " pod="kube-system/konnectivity-agent-46pn7"
Jul 21 20:14:10.529548 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529127    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-multus-socket-dir-parent\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.529548 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529150    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-systemd-units\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.529548 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529155    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.529548 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529174    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/55f51c26-71cd-4e1b-84f2-32f2de4138d5-env-overrides\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.529548 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529212    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-systemd-units\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.529548 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529244    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-etc-sysctl-d\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.529548 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529273    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-etc-tuned\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.529548 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529299    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-system-cni-dir\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.529548 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529329    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t6hn\" (UniqueName: \"kubernetes.io/projected/c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7-kube-api-access-9t6hn\") pod \"aws-ebs-csi-driver-node-ntf8z\" (UID: \"c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z"
Jul 21 20:14:10.529548 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529353    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20c1b2ab-1a68-456f-bf0c-53417e458643-host\") pod \"node-ca-j55fg\" (UID: \"20c1b2ab-1a68-456f-bf0c-53417e458643\") " pod="openshift-image-registry/node-ca-j55fg"
Jul 21 20:14:10.529548 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529378    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-etc-modprobe-d\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.529548 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529398    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/55f51c26-71cd-4e1b-84f2-32f2de4138d5-ovnkube-config\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.529548 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529402    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-run\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.529548 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529458    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/92f34183-cb25-480d-9553-2f38678d8132-cni-binary-copy\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.529548 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529489    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-host-var-lib-kubelet\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.529548 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529510    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d32959ad-b973-4850-8f1f-9c135930cbdb-host-slash\") pod \"iptables-alerter-7pgtc\" (UID: \"d32959ad-b973-4850-8f1f-9c135930cbdb\") " pod="openshift-network-operator/iptables-alerter-7pgtc"
Jul 21 20:14:10.530395 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529511    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/55f51c26-71cd-4e1b-84f2-32f2de4138d5-env-overrides\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.530395 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529538    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdz59\" (UniqueName: \"kubernetes.io/projected/3712cffa-e355-4c1e-9d88-b133a9eec5b4-kube-api-access-sdz59\") pod \"network-metrics-daemon-q9fp4\" (UID: \"3712cffa-e355-4c1e-9d88-b133a9eec5b4\") " pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:10.530395 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529566    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8xpp\" (UniqueName: \"kubernetes.io/projected/55f51c26-71cd-4e1b-84f2-32f2de4138d5-kube-api-access-w8xpp\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.530395 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529590    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-cnibin\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.530395 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529616    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.530395 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529642    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/55f51c26-71cd-4e1b-84f2-32f2de4138d5-ovnkube-script-lib\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.530395 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529687    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmk94\" (UniqueName: \"kubernetes.io/projected/20c1b2ab-1a68-456f-bf0c-53417e458643-kube-api-access-kmk94\") pod \"node-ca-j55fg\" (UID: \"20c1b2ab-1a68-456f-bf0c-53417e458643\") " pod="openshift-image-registry/node-ca-j55fg"
Jul 21 20:14:10.530395 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529744    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-etc-sysctl-conf\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.530395 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529756    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.530395 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529781    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/adf41cf7-7a06-4eb9-9e21-a2a861e137f6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bdpzc\" (UID: \"adf41cf7-7a06-4eb9-9e21-a2a861e137f6\") " pod="openshift-multus/multus-additional-cni-plugins-bdpzc"
Jul 21 20:14:10.530395 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529816    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/adf41cf7-7a06-4eb9-9e21-a2a861e137f6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bdpzc\" (UID: \"adf41cf7-7a06-4eb9-9e21-a2a861e137f6\") " pod="openshift-multus/multus-additional-cni-plugins-bdpzc"
Jul 21 20:14:10.530395 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529834    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7-device-dir\") pod \"aws-ebs-csi-driver-node-ntf8z\" (UID: \"c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z"
Jul 21 20:14:10.530395 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529850    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-node-log\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.530395 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529868    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/55f51c26-71cd-4e1b-84f2-32f2de4138d5-ovn-node-metrics-cert\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.530395 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529885    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-host-run-k8s-cni-cncf-io\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.530395 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529912    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/adf41cf7-7a06-4eb9-9e21-a2a861e137f6-cni-binary-copy\") pod \"multus-additional-cni-plugins-bdpzc\" (UID: \"adf41cf7-7a06-4eb9-9e21-a2a861e137f6\") " pod="openshift-multus/multus-additional-cni-plugins-bdpzc"
Jul 21 20:14:10.530395 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529931    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7-device-dir\") pod \"aws-ebs-csi-driver-node-ntf8z\" (UID: \"c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z"
Jul 21 20:14:10.531140 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.529932    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-node-log\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.531140 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530045    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-log-socket\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.531140 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530073    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/329479f3-ad8b-4d55-8902-fd524ced9b32-kubelet-config\") pod \"global-pull-secret-syncer-7fmhc\" (UID: \"329479f3-ad8b-4d55-8902-fd524ced9b32\") " pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:10.531140 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530095    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-os-release\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.531140 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530121    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/92f34183-cb25-480d-9553-2f38678d8132-multus-daemon-config\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.531140 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530131    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-log-socket\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.531140 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530185    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-host-cni-bin\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.531140 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530211    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/20c1b2ab-1a68-456f-bf0c-53417e458643-serviceca\") pod \"node-ca-j55fg\" (UID: \"20c1b2ab-1a68-456f-bf0c-53417e458643\") " pod="openshift-image-registry/node-ca-j55fg"
Jul 21 20:14:10.531140 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530228    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-etc-kubernetes\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.531140 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530240    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 20:14:10.531140 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530251    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-var-lib-kubelet\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.531140 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530249    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/55f51c26-71cd-4e1b-84f2-32f2de4138d5-ovnkube-script-lib\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.531140 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530276    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-host-cni-bin\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.531140 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530296    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38dce886-864e-4891-aa0c-80b892634b99-tmp-dir\") pod \"node-resolver-tttht\" (UID: \"38dce886-864e-4891-aa0c-80b892634b99\") " pod="openshift-dns/node-resolver-tttht"
Jul 21 20:14:10.531140 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530311    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/adf41cf7-7a06-4eb9-9e21-a2a861e137f6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bdpzc\" (UID: \"adf41cf7-7a06-4eb9-9e21-a2a861e137f6\") " pod="openshift-multus/multus-additional-cni-plugins-bdpzc"
Jul 21 20:14:10.531140 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530339    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dksqx\" (UniqueName: \"kubernetes.io/projected/d32959ad-b973-4850-8f1f-9c135930cbdb-kube-api-access-dksqx\") pod \"iptables-alerter-7pgtc\" (UID: \"d32959ad-b973-4850-8f1f-9c135930cbdb\") " pod="openshift-network-operator/iptables-alerter-7pgtc"
Jul 21 20:14:10.531140 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530372    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/adf41cf7-7a06-4eb9-9e21-a2a861e137f6-os-release\") pod \"multus-additional-cni-plugins-bdpzc\" (UID: \"adf41cf7-7a06-4eb9-9e21-a2a861e137f6\") " pod="openshift-multus/multus-additional-cni-plugins-bdpzc"
Jul 21 20:14:10.531749 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530397    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f965\" (UniqueName: \"kubernetes.io/projected/adf41cf7-7a06-4eb9-9e21-a2a861e137f6-kube-api-access-9f965\") pod \"multus-additional-cni-plugins-bdpzc\" (UID: \"adf41cf7-7a06-4eb9-9e21-a2a861e137f6\") " pod="openshift-multus/multus-additional-cni-plugins-bdpzc"
Jul 21 20:14:10.531749 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530422    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-host\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.531749 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530439    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/adf41cf7-7a06-4eb9-9e21-a2a861e137f6-os-release\") pod \"multus-additional-cni-plugins-bdpzc\" (UID: \"adf41cf7-7a06-4eb9-9e21-a2a861e137f6\") " pod="openshift-multus/multus-additional-cni-plugins-bdpzc"
Jul 21 20:14:10.531749 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530447    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-host-run-netns\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.531749 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530474    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-var-lib-openvswitch\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.531749 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530495    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/adf41cf7-7a06-4eb9-9e21-a2a861e137f6-cni-binary-copy\") pod \"multus-additional-cni-plugins-bdpzc\" (UID: \"adf41cf7-7a06-4eb9-9e21-a2a861e137f6\") " pod="openshift-multus/multus-additional-cni-plugins-bdpzc"
Jul 21 20:14:10.531749 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530505    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q72jr\" (UniqueName: \"kubernetes.io/projected/4e6c7adb-e703-4f33-af51-22fc05e06d23-kube-api-access-q72jr\") pod \"network-check-target-5ls7f\" (UID: \"4e6c7adb-e703-4f33-af51-22fc05e06d23\") " pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:14:10.531749 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530509    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/adf41cf7-7a06-4eb9-9e21-a2a861e137f6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bdpzc\" (UID: \"adf41cf7-7a06-4eb9-9e21-a2a861e137f6\") " pod="openshift-multus/multus-additional-cni-plugins-bdpzc"
Jul 21 20:14:10.531749 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530532    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/adf41cf7-7a06-4eb9-9e21-a2a861e137f6-cnibin\") pod \"multus-additional-cni-plugins-bdpzc\" (UID: \"adf41cf7-7a06-4eb9-9e21-a2a861e137f6\") " pod="openshift-multus/multus-additional-cni-plugins-bdpzc"
Jul 21 20:14:10.531749 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530558    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7-etc-selinux\") pod \"aws-ebs-csi-driver-node-ntf8z\" (UID: \"c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z"
Jul 21 20:14:10.531749 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530583    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-host-slash\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.531749 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530558    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-var-lib-openvswitch\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.531749 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530585    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/adf41cf7-7a06-4eb9-9e21-a2a861e137f6-cnibin\") pod \"multus-additional-cni-plugins-bdpzc\" (UID: \"adf41cf7-7a06-4eb9-9e21-a2a861e137f6\") " pod="openshift-multus/multus-additional-cni-plugins-bdpzc"
Jul 21 20:14:10.531749 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530608    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-run-systemd\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.531749 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530648    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-run-systemd\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.531749 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530655    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7-etc-selinux\") pod \"aws-ebs-csi-driver-node-ntf8z\" (UID: \"c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z"
Jul 21 20:14:10.531749 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530664    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-host-slash\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.532277 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530669    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-run-openvswitch\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.532277 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530703    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-run-ovn\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.532277 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530732    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-run-openvswitch\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.532277 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530758    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7-sys-fs\") pod \"aws-ebs-csi-driver-node-ntf8z\" (UID: \"c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z"
Jul 21 20:14:10.532277 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530779    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-host-run-netns\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.532277 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530793    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-run-ovn\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.532277 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530816    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7-sys-fs\") pod \"aws-ebs-csi-driver-node-ntf8z\" (UID: \"c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z"
Jul 21 20:14:10.532277 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530808    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/329479f3-ad8b-4d55-8902-fd524ced9b32-original-pull-secret\") pod \"global-pull-secret-syncer-7fmhc\" (UID: \"329479f3-ad8b-4d55-8902-fd524ced9b32\") " pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:10.532277 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530838    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-host-run-netns\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.532277 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530860    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-etc-systemd\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.532277 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530876    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-lib-modules\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.532277 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530892    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-hostroot\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.532277 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530907    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-multus-conf-dir\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.532277 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530925    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66g2h\" (UniqueName: \"kubernetes.io/projected/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-kube-api-access-66g2h\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.532277 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530940    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzx7g\" (UniqueName: \"kubernetes.io/projected/38dce886-864e-4891-aa0c-80b892634b99-kube-api-access-rzx7g\") pod \"node-resolver-tttht\" (UID: \"38dce886-864e-4891-aa0c-80b892634b99\") " pod="openshift-dns/node-resolver-tttht"
Jul 21 20:14:10.532277 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530966    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb6jx\" (UniqueName: \"kubernetes.io/projected/92f34183-cb25-480d-9553-2f38678d8132-kube-api-access-rb6jx\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.532277 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.530988    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs\") pod \"network-metrics-daemon-q9fp4\" (UID: \"3712cffa-e355-4c1e-9d88-b133a9eec5b4\") " pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:10.532837 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.531013    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7-registration-dir\") pod \"aws-ebs-csi-driver-node-ntf8z\" (UID: \"c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z"
Jul 21 20:14:10.532837 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.531031    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-etc-openvswitch\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.532837 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:10.531075    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:14:10.532837 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.531081    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7-registration-dir\") pod \"aws-ebs-csi-driver-node-ntf8z\" (UID: \"c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z"
Jul 21 20:14:10.532837 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.531092    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-host-cni-netd\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.532837 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.531101    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-etc-openvswitch\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.532837 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:10.531154    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs podName:3712cffa-e355-4c1e-9d88-b133a9eec5b4 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:11.031135094 +0000 UTC m=+1.963533234 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs") pod "network-metrics-daemon-q9fp4" (UID: "3712cffa-e355-4c1e-9d88-b133a9eec5b4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:14:10.532837 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.531170    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/38dce886-864e-4891-aa0c-80b892634b99-hosts-file\") pod \"node-resolver-tttht\" (UID: \"38dce886-864e-4891-aa0c-80b892634b99\") " pod="openshift-dns/node-resolver-tttht"
Jul 21 20:14:10.532837 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.531195    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/55f51c26-71cd-4e1b-84f2-32f2de4138d5-host-cni-netd\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.532837 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.531225    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-host-var-lib-cni-multus\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.532837 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.531250    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ntf8z\" (UID: \"c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z"
Jul 21 20:14:10.532837 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.531281    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ntf8z\" (UID: \"c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z"
Jul 21 20:14:10.532837 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.531285    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/abe5ed79-25df-4e07-a3b4-c8014119e03e-konnectivity-ca\") pod \"konnectivity-agent-46pn7\" (UID: \"abe5ed79-25df-4e07-a3b4-c8014119e03e\") " pod="kube-system/konnectivity-agent-46pn7"
Jul 21 20:14:10.532837 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.531318    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-multus-cni-dir\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.532837 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.531339    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-host-run-multus-certs\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.533779 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.533745    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/55f51c26-71cd-4e1b-84f2-32f2de4138d5-ovn-node-metrics-cert\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.541818 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:10.541790    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 20:14:10.541818 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:10.541818    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 20:14:10.541994 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:10.541834    2576 projected.go:196] Error preparing data for projected volume kube-api-access-q72jr for pod openshift-network-diagnostics/network-check-target-5ls7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:14:10.541994 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:10.541926    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e6c7adb-e703-4f33-af51-22fc05e06d23-kube-api-access-q72jr podName:4e6c7adb-e703-4f33-af51-22fc05e06d23 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:11.041905896 +0000 UTC m=+1.974304036 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-q72jr" (UniqueName: "kubernetes.io/projected/4e6c7adb-e703-4f33-af51-22fc05e06d23-kube-api-access-q72jr") pod "network-check-target-5ls7f" (UID: "4e6c7adb-e703-4f33-af51-22fc05e06d23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:14:10.544361 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.544336    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdz59\" (UniqueName: \"kubernetes.io/projected/3712cffa-e355-4c1e-9d88-b133a9eec5b4-kube-api-access-sdz59\") pod \"network-metrics-daemon-q9fp4\" (UID: \"3712cffa-e355-4c1e-9d88-b133a9eec5b4\") " pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:10.544858 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.544835    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f965\" (UniqueName: \"kubernetes.io/projected/adf41cf7-7a06-4eb9-9e21-a2a861e137f6-kube-api-access-9f965\") pod \"multus-additional-cni-plugins-bdpzc\" (UID: \"adf41cf7-7a06-4eb9-9e21-a2a861e137f6\") " pod="openshift-multus/multus-additional-cni-plugins-bdpzc"
Jul 21 20:14:10.545007 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.544989    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t6hn\" (UniqueName: \"kubernetes.io/projected/c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7-kube-api-access-9t6hn\") pod \"aws-ebs-csi-driver-node-ntf8z\" (UID: \"c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z"
Jul 21 20:14:10.545367 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.545348    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8xpp\" (UniqueName: \"kubernetes.io/projected/55f51c26-71cd-4e1b-84f2-32f2de4138d5-kube-api-access-w8xpp\") pod \"ovnkube-node-54f9x\" (UID: \"55f51c26-71cd-4e1b-84f2-32f2de4138d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.631684 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.631648    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-host-run-k8s-cni-cncf-io\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.631684 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.631685    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/329479f3-ad8b-4d55-8902-fd524ced9b32-kubelet-config\") pod \"global-pull-secret-syncer-7fmhc\" (UID: \"329479f3-ad8b-4d55-8902-fd524ced9b32\") " pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:10.631913 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.631720    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-os-release\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.631913 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.631779    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-host-run-k8s-cni-cncf-io\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.631913 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.631803    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/329479f3-ad8b-4d55-8902-fd524ced9b32-kubelet-config\") pod \"global-pull-secret-syncer-7fmhc\" (UID: \"329479f3-ad8b-4d55-8902-fd524ced9b32\") " pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:10.631913 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.631778    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/92f34183-cb25-480d-9553-2f38678d8132-multus-daemon-config\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.631913 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.631829    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-os-release\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.631913 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.631844    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/20c1b2ab-1a68-456f-bf0c-53417e458643-serviceca\") pod \"node-ca-j55fg\" (UID: \"20c1b2ab-1a68-456f-bf0c-53417e458643\") " pod="openshift-image-registry/node-ca-j55fg"
Jul 21 20:14:10.631913 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.631863    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-etc-kubernetes\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.631913 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.631891    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-var-lib-kubelet\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.632501 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.631918    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38dce886-864e-4891-aa0c-80b892634b99-tmp-dir\") pod \"node-resolver-tttht\" (UID: \"38dce886-864e-4891-aa0c-80b892634b99\") " pod="openshift-dns/node-resolver-tttht"
Jul 21 20:14:10.632501 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.631945    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dksqx\" (UniqueName: \"kubernetes.io/projected/d32959ad-b973-4850-8f1f-9c135930cbdb-kube-api-access-dksqx\") pod \"iptables-alerter-7pgtc\" (UID: \"d32959ad-b973-4850-8f1f-9c135930cbdb\") " pod="openshift-network-operator/iptables-alerter-7pgtc"
Jul 21 20:14:10.632501 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.631959    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-etc-kubernetes\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.632501 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.631974    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-host\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.632501 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.631978    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-var-lib-kubelet\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.632501 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632032    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-host-run-netns\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.632501 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632062    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-host-run-netns\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.632501 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632033    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-host\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.632501 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632085    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/329479f3-ad8b-4d55-8902-fd524ced9b32-original-pull-secret\") pod \"global-pull-secret-syncer-7fmhc\" (UID: \"329479f3-ad8b-4d55-8902-fd524ced9b32\") " pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:10.632501 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632116    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-etc-systemd\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.632501 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632138    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-lib-modules\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.632501 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632154    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-hostroot\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.632501 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:10.632165    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 20:14:10.632501 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632187    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-etc-systemd\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.632501 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632203    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-multus-conf-dir\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.632501 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632169    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-multus-conf-dir\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.632501 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:10.632227    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/329479f3-ad8b-4d55-8902-fd524ced9b32-original-pull-secret podName:329479f3-ad8b-4d55-8902-fd524ced9b32 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:11.132207539 +0000 UTC m=+2.064605684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/329479f3-ad8b-4d55-8902-fd524ced9b32-original-pull-secret") pod "global-pull-secret-syncer-7fmhc" (UID: "329479f3-ad8b-4d55-8902-fd524ced9b32") : object "kube-system"/"original-pull-secret" not registered
Jul 21 20:14:10.632501 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632242    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-hostroot\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.633367 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632278    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38dce886-864e-4891-aa0c-80b892634b99-tmp-dir\") pod \"node-resolver-tttht\" (UID: \"38dce886-864e-4891-aa0c-80b892634b99\") " pod="openshift-dns/node-resolver-tttht"
Jul 21 20:14:10.633367 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632293    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-lib-modules\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.633367 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632281    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66g2h\" (UniqueName: \"kubernetes.io/projected/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-kube-api-access-66g2h\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.633367 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632376    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzx7g\" (UniqueName: \"kubernetes.io/projected/38dce886-864e-4891-aa0c-80b892634b99-kube-api-access-rzx7g\") pod \"node-resolver-tttht\" (UID: \"38dce886-864e-4891-aa0c-80b892634b99\") " pod="openshift-dns/node-resolver-tttht"
Jul 21 20:14:10.633367 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632404    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb6jx\" (UniqueName: \"kubernetes.io/projected/92f34183-cb25-480d-9553-2f38678d8132-kube-api-access-rb6jx\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.633367 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632406    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/20c1b2ab-1a68-456f-bf0c-53417e458643-serviceca\") pod \"node-ca-j55fg\" (UID: \"20c1b2ab-1a68-456f-bf0c-53417e458643\") " pod="openshift-image-registry/node-ca-j55fg"
Jul 21 20:14:10.633367 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632416    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/92f34183-cb25-480d-9553-2f38678d8132-multus-daemon-config\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.633367 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632446    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/38dce886-864e-4891-aa0c-80b892634b99-hosts-file\") pod \"node-resolver-tttht\" (UID: \"38dce886-864e-4891-aa0c-80b892634b99\") " pod="openshift-dns/node-resolver-tttht"
Jul 21 20:14:10.633367 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632474    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-host-var-lib-cni-multus\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.633367 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632493    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/38dce886-864e-4891-aa0c-80b892634b99-hosts-file\") pod \"node-resolver-tttht\" (UID: \"38dce886-864e-4891-aa0c-80b892634b99\") " pod="openshift-dns/node-resolver-tttht"
Jul 21 20:14:10.633367 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632502    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/abe5ed79-25df-4e07-a3b4-c8014119e03e-konnectivity-ca\") pod \"konnectivity-agent-46pn7\" (UID: \"abe5ed79-25df-4e07-a3b4-c8014119e03e\") " pod="kube-system/konnectivity-agent-46pn7"
Jul 21 20:14:10.633367 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632525    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-multus-cni-dir\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.633367 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632552    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-host-run-multus-certs\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.633367 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632526    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-host-var-lib-cni-multus\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.633367 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632577    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/329479f3-ad8b-4d55-8902-fd524ced9b32-dbus\") pod \"global-pull-secret-syncer-7fmhc\" (UID: \"329479f3-ad8b-4d55-8902-fd524ced9b32\") " pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:10.633367 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632601    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-sys\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.633367 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632610    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-host-run-multus-certs\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.633367 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632636    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-etc-kubernetes\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.634279 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632666    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d32959ad-b973-4850-8f1f-9c135930cbdb-iptables-alerter-script\") pod \"iptables-alerter-7pgtc\" (UID: \"d32959ad-b973-4850-8f1f-9c135930cbdb\") " pod="openshift-network-operator/iptables-alerter-7pgtc"
Jul 21 20:14:10.634279 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632685    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-etc-kubernetes\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.634279 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632660    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-sys\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.634279 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632720    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-etc-sysconfig\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.634279 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632740    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/329479f3-ad8b-4d55-8902-fd524ced9b32-dbus\") pod \"global-pull-secret-syncer-7fmhc\" (UID: \"329479f3-ad8b-4d55-8902-fd524ced9b32\") " pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:10.634279 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632746    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-multus-cni-dir\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.634279 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632769    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-etc-sysconfig\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.634279 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632788    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-tmp\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.634279 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632831    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-host-var-lib-cni-bin\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.634279 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632861    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/abe5ed79-25df-4e07-a3b4-c8014119e03e-agent-certs\") pod \"konnectivity-agent-46pn7\" (UID: \"abe5ed79-25df-4e07-a3b4-c8014119e03e\") " pod="kube-system/konnectivity-agent-46pn7"
Jul 21 20:14:10.634279 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632890    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-host-var-lib-cni-bin\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.634279 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632895    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-multus-socket-dir-parent\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.634279 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632940    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-etc-sysctl-d\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.634279 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632969    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-etc-tuned\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.634279 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632996    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-system-cni-dir\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.634279 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.633021    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20c1b2ab-1a68-456f-bf0c-53417e458643-host\") pod \"node-ca-j55fg\" (UID: \"20c1b2ab-1a68-456f-bf0c-53417e458643\") " pod="openshift-image-registry/node-ca-j55fg"
Jul 21 20:14:10.634279 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.633037    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/abe5ed79-25df-4e07-a3b4-c8014119e03e-konnectivity-ca\") pod \"konnectivity-agent-46pn7\" (UID: \"abe5ed79-25df-4e07-a3b4-c8014119e03e\") " pod="kube-system/konnectivity-agent-46pn7"
Jul 21 20:14:10.634279 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.633043    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-etc-modprobe-d\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.635202 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.633071    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-run\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.635202 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.633076    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-etc-sysctl-d\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.635202 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.633094    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/92f34183-cb25-480d-9553-2f38678d8132-cni-binary-copy\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.635202 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.632941    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-multus-socket-dir-parent\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.635202 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.633110    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-system-cni-dir\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.635202 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.633151    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-host-var-lib-kubelet\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.635202 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.633160    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20c1b2ab-1a68-456f-bf0c-53417e458643-host\") pod \"node-ca-j55fg\" (UID: \"20c1b2ab-1a68-456f-bf0c-53417e458643\") " pod="openshift-image-registry/node-ca-j55fg"
Jul 21 20:14:10.635202 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.633188    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d32959ad-b973-4850-8f1f-9c135930cbdb-host-slash\") pod \"iptables-alerter-7pgtc\" (UID: \"d32959ad-b973-4850-8f1f-9c135930cbdb\") " pod="openshift-network-operator/iptables-alerter-7pgtc"
Jul 21 20:14:10.635202 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.633218    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-cnibin\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.635202 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.633220    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-host-var-lib-kubelet\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.635202 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.633223    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d32959ad-b973-4850-8f1f-9c135930cbdb-iptables-alerter-script\") pod \"iptables-alerter-7pgtc\" (UID: \"d32959ad-b973-4850-8f1f-9c135930cbdb\") " pod="openshift-network-operator/iptables-alerter-7pgtc"
Jul 21 20:14:10.635202 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.633247    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmk94\" (UniqueName: \"kubernetes.io/projected/20c1b2ab-1a68-456f-bf0c-53417e458643-kube-api-access-kmk94\") pod \"node-ca-j55fg\" (UID: \"20c1b2ab-1a68-456f-bf0c-53417e458643\") " pod="openshift-image-registry/node-ca-j55fg"
Jul 21 20:14:10.635202 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.633274    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-etc-sysctl-conf\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.635202 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.633296    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-etc-modprobe-d\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.635202 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.633281    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-run\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.635202 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.633390    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/92f34183-cb25-480d-9553-2f38678d8132-cnibin\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.635202 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.633410    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-etc-sysctl-conf\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.635202 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.633414    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d32959ad-b973-4850-8f1f-9c135930cbdb-host-slash\") pod \"iptables-alerter-7pgtc\" (UID: \"d32959ad-b973-4850-8f1f-9c135930cbdb\") " pod="openshift-network-operator/iptables-alerter-7pgtc"
Jul 21 20:14:10.636066 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.633587    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/92f34183-cb25-480d-9553-2f38678d8132-cni-binary-copy\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.636066 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.635390    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-etc-tuned\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.636066 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.635500    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-tmp\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.636066 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.636000    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/abe5ed79-25df-4e07-a3b4-c8014119e03e-agent-certs\") pod \"konnectivity-agent-46pn7\" (UID: \"abe5ed79-25df-4e07-a3b4-c8014119e03e\") " pod="kube-system/konnectivity-agent-46pn7"
Jul 21 20:14:10.645354 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.645325    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66g2h\" (UniqueName: \"kubernetes.io/projected/1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83-kube-api-access-66g2h\") pod \"tuned-sxdjr\" (UID: \"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83\") " pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.645481 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.645333    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dksqx\" (UniqueName: \"kubernetes.io/projected/d32959ad-b973-4850-8f1f-9c135930cbdb-kube-api-access-dksqx\") pod \"iptables-alerter-7pgtc\" (UID: \"d32959ad-b973-4850-8f1f-9c135930cbdb\") " pod="openshift-network-operator/iptables-alerter-7pgtc"
Jul 21 20:14:10.645481 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.645399    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzx7g\" (UniqueName: \"kubernetes.io/projected/38dce886-864e-4891-aa0c-80b892634b99-kube-api-access-rzx7g\") pod \"node-resolver-tttht\" (UID: \"38dce886-864e-4891-aa0c-80b892634b99\") " pod="openshift-dns/node-resolver-tttht"
Jul 21 20:14:10.646973 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.646941    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmk94\" (UniqueName: \"kubernetes.io/projected/20c1b2ab-1a68-456f-bf0c-53417e458643-kube-api-access-kmk94\") pod \"node-ca-j55fg\" (UID: \"20c1b2ab-1a68-456f-bf0c-53417e458643\") " pod="openshift-image-registry/node-ca-j55fg"
Jul 21 20:14:10.647560 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.647542    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb6jx\" (UniqueName: \"kubernetes.io/projected/92f34183-cb25-480d-9553-2f38678d8132-kube-api-access-rb6jx\") pod \"multus-tc85m\" (UID: \"92f34183-cb25-480d-9553-2f38678d8132\") " pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.744894 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.744801    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bdpzc"
Jul 21 20:14:10.762936 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.762909    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z"
Jul 21 20:14:10.780424 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.780386    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:10.792611 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.792552    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-46pn7"
Jul 21 20:14:10.807621 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.807589    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sxdjr"
Jul 21 20:14:10.825670 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.825637    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j55fg"
Jul 21 20:14:10.840797 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.840760    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tttht"
Jul 21 20:14:10.862985 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.862949    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tc85m"
Jul 21 20:14:10.867803 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.867778    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7pgtc"
Jul 21 20:14:10.891171 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:10.891128    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aaf5d7e58116369463822b045e52d90.slice/crio-c7e29f438c0d42688633be6c7c0a86448f3db2bede9215b4d35ec800f9c6abb8 WatchSource:0}: Error finding container c7e29f438c0d42688633be6c7c0a86448f3db2bede9215b4d35ec800f9c6abb8: Status 404 returned error can't find the container with id c7e29f438c0d42688633be6c7c0a86448f3db2bede9215b4d35ec800f9c6abb8
Jul 21 20:14:10.891560 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:10.891539    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92f34183_cb25_480d_9553_2f38678d8132.slice/crio-06673424206f1c06dc59fd3b1bb475c447601a5513dd15eb1acb1791de7301fe WatchSource:0}: Error finding container 06673424206f1c06dc59fd3b1bb475c447601a5513dd15eb1acb1791de7301fe: Status 404 returned error can't find the container with id 06673424206f1c06dc59fd3b1bb475c447601a5513dd15eb1acb1791de7301fe
Jul 21 20:14:10.892409 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:10.892381    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd32959ad_b973_4850_8f1f_9c135930cbdb.slice/crio-88e214e44cd594cdc6c0c8a3f02a38d71543220e717643e0e703b962948034fa WatchSource:0}: Error finding container 88e214e44cd594cdc6c0c8a3f02a38d71543220e717643e0e703b962948034fa: Status 404 returned error can't find the container with id 88e214e44cd594cdc6c0c8a3f02a38d71543220e717643e0e703b962948034fa
Jul 21 20:14:10.893190 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:10.893166    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc92ea5607a4c49d38cbe93e974df244d.slice/crio-6666ee58732a051aaa3c6bce360a3ad5e76d26c7554d2dcaecd064f8af9e021f WatchSource:0}: Error finding container 6666ee58732a051aaa3c6bce360a3ad5e76d26c7554d2dcaecd064f8af9e021f: Status 404 returned error can't find the container with id 6666ee58732a051aaa3c6bce360a3ad5e76d26c7554d2dcaecd064f8af9e021f
Jul 21 20:14:10.896412 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:10.896392    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 20:14:11.037533 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:11.037446    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs\") pod \"network-metrics-daemon-q9fp4\" (UID: \"3712cffa-e355-4c1e-9d88-b133a9eec5b4\") " pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:11.037681 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:11.037566    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:14:11.037681 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:11.037627    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs podName:3712cffa-e355-4c1e-9d88-b133a9eec5b4 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:12.037612528 +0000 UTC m=+2.970010664 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs") pod "network-metrics-daemon-q9fp4" (UID: "3712cffa-e355-4c1e-9d88-b133a9eec5b4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:14:11.137948 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:11.137898    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q72jr\" (UniqueName: \"kubernetes.io/projected/4e6c7adb-e703-4f33-af51-22fc05e06d23-kube-api-access-q72jr\") pod \"network-check-target-5ls7f\" (UID: \"4e6c7adb-e703-4f33-af51-22fc05e06d23\") " pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:14:11.137948 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:11.137951    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/329479f3-ad8b-4d55-8902-fd524ced9b32-original-pull-secret\") pod \"global-pull-secret-syncer-7fmhc\" (UID: \"329479f3-ad8b-4d55-8902-fd524ced9b32\") " pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:11.138164 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:11.138053    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 20:14:11.138164 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:11.138076    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 20:14:11.138164 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:11.138099    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 20:14:11.138164 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:11.138110    2576 projected.go:196] Error preparing data for projected volume kube-api-access-q72jr for pod openshift-network-diagnostics/network-check-target-5ls7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:14:11.138164 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:11.138113    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/329479f3-ad8b-4d55-8902-fd524ced9b32-original-pull-secret podName:329479f3-ad8b-4d55-8902-fd524ced9b32 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:12.138097463 +0000 UTC m=+3.070495622 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/329479f3-ad8b-4d55-8902-fd524ced9b32-original-pull-secret") pod "global-pull-secret-syncer-7fmhc" (UID: "329479f3-ad8b-4d55-8902-fd524ced9b32") : object "kube-system"/"original-pull-secret" not registered
Jul 21 20:14:11.138164 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:11.138153    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e6c7adb-e703-4f33-af51-22fc05e06d23-kube-api-access-q72jr podName:4e6c7adb-e703-4f33-af51-22fc05e06d23 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:12.138138927 +0000 UTC m=+3.070537063 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-q72jr" (UniqueName: "kubernetes.io/projected/4e6c7adb-e703-4f33-af51-22fc05e06d23-kube-api-access-q72jr") pod "network-check-target-5ls7f" (UID: "4e6c7adb-e703-4f33-af51-22fc05e06d23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:14:11.173421 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:11.173390    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20c1b2ab_1a68_456f_bf0c_53417e458643.slice/crio-d46277af206bfe4bc386c7e503d1566457e8860a859d3b6173fb96718215a2a2 WatchSource:0}: Error finding container d46277af206bfe4bc386c7e503d1566457e8860a859d3b6173fb96718215a2a2: Status 404 returned error can't find the container with id d46277af206bfe4bc386c7e503d1566457e8860a859d3b6173fb96718215a2a2
Jul 21 20:14:11.197034 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:11.196998    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55f51c26_71cd_4e1b_84f2_32f2de4138d5.slice/crio-21dae5f45382441d8f3a3841b4af60c5e913f8bfd9d92aedee505062aca8d116 WatchSource:0}: Error finding container 21dae5f45382441d8f3a3841b4af60c5e913f8bfd9d92aedee505062aca8d116: Status 404 returned error can't find the container with id 21dae5f45382441d8f3a3841b4af60c5e913f8bfd9d92aedee505062aca8d116
Jul 21 20:14:11.200203 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:11.200173    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf41cf7_7a06_4eb9_9e21_a2a861e137f6.slice/crio-b0249f8885f4ff265cfe0792b6c8bb5dff5ef79826e68bfdfba19bd66e0eb0c4 WatchSource:0}: Error finding container b0249f8885f4ff265cfe0792b6c8bb5dff5ef79826e68bfdfba19bd66e0eb0c4: Status 404 returned error can't find the container with id b0249f8885f4ff265cfe0792b6c8bb5dff5ef79826e68bfdfba19bd66e0eb0c4
Jul 21 20:14:11.255574 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:11.255528    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e1ffa3d_d18a_4ad2_906a_771b1d2d0f83.slice/crio-dc341eeaea661a7efa2498a59fe1570e12142a05ef602b0e3f7fa243c071ce08 WatchSource:0}: Error finding container dc341eeaea661a7efa2498a59fe1570e12142a05ef602b0e3f7fa243c071ce08: Status 404 returned error can't find the container with id dc341eeaea661a7efa2498a59fe1570e12142a05ef602b0e3f7fa243c071ce08
Jul 21 20:14:11.285015 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:11.284969    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8efa2eb_95c5_452a_b2ec_7cf2f14cd9b7.slice/crio-ac8c14fa8eb7298226c4f98eb63c098c16d6a88306259ee6f40a549ca86b779a WatchSource:0}: Error finding container ac8c14fa8eb7298226c4f98eb63c098c16d6a88306259ee6f40a549ca86b779a: Status 404 returned error can't find the container with id ac8c14fa8eb7298226c4f98eb63c098c16d6a88306259ee6f40a549ca86b779a
Jul 21 20:14:11.304260 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:11.304224    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38dce886_864e_4891_aa0c_80b892634b99.slice/crio-cbb87b050aa34ff697ba09f22747b742d32b01578427e351922e91c21ed6d635 WatchSource:0}: Error finding container cbb87b050aa34ff697ba09f22747b742d32b01578427e351922e91c21ed6d635: Status 404 returned error can't find the container with id cbb87b050aa34ff697ba09f22747b742d32b01578427e351922e91c21ed6d635
Jul 21 20:14:11.408984 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:11.408944    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 20:14:11.468553 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:11.468421    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 20:09:10 +0000 UTC" deadline="2027-12-30 22:02:19.327774962 +0000 UTC"
Jul 21 20:14:11.468553 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:11.468487    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12649h48m7.859292664s"
Jul 21 20:14:11.648519 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:11.648482    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:14:11.648698 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:11.648625    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ls7f" podUID="4e6c7adb-e703-4f33-af51-22fc05e06d23"
Jul 21 20:14:11.649090 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:11.649066    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:11.649188 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:11.649172    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7fmhc" podUID="329479f3-ad8b-4d55-8902-fd524ced9b32"
Jul 21 20:14:11.655449 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:11.655387    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sxdjr" event={"ID":"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83","Type":"ContainerStarted","Data":"dc341eeaea661a7efa2498a59fe1570e12142a05ef602b0e3f7fa243c071ce08"}
Jul 21 20:14:11.659382 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:11.659350    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j55fg" event={"ID":"20c1b2ab-1a68-456f-bf0c-53417e458643","Type":"ContainerStarted","Data":"d46277af206bfe4bc386c7e503d1566457e8860a859d3b6173fb96718215a2a2"}
Jul 21 20:14:11.661669 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:11.661603    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-201.ec2.internal" event={"ID":"6aaf5d7e58116369463822b045e52d90","Type":"ContainerStarted","Data":"c7e29f438c0d42688633be6c7c0a86448f3db2bede9215b4d35ec800f9c6abb8"}
Jul 21 20:14:11.664139 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:11.664112    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tc85m" event={"ID":"92f34183-cb25-480d-9553-2f38678d8132","Type":"ContainerStarted","Data":"06673424206f1c06dc59fd3b1bb475c447601a5513dd15eb1acb1791de7301fe"}
Jul 21 20:14:11.666349 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:11.666324    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-201.ec2.internal" event={"ID":"c92ea5607a4c49d38cbe93e974df244d","Type":"ContainerStarted","Data":"6666ee58732a051aaa3c6bce360a3ad5e76d26c7554d2dcaecd064f8af9e021f"}
Jul 21 20:14:11.670595 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:11.670540    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bdpzc" event={"ID":"adf41cf7-7a06-4eb9-9e21-a2a861e137f6","Type":"ContainerStarted","Data":"b0249f8885f4ff265cfe0792b6c8bb5dff5ef79826e68bfdfba19bd66e0eb0c4"}
Jul 21 20:14:11.673360 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:11.673331    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-54f9x" event={"ID":"55f51c26-71cd-4e1b-84f2-32f2de4138d5","Type":"ContainerStarted","Data":"21dae5f45382441d8f3a3841b4af60c5e913f8bfd9d92aedee505062aca8d116"}
Jul 21 20:14:11.675346 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:11.675317    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7pgtc" event={"ID":"d32959ad-b973-4850-8f1f-9c135930cbdb","Type":"ContainerStarted","Data":"88e214e44cd594cdc6c0c8a3f02a38d71543220e717643e0e703b962948034fa"}
Jul 21 20:14:11.679040 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:11.679003    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-46pn7" event={"ID":"abe5ed79-25df-4e07-a3b4-c8014119e03e","Type":"ContainerStarted","Data":"269d10ab2e3a7cbfcd075800dbea8bbb209b29923b6caab6434edd5b5f75262f"}
Jul 21 20:14:11.680818 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:11.680790    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tttht" event={"ID":"38dce886-864e-4891-aa0c-80b892634b99","Type":"ContainerStarted","Data":"cbb87b050aa34ff697ba09f22747b742d32b01578427e351922e91c21ed6d635"}
Jul 21 20:14:11.683494 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:11.683469    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z" event={"ID":"c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7","Type":"ContainerStarted","Data":"ac8c14fa8eb7298226c4f98eb63c098c16d6a88306259ee6f40a549ca86b779a"}
Jul 21 20:14:12.046842 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:12.046303    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs\") pod \"network-metrics-daemon-q9fp4\" (UID: \"3712cffa-e355-4c1e-9d88-b133a9eec5b4\") " pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:12.046842 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:12.046474    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:14:12.046842 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:12.046545    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs podName:3712cffa-e355-4c1e-9d88-b133a9eec5b4 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:14.046525014 +0000 UTC m=+4.978923161 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs") pod "network-metrics-daemon-q9fp4" (UID: "3712cffa-e355-4c1e-9d88-b133a9eec5b4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:14:12.085168 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:12.084926    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 20:14:12.147025 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:12.146983    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/329479f3-ad8b-4d55-8902-fd524ced9b32-original-pull-secret\") pod \"global-pull-secret-syncer-7fmhc\" (UID: \"329479f3-ad8b-4d55-8902-fd524ced9b32\") " pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:12.147229 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:12.147105    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q72jr\" (UniqueName: \"kubernetes.io/projected/4e6c7adb-e703-4f33-af51-22fc05e06d23-kube-api-access-q72jr\") pod \"network-check-target-5ls7f\" (UID: \"4e6c7adb-e703-4f33-af51-22fc05e06d23\") " pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:14:12.147294 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:12.147263    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 20:14:12.147294 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:12.147284    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 20:14:12.147413 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:12.147298    2576 projected.go:196] Error preparing data for projected volume kube-api-access-q72jr for pod openshift-network-diagnostics/network-check-target-5ls7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:14:12.147413 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:12.147360    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e6c7adb-e703-4f33-af51-22fc05e06d23-kube-api-access-q72jr podName:4e6c7adb-e703-4f33-af51-22fc05e06d23 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:14.147339879 +0000 UTC m=+5.079738022 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-q72jr" (UniqueName: "kubernetes.io/projected/4e6c7adb-e703-4f33-af51-22fc05e06d23-kube-api-access-q72jr") pod "network-check-target-5ls7f" (UID: "4e6c7adb-e703-4f33-af51-22fc05e06d23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:14:12.147847 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:12.147813    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 20:14:12.147932 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:12.147870    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/329479f3-ad8b-4d55-8902-fd524ced9b32-original-pull-secret podName:329479f3-ad8b-4d55-8902-fd524ced9b32 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:14.147853128 +0000 UTC m=+5.080251270 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/329479f3-ad8b-4d55-8902-fd524ced9b32-original-pull-secret") pod "global-pull-secret-syncer-7fmhc" (UID: "329479f3-ad8b-4d55-8902-fd524ced9b32") : object "kube-system"/"original-pull-secret" not registered
Jul 21 20:14:12.469772 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:12.469634    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 20:09:10 +0000 UTC" deadline="2028-04-22 02:14:57.86005208 +0000 UTC"
Jul 21 20:14:12.469772 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:12.469677    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15366h0m45.390379314s"
Jul 21 20:14:12.645592 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:12.645438    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:12.645818 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:12.645603    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9fp4" podUID="3712cffa-e355-4c1e-9d88-b133a9eec5b4"
Jul 21 20:14:13.218496 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:13.218398    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 20:14:13.649402 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:13.648419    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:14:13.649402 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:13.648551    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ls7f" podUID="4e6c7adb-e703-4f33-af51-22fc05e06d23"
Jul 21 20:14:13.649402 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:13.649110    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:13.649402 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:13.649211    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7fmhc" podUID="329479f3-ad8b-4d55-8902-fd524ced9b32"
Jul 21 20:14:14.070799 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:14.070699    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs\") pod \"network-metrics-daemon-q9fp4\" (UID: \"3712cffa-e355-4c1e-9d88-b133a9eec5b4\") " pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:14.070978 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:14.070869    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:14:14.070978 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:14.070941    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs podName:3712cffa-e355-4c1e-9d88-b133a9eec5b4 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:18.070920378 +0000 UTC m=+9.003318537 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs") pod "network-metrics-daemon-q9fp4" (UID: "3712cffa-e355-4c1e-9d88-b133a9eec5b4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:14:14.171639 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:14.171601    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q72jr\" (UniqueName: \"kubernetes.io/projected/4e6c7adb-e703-4f33-af51-22fc05e06d23-kube-api-access-q72jr\") pod \"network-check-target-5ls7f\" (UID: \"4e6c7adb-e703-4f33-af51-22fc05e06d23\") " pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:14:14.171861 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:14.171661    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/329479f3-ad8b-4d55-8902-fd524ced9b32-original-pull-secret\") pod \"global-pull-secret-syncer-7fmhc\" (UID: \"329479f3-ad8b-4d55-8902-fd524ced9b32\") " pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:14.171861 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:14.171853    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 20:14:14.171990 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:14.171922    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/329479f3-ad8b-4d55-8902-fd524ced9b32-original-pull-secret podName:329479f3-ad8b-4d55-8902-fd524ced9b32 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:18.171900106 +0000 UTC m=+9.104298250 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/329479f3-ad8b-4d55-8902-fd524ced9b32-original-pull-secret") pod "global-pull-secret-syncer-7fmhc" (UID: "329479f3-ad8b-4d55-8902-fd524ced9b32") : object "kube-system"/"original-pull-secret" not registered
Jul 21 20:14:14.172403 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:14.172375    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 20:14:14.172403 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:14.172404    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 20:14:14.172545 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:14.172418    2576 projected.go:196] Error preparing data for projected volume kube-api-access-q72jr for pod openshift-network-diagnostics/network-check-target-5ls7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:14:14.172545 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:14.172470    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e6c7adb-e703-4f33-af51-22fc05e06d23-kube-api-access-q72jr podName:4e6c7adb-e703-4f33-af51-22fc05e06d23 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:18.172452524 +0000 UTC m=+9.104850663 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-q72jr" (UniqueName: "kubernetes.io/projected/4e6c7adb-e703-4f33-af51-22fc05e06d23-kube-api-access-q72jr") pod "network-check-target-5ls7f" (UID: "4e6c7adb-e703-4f33-af51-22fc05e06d23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:14:14.646441 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:14.645943    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:14.646441 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:14.646086    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9fp4" podUID="3712cffa-e355-4c1e-9d88-b133a9eec5b4"
Jul 21 20:14:15.646130 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:15.646094    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:14:15.646589 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:15.646237    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ls7f" podUID="4e6c7adb-e703-4f33-af51-22fc05e06d23"
Jul 21 20:14:15.646713 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:15.646647    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:15.646785 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:15.646759    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7fmhc" podUID="329479f3-ad8b-4d55-8902-fd524ced9b32"
Jul 21 20:14:16.645358 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:16.645321    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:16.645547 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:16.645479    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9fp4" podUID="3712cffa-e355-4c1e-9d88-b133a9eec5b4"
Jul 21 20:14:17.646236 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:17.645850    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:14:17.646236 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:17.645990    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ls7f" podUID="4e6c7adb-e703-4f33-af51-22fc05e06d23"
Jul 21 20:14:17.646781 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:17.646345    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:17.646781 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:17.646466    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7fmhc" podUID="329479f3-ad8b-4d55-8902-fd524ced9b32"
Jul 21 20:14:18.108652 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:18.108609    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs\") pod \"network-metrics-daemon-q9fp4\" (UID: \"3712cffa-e355-4c1e-9d88-b133a9eec5b4\") " pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:18.108876 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:18.108806    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:14:18.109357 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:18.108965    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs podName:3712cffa-e355-4c1e-9d88-b133a9eec5b4 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:26.108938361 +0000 UTC m=+17.041336517 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs") pod "network-metrics-daemon-q9fp4" (UID: "3712cffa-e355-4c1e-9d88-b133a9eec5b4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:14:18.209860 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:18.209818    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q72jr\" (UniqueName: \"kubernetes.io/projected/4e6c7adb-e703-4f33-af51-22fc05e06d23-kube-api-access-q72jr\") pod \"network-check-target-5ls7f\" (UID: \"4e6c7adb-e703-4f33-af51-22fc05e06d23\") " pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:14:18.210048 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:18.209882    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/329479f3-ad8b-4d55-8902-fd524ced9b32-original-pull-secret\") pod \"global-pull-secret-syncer-7fmhc\" (UID: \"329479f3-ad8b-4d55-8902-fd524ced9b32\") " pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:18.210113 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:18.210093    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 20:14:18.210184 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:18.210170    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/329479f3-ad8b-4d55-8902-fd524ced9b32-original-pull-secret podName:329479f3-ad8b-4d55-8902-fd524ced9b32 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:26.210151184 +0000 UTC m=+17.142549322 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/329479f3-ad8b-4d55-8902-fd524ced9b32-original-pull-secret") pod "global-pull-secret-syncer-7fmhc" (UID: "329479f3-ad8b-4d55-8902-fd524ced9b32") : object "kube-system"/"original-pull-secret" not registered
Jul 21 20:14:18.210496 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:18.210469    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 20:14:18.210496 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:18.210494    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 20:14:18.210626 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:18.210506    2576 projected.go:196] Error preparing data for projected volume kube-api-access-q72jr for pod openshift-network-diagnostics/network-check-target-5ls7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:14:18.210626 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:18.210553    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e6c7adb-e703-4f33-af51-22fc05e06d23-kube-api-access-q72jr podName:4e6c7adb-e703-4f33-af51-22fc05e06d23 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:26.210538862 +0000 UTC m=+17.142937000 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-q72jr" (UniqueName: "kubernetes.io/projected/4e6c7adb-e703-4f33-af51-22fc05e06d23-kube-api-access-q72jr") pod "network-check-target-5ls7f" (UID: "4e6c7adb-e703-4f33-af51-22fc05e06d23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:14:18.645230 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:18.645193    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:18.645421 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:18.645338    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9fp4" podUID="3712cffa-e355-4c1e-9d88-b133a9eec5b4"
Jul 21 20:14:19.646926 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:19.646892    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:14:19.647372 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:19.647009    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ls7f" podUID="4e6c7adb-e703-4f33-af51-22fc05e06d23"
Jul 21 20:14:19.647372 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:19.647121    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:19.647372 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:19.647210    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7fmhc" podUID="329479f3-ad8b-4d55-8902-fd524ced9b32"
Jul 21 20:14:20.645873 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:20.645837    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:20.646059 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:20.645986    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9fp4" podUID="3712cffa-e355-4c1e-9d88-b133a9eec5b4"
Jul 21 20:14:21.645308 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:21.645279    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:14:21.645807 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:21.645408    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ls7f" podUID="4e6c7adb-e703-4f33-af51-22fc05e06d23"
Jul 21 20:14:21.645807 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:21.645450    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:21.645807 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:21.645538    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7fmhc" podUID="329479f3-ad8b-4d55-8902-fd524ced9b32"
Jul 21 20:14:22.645706 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:22.645659    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:22.646242 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:22.645801    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9fp4" podUID="3712cffa-e355-4c1e-9d88-b133a9eec5b4"
Jul 21 20:14:23.648041 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:23.648013    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:23.648444 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:23.648144    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7fmhc" podUID="329479f3-ad8b-4d55-8902-fd524ced9b32"
Jul 21 20:14:23.648444 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:23.648203    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:14:23.648444 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:23.648319    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ls7f" podUID="4e6c7adb-e703-4f33-af51-22fc05e06d23"
Jul 21 20:14:24.645419 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:24.645361    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:24.645609 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:24.645506    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9fp4" podUID="3712cffa-e355-4c1e-9d88-b133a9eec5b4"
Jul 21 20:14:25.650837 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:25.650811    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:14:25.651287 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:25.650813    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:25.651287 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:25.650938    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ls7f" podUID="4e6c7adb-e703-4f33-af51-22fc05e06d23"
Jul 21 20:14:25.651287 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:25.651025    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7fmhc" podUID="329479f3-ad8b-4d55-8902-fd524ced9b32"
Jul 21 20:14:26.169593 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:26.169558    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs\") pod \"network-metrics-daemon-q9fp4\" (UID: \"3712cffa-e355-4c1e-9d88-b133a9eec5b4\") " pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:26.169860 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:26.169733    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:14:26.169860 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:26.169812    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs podName:3712cffa-e355-4c1e-9d88-b133a9eec5b4 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:42.169795505 +0000 UTC m=+33.102193640 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs") pod "network-metrics-daemon-q9fp4" (UID: "3712cffa-e355-4c1e-9d88-b133a9eec5b4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:14:26.270366 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:26.270322    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q72jr\" (UniqueName: \"kubernetes.io/projected/4e6c7adb-e703-4f33-af51-22fc05e06d23-kube-api-access-q72jr\") pod \"network-check-target-5ls7f\" (UID: \"4e6c7adb-e703-4f33-af51-22fc05e06d23\") " pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:14:26.270366 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:26.270368    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/329479f3-ad8b-4d55-8902-fd524ced9b32-original-pull-secret\") pod \"global-pull-secret-syncer-7fmhc\" (UID: \"329479f3-ad8b-4d55-8902-fd524ced9b32\") " pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:26.270592 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:26.270475    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 20:14:26.270592 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:26.270508    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 20:14:26.270592 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:26.270539    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 20:14:26.270592 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:26.270542    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/329479f3-ad8b-4d55-8902-fd524ced9b32-original-pull-secret podName:329479f3-ad8b-4d55-8902-fd524ced9b32 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:42.27052175 +0000 UTC m=+33.202919908 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/329479f3-ad8b-4d55-8902-fd524ced9b32-original-pull-secret") pod "global-pull-secret-syncer-7fmhc" (UID: "329479f3-ad8b-4d55-8902-fd524ced9b32") : object "kube-system"/"original-pull-secret" not registered
Jul 21 20:14:26.270592 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:26.270553    2576 projected.go:196] Error preparing data for projected volume kube-api-access-q72jr for pod openshift-network-diagnostics/network-check-target-5ls7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:14:26.270815 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:26.270604    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e6c7adb-e703-4f33-af51-22fc05e06d23-kube-api-access-q72jr podName:4e6c7adb-e703-4f33-af51-22fc05e06d23 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:42.270587265 +0000 UTC m=+33.202985405 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-q72jr" (UniqueName: "kubernetes.io/projected/4e6c7adb-e703-4f33-af51-22fc05e06d23-kube-api-access-q72jr") pod "network-check-target-5ls7f" (UID: "4e6c7adb-e703-4f33-af51-22fc05e06d23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:14:26.645260 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:26.645229    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:26.645424 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:26.645339    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9fp4" podUID="3712cffa-e355-4c1e-9d88-b133a9eec5b4"
Jul 21 20:14:27.645852 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:27.645765    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:14:27.645852 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:27.645802    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:27.646356 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:27.645902    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ls7f" podUID="4e6c7adb-e703-4f33-af51-22fc05e06d23"
Jul 21 20:14:27.646356 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:27.646019    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7fmhc" podUID="329479f3-ad8b-4d55-8902-fd524ced9b32"
Jul 21 20:14:28.645330 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:28.645298    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:28.645511 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:28.645434    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9fp4" podUID="3712cffa-e355-4c1e-9d88-b133a9eec5b4"
Jul 21 20:14:29.646605 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:29.646491    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:14:29.647061 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:29.646655    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ls7f" podUID="4e6c7adb-e703-4f33-af51-22fc05e06d23"
Jul 21 20:14:29.647061 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:29.646737    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:29.647061 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:29.646876    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7fmhc" podUID="329479f3-ad8b-4d55-8902-fd524ced9b32"
Jul 21 20:14:30.645977 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:30.645941    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:30.646162 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:30.646080    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9fp4" podUID="3712cffa-e355-4c1e-9d88-b133a9eec5b4"
Jul 21 20:14:31.649541 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:31.649323    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:31.649936 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:31.649374    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:14:31.649936 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:31.649643    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7fmhc" podUID="329479f3-ad8b-4d55-8902-fd524ced9b32"
Jul 21 20:14:31.649936 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:31.649791    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ls7f" podUID="4e6c7adb-e703-4f33-af51-22fc05e06d23"
Jul 21 20:14:31.737939 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:31.737900    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sxdjr" event={"ID":"1e1ffa3d-d18a-4ad2-906a-771b1d2d0f83","Type":"ContainerStarted","Data":"3916f52f4dbd635638516416b8e769c224641fc741ba43a5e23304376d707f01"}
Jul 21 20:14:31.739453 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:31.739428    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tc85m" event={"ID":"92f34183-cb25-480d-9553-2f38678d8132","Type":"ContainerStarted","Data":"d661b7a91a37b65e5dadc0507335190f4ba56b33e7dbe614760639b161ba978a"}
Jul 21 20:14:31.740830 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:31.740802    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-201.ec2.internal" event={"ID":"c92ea5607a4c49d38cbe93e974df244d","Type":"ContainerStarted","Data":"7d278e8f71515ed268bcd9346e85818b96aecb74e64a3fa19e31044ad570dac5"}
Jul 21 20:14:31.793119 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:31.793066    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sxdjr" podStartSLOduration=1.6986937009999998 podStartE2EDuration="21.793049024s" totalImagesPullingTime="20.094355323s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:14:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:14:31.762177949 +0000 UTC m=+22.694576109" watchObservedRunningTime="2026-07-21 20:14:31.793049024 +0000 UTC m=+22.725447183"
Jul 21 20:14:31.827563 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:31.827517    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tc85m" podStartSLOduration=1.30387353 podStartE2EDuration="21.827493864s" totalImagesPullingTime="20.523620334s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:14:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:14:31.801334881 +0000 UTC m=+22.733733030" watchObservedRunningTime="2026-07-21 20:14:31.827493864 +0000 UTC m=+22.759892021"
Jul 21 20:14:31.827744 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:31.827646    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-201.ec2.internal" podStartSLOduration=21.827643098 podStartE2EDuration="21.827643098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:14:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:14:31.827630531 +0000 UTC m=+22.760028688" watchObservedRunningTime="2026-07-21 20:14:31.827643098 +0000 UTC m=+22.760041254"
Jul 21 20:14:32.645907 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:32.645676    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:32.646049 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:32.646025    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9fp4" podUID="3712cffa-e355-4c1e-9d88-b133a9eec5b4"
Jul 21 20:14:32.744109 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:32.744036    2576 generic.go:356] "Generic (PLEG): container finished" podID="6aaf5d7e58116369463822b045e52d90" containerID="4b39230323799d269331791756ffa1c5782f21c0141ac7ce59017e46b1486d02" exitCode=0
Jul 21 20:14:32.744849 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:32.744111    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-201.ec2.internal" event={"ID":"6aaf5d7e58116369463822b045e52d90","Type":"ContainerDied","Data":"4b39230323799d269331791756ffa1c5782f21c0141ac7ce59017e46b1486d02"}
Jul 21 20:14:32.745611 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:32.745585    2576 generic.go:356] "Generic (PLEG): container finished" podID="adf41cf7-7a06-4eb9-9e21-a2a861e137f6" containerID="7c39a00b25df71f8363ebb51a78874c999e0e8a0910528e04a775164e967b27f" exitCode=0
Jul 21 20:14:32.745760 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:32.745650    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bdpzc" event={"ID":"adf41cf7-7a06-4eb9-9e21-a2a861e137f6","Type":"ContainerDied","Data":"7c39a00b25df71f8363ebb51a78874c999e0e8a0910528e04a775164e967b27f"}
Jul 21 20:14:32.748717 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:32.748681    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-54f9x_55f51c26-71cd-4e1b-84f2-32f2de4138d5/ovn-acl-logging/0.log"
Jul 21 20:14:32.749049 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:32.749026    2576 generic.go:356] "Generic (PLEG): container finished" podID="55f51c26-71cd-4e1b-84f2-32f2de4138d5" containerID="23dc440413c9d298f2b26bdeb9ab8d8369a35f00a2f28be2d1a7cff21257f9cb" exitCode=1
Jul 21 20:14:32.749131 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:32.749061    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-54f9x" event={"ID":"55f51c26-71cd-4e1b-84f2-32f2de4138d5","Type":"ContainerStarted","Data":"cb3287402c06c94047bcb14e7763faa12d0cf942992fd16bce87f8f31d6b34c4"}
Jul 21 20:14:32.749131 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:32.749122    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-54f9x" event={"ID":"55f51c26-71cd-4e1b-84f2-32f2de4138d5","Type":"ContainerStarted","Data":"b59ebab771e6eac49745fcf080dd0bdb823d4691f6e68a4da1b6041a835a5c19"}
Jul 21 20:14:32.749221 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:32.749159    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-54f9x" event={"ID":"55f51c26-71cd-4e1b-84f2-32f2de4138d5","Type":"ContainerStarted","Data":"39df24f07b5ad25e15bbed27a54418d5846e924051300c7d8921e9d058b6d575"}
Jul 21 20:14:32.749221 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:32.749201    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-54f9x" event={"ID":"55f51c26-71cd-4e1b-84f2-32f2de4138d5","Type":"ContainerStarted","Data":"233e03f866f814526c927c07067d80759d5cb0ff18332e3624455b3b3b7f170b"}
Jul 21 20:14:32.749305 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:32.749232    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-54f9x" event={"ID":"55f51c26-71cd-4e1b-84f2-32f2de4138d5","Type":"ContainerDied","Data":"23dc440413c9d298f2b26bdeb9ab8d8369a35f00a2f28be2d1a7cff21257f9cb"}
Jul 21 20:14:32.749305 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:32.749270    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-54f9x" event={"ID":"55f51c26-71cd-4e1b-84f2-32f2de4138d5","Type":"ContainerStarted","Data":"3521e0ff0af3533f0e16f06d264f2c47ee18f91a451846b44319783692a86b15"}
Jul 21 20:14:32.750558 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:32.750512    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7pgtc" event={"ID":"d32959ad-b973-4850-8f1f-9c135930cbdb","Type":"ContainerStarted","Data":"d60dfc68455987ec139835745ea2272758133a3746e7a561760c4c4d9e07785f"}
Jul 21 20:14:32.752017 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:32.751988    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-46pn7" event={"ID":"abe5ed79-25df-4e07-a3b4-c8014119e03e","Type":"ContainerStarted","Data":"034526eeb06f9236badc7fc0fe78a2e432b417996d858e740fb90cf28230a26a"}
Jul 21 20:14:32.753390 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:32.753370    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tttht" event={"ID":"38dce886-864e-4891-aa0c-80b892634b99","Type":"ContainerStarted","Data":"4d4c122b9b922b057e0eaff973b277821f2c22cab7fa46a8b8e118b99f4a1764"}
Jul 21 20:14:32.754733 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:32.754714    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z" event={"ID":"c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7","Type":"ContainerStarted","Data":"e3008cd23ead4b02d4c810f3771dc02d44d514fed440edd364f50c8eb077a1a3"}
Jul 21 20:14:32.756134 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:32.756115    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j55fg" event={"ID":"20c1b2ab-1a68-456f-bf0c-53417e458643","Type":"ContainerStarted","Data":"cdc668593f5831736b004d294c9b064ca8d441c0917dc95a7049262c1743fb05"}
Jul 21 20:14:32.850977 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:32.850769    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-j55fg" podStartSLOduration=2.675940415 podStartE2EDuration="22.850754776s" totalImagesPullingTime="20.174814361s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:14:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:14:32.813033146 +0000 UTC m=+23.745431314" watchObservedRunningTime="2026-07-21 20:14:32.850754776 +0000 UTC m=+23.783152957"
Jul 21 20:14:32.882266 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:32.882214    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tttht" podStartSLOduration=2.839240314 podStartE2EDuration="22.882196488s" totalImagesPullingTime="20.042956174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:14:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:14:32.851051169 +0000 UTC m=+23.783449304" watchObservedRunningTime="2026-07-21 20:14:32.882196488 +0000 UTC m=+23.814594644"
Jul 21 20:14:32.882516 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:32.882498    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-46pn7" podStartSLOduration=3.119510527 podStartE2EDuration="22.882492806s" totalImagesPullingTime="19.762982279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:14:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:14:32.882413231 +0000 UTC m=+23.814811389" watchObservedRunningTime="2026-07-21 20:14:32.882492806 +0000 UTC m=+23.814890962"
Jul 21 20:14:32.909903 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:32.909845    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7pgtc" podStartSLOduration=2.456917874 podStartE2EDuration="22.909828723s" totalImagesPullingTime="20.452910849s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:14:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:14:32.909325984 +0000 UTC m=+23.841724141" watchObservedRunningTime="2026-07-21 20:14:32.909828723 +0000 UTC m=+23.842226880"
Jul 21 20:14:33.645206 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:33.645166    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:33.645442 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:33.645288    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7fmhc" podUID="329479f3-ad8b-4d55-8902-fd524ced9b32"
Jul 21 20:14:33.645442 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:33.645336    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:14:33.645550 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:33.645448    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ls7f" podUID="4e6c7adb-e703-4f33-af51-22fc05e06d23"
Jul 21 20:14:33.972440 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:33.972414    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 20:14:34.517199 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:34.517096    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T20:14:33.972433456Z","UUID":"b7a8a9b4-de70-460e-bf8c-efe1faaadc29","Handler":null,"Name":"","Endpoint":""}
Jul 21 20:14:34.519143 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:34.519119    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 20:14:34.519285 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:34.519165    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 20:14:34.645898 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:34.645863    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:34.646078 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:34.646015    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9fp4" podUID="3712cffa-e355-4c1e-9d88-b133a9eec5b4"
Jul 21 20:14:34.762473 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:34.762438    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z" event={"ID":"c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7","Type":"ContainerStarted","Data":"66bed9b3d6960ef7ea375da9ef31f9c30fc2db2d68688ece325d3fd055ea2181"}
Jul 21 20:14:34.764705 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:34.764657    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-201.ec2.internal" event={"ID":"6aaf5d7e58116369463822b045e52d90","Type":"ContainerStarted","Data":"9fc098d453b0ae6947941273ca70d7aedc5a902052d8c972b155fc8e4d9bd959"}
Jul 21 20:14:35.649194 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:35.649095    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:35.649194 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:35.649130    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:14:35.649791 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:35.649220    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7fmhc" podUID="329479f3-ad8b-4d55-8902-fd524ced9b32"
Jul 21 20:14:35.649791 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:35.649327    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ls7f" podUID="4e6c7adb-e703-4f33-af51-22fc05e06d23"
Jul 21 20:14:35.769599 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:35.769564    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z" event={"ID":"c8efa2eb-95c5-452a-b2ec-7cf2f14cd9b7","Type":"ContainerStarted","Data":"7721753a4ae7ed212c45584150ffbe0447c31d20088c0ac802a4ea46169350ba"}
Jul 21 20:14:35.772873 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:35.772849    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-54f9x_55f51c26-71cd-4e1b-84f2-32f2de4138d5/ovn-acl-logging/0.log"
Jul 21 20:14:35.773238 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:35.773215    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-54f9x" event={"ID":"55f51c26-71cd-4e1b-84f2-32f2de4138d5","Type":"ContainerStarted","Data":"ba09c0a671cb56fa3defbbb7528879532c287dc1feeedd1155f19e60e30df048"}
Jul 21 20:14:35.796653 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:35.796594    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-201.ec2.internal" podStartSLOduration=25.796573037 podStartE2EDuration="25.796573037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:14:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:14:34.785752491 +0000 UTC m=+25.718150647" watchObservedRunningTime="2026-07-21 20:14:35.796573037 +0000 UTC m=+26.728971197"
Jul 21 20:14:36.645855 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:36.645819    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:36.646109 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:36.645941    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9fp4" podUID="3712cffa-e355-4c1e-9d88-b133a9eec5b4"
Jul 21 20:14:36.871092 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:36.871059    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-46pn7"
Jul 21 20:14:36.871613 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:36.871595    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-46pn7"
Jul 21 20:14:36.903911 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:36.903808    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntf8z" podStartSLOduration=5.00202541 podStartE2EDuration="27.903789793s" totalImagesPullingTime="22.901764383s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:14:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:14:35.796680289 +0000 UTC m=+26.729078448" watchObservedRunningTime="2026-07-21 20:14:36.903789793 +0000 UTC m=+27.836187949"
Jul 21 20:14:37.646456 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:37.645853    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:14:37.646456 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:37.645899    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:37.646456 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:37.646235    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ls7f" podUID="4e6c7adb-e703-4f33-af51-22fc05e06d23"
Jul 21 20:14:37.646456 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:37.646348    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7fmhc" podUID="329479f3-ad8b-4d55-8902-fd524ced9b32"
Jul 21 20:14:37.781620 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:37.781592    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-54f9x_55f51c26-71cd-4e1b-84f2-32f2de4138d5/ovn-acl-logging/0.log"
Jul 21 20:14:37.781968 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:37.781945    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-54f9x" event={"ID":"55f51c26-71cd-4e1b-84f2-32f2de4138d5","Type":"ContainerStarted","Data":"cdfc660469da04099f670d326dce6eecebd1bee41f0b22f4676281150ee4e37b"}
Jul 21 20:14:37.782337 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:37.782319    2576 scope.go:117] "RemoveContainer" containerID="23dc440413c9d298f2b26bdeb9ab8d8369a35f00a2f28be2d1a7cff21257f9cb"
Jul 21 20:14:38.645018 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:38.644977    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:38.645716 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:38.645098    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9fp4" podUID="3712cffa-e355-4c1e-9d88-b133a9eec5b4"
Jul 21 20:14:38.786834 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:38.786732    2576 generic.go:356] "Generic (PLEG): container finished" podID="adf41cf7-7a06-4eb9-9e21-a2a861e137f6" containerID="786b88f4ab92f94d8f88aba8227ac4b9871351425e77a0e2248eb80ee8df8583" exitCode=0
Jul 21 20:14:38.786993 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:38.786843    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bdpzc" event={"ID":"adf41cf7-7a06-4eb9-9e21-a2a861e137f6","Type":"ContainerDied","Data":"786b88f4ab92f94d8f88aba8227ac4b9871351425e77a0e2248eb80ee8df8583"}
Jul 21 20:14:38.795831 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:38.795805    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-54f9x_55f51c26-71cd-4e1b-84f2-32f2de4138d5/ovn-acl-logging/0.log"
Jul 21 20:14:38.796258 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:38.796234    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-54f9x" event={"ID":"55f51c26-71cd-4e1b-84f2-32f2de4138d5","Type":"ContainerStarted","Data":"0bae147eef7a57e0029eac5280f32efed1571d7b967db526276940281cb94efe"}
Jul 21 20:14:38.796656 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:38.796630    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:38.796809 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:38.796734    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:38.796809 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:38.796794    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:38.814641 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:38.814502    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:38.814641 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:38.814649    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:14:38.889802 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:38.889741    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-54f9x" podStartSLOduration=8.119967146 podStartE2EDuration="28.889717671s" totalImagesPullingTime="20.769750525s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:14:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:14:38.889028589 +0000 UTC m=+29.821426780" watchObservedRunningTime="2026-07-21 20:14:38.889717671 +0000 UTC m=+29.822115829"
Jul 21 20:14:39.646996 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:39.646803    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:14:39.647466 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:39.646857    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:39.647466 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:39.647074    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ls7f" podUID="4e6c7adb-e703-4f33-af51-22fc05e06d23"
Jul 21 20:14:39.647466 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:39.647132    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7fmhc" podUID="329479f3-ad8b-4d55-8902-fd524ced9b32"
Jul 21 20:14:40.121954 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:40.121920    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q9fp4"]
Jul 21 20:14:40.122105 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:40.122060    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:40.122157 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:40.122140    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9fp4" podUID="3712cffa-e355-4c1e-9d88-b133a9eec5b4"
Jul 21 20:14:40.125892 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:40.125864    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5ls7f"]
Jul 21 20:14:40.126078 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:40.126054    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:14:40.126195 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:40.126159    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ls7f" podUID="4e6c7adb-e703-4f33-af51-22fc05e06d23"
Jul 21 20:14:40.126435 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:40.126412    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7fmhc"]
Jul 21 20:14:40.126529 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:40.126504    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:40.126593 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:40.126579    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7fmhc" podUID="329479f3-ad8b-4d55-8902-fd524ced9b32"
Jul 21 20:14:40.400544 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:40.400504    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-46pn7"
Jul 21 20:14:40.400738 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:40.400661    2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 21 20:14:40.401234 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:40.401217    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-46pn7"
Jul 21 20:14:40.740930 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:40.740852    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:14:40.802935 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:40.802899    2576 generic.go:356] "Generic (PLEG): container finished" podID="adf41cf7-7a06-4eb9-9e21-a2a861e137f6" containerID="ef1f4527f53aee147c71813e878fc99e111c8fa516f12a1ded7a4ba4b7c84329" exitCode=0
Jul 21 20:14:40.803093 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:40.802983    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bdpzc" event={"ID":"adf41cf7-7a06-4eb9-9e21-a2a861e137f6","Type":"ContainerDied","Data":"ef1f4527f53aee147c71813e878fc99e111c8fa516f12a1ded7a4ba4b7c84329"}
Jul 21 20:14:40.901824 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:40.901792    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:14:41.645728 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:41.645650    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:14:41.645949 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:41.645661    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:41.646055 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:41.645730    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:41.646118 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:41.646088    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ls7f" podUID="4e6c7adb-e703-4f33-af51-22fc05e06d23"
Jul 21 20:14:41.646250 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:41.646224    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9fp4" podUID="3712cffa-e355-4c1e-9d88-b133a9eec5b4"
Jul 21 20:14:41.646330 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:41.646315    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7fmhc" podUID="329479f3-ad8b-4d55-8902-fd524ced9b32"
Jul 21 20:14:41.807639 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:41.807606    2576 generic.go:356] "Generic (PLEG): container finished" podID="adf41cf7-7a06-4eb9-9e21-a2a861e137f6" containerID="30342644d67b6bf16c7d2a21782bf9c48d35ea49dd51634e8c875aa27c1b5913" exitCode=0
Jul 21 20:14:41.808025 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:41.807663    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bdpzc" event={"ID":"adf41cf7-7a06-4eb9-9e21-a2a861e137f6","Type":"ContainerDied","Data":"30342644d67b6bf16c7d2a21782bf9c48d35ea49dd51634e8c875aa27c1b5913"}
Jul 21 20:14:42.191046 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:42.191007    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs\") pod \"network-metrics-daemon-q9fp4\" (UID: \"3712cffa-e355-4c1e-9d88-b133a9eec5b4\") " pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:42.191224 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:42.191123    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:14:42.191224 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:42.191174    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs podName:3712cffa-e355-4c1e-9d88-b133a9eec5b4 nodeName:}" failed. No retries permitted until 2026-07-21 20:15:14.19116156 +0000 UTC m=+65.123559700 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs") pod "network-metrics-daemon-q9fp4" (UID: "3712cffa-e355-4c1e-9d88-b133a9eec5b4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:14:42.291883 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:42.291845    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q72jr\" (UniqueName: \"kubernetes.io/projected/4e6c7adb-e703-4f33-af51-22fc05e06d23-kube-api-access-q72jr\") pod \"network-check-target-5ls7f\" (UID: \"4e6c7adb-e703-4f33-af51-22fc05e06d23\") " pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:14:42.291883 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:42.291886    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/329479f3-ad8b-4d55-8902-fd524ced9b32-original-pull-secret\") pod \"global-pull-secret-syncer-7fmhc\" (UID: \"329479f3-ad8b-4d55-8902-fd524ced9b32\") " pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:42.292070 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:42.291989    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 20:14:42.292070 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:42.292011    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 20:14:42.292070 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:42.292034    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 20:14:42.292070 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:42.292039    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/329479f3-ad8b-4d55-8902-fd524ced9b32-original-pull-secret podName:329479f3-ad8b-4d55-8902-fd524ced9b32 nodeName:}" failed. No retries permitted until 2026-07-21 20:15:14.292026509 +0000 UTC m=+65.224424645 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/329479f3-ad8b-4d55-8902-fd524ced9b32-original-pull-secret") pod "global-pull-secret-syncer-7fmhc" (UID: "329479f3-ad8b-4d55-8902-fd524ced9b32") : object "kube-system"/"original-pull-secret" not registered
Jul 21 20:14:42.292070 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:42.292044    2576 projected.go:196] Error preparing data for projected volume kube-api-access-q72jr for pod openshift-network-diagnostics/network-check-target-5ls7f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:14:42.292254 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:42.292089    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e6c7adb-e703-4f33-af51-22fc05e06d23-kube-api-access-q72jr podName:4e6c7adb-e703-4f33-af51-22fc05e06d23 nodeName:}" failed. No retries permitted until 2026-07-21 20:15:14.292074026 +0000 UTC m=+65.224472164 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-q72jr" (UniqueName: "kubernetes.io/projected/4e6c7adb-e703-4f33-af51-22fc05e06d23-kube-api-access-q72jr") pod "network-check-target-5ls7f" (UID: "4e6c7adb-e703-4f33-af51-22fc05e06d23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:14:43.645936 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:43.645895    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:43.646288 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:43.646017    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:14:43.646288 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:43.646024    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7fmhc" podUID="329479f3-ad8b-4d55-8902-fd524ced9b32"
Jul 21 20:14:43.646288 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:43.646024    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:43.646288 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:43.646123    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5ls7f" podUID="4e6c7adb-e703-4f33-af51-22fc05e06d23"
Jul 21 20:14:43.646288 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:43.646213    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9fp4" podUID="3712cffa-e355-4c1e-9d88-b133a9eec5b4"
Jul 21 20:14:44.916661 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:44.916472    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-201.ec2.internal" event="NodeReady"
Jul 21 20:14:44.917158 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:44.916800    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 20:14:44.977929 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:44.977896    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:14:44.999359 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:44.999329    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dnn52"]
Jul 21 20:14:45.001716 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.001675    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-666gc"]
Jul 21 20:14:45.001857 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.001825    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dnn52"
Jul 21 20:14:45.003397 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.003378    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-666gc"
Jul 21 20:14:45.006320 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.006295    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 20:14:45.006800 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.006780    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 20:14:45.006941 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.006922    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-t5nj5\""
Jul 21 20:14:45.007240 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.007222    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 20:14:45.007331 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.007265    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 20:14:45.007395 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.007371    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 20:14:45.007487 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.007469    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v6nlp\""
Jul 21 20:14:45.037642 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.037609    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dnn52"]
Jul 21 20:14:45.038311 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.038290    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-666gc"]
Jul 21 20:14:45.098657 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.098604    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:14:45.114142 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.114114    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwqgn\" (UniqueName: \"kubernetes.io/projected/835a703c-f349-475e-b945-9291e474ad83-kube-api-access-jwqgn\") pod \"dns-default-666gc\" (UID: \"835a703c-f349-475e-b945-9291e474ad83\") " pod="openshift-dns/dns-default-666gc"
Jul 21 20:14:45.114142 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.114150    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e23c3058-7bcf-4207-878a-1fb665d74d22-cert\") pod \"ingress-canary-dnn52\" (UID: \"e23c3058-7bcf-4207-878a-1fb665d74d22\") " pod="openshift-ingress-canary/ingress-canary-dnn52"
Jul 21 20:14:45.114347 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.114188    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqgps\" (UniqueName: \"kubernetes.io/projected/e23c3058-7bcf-4207-878a-1fb665d74d22-kube-api-access-mqgps\") pod \"ingress-canary-dnn52\" (UID: \"e23c3058-7bcf-4207-878a-1fb665d74d22\") " pod="openshift-ingress-canary/ingress-canary-dnn52"
Jul 21 20:14:45.114347 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.114282    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/835a703c-f349-475e-b945-9291e474ad83-tmp-dir\") pod \"dns-default-666gc\" (UID: \"835a703c-f349-475e-b945-9291e474ad83\") " pod="openshift-dns/dns-default-666gc"
Jul 21 20:14:45.114347 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.114323    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/835a703c-f349-475e-b945-9291e474ad83-config-volume\") pod \"dns-default-666gc\" (UID: \"835a703c-f349-475e-b945-9291e474ad83\") " pod="openshift-dns/dns-default-666gc"
Jul 21 20:14:45.114457 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.114434    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls\") pod \"dns-default-666gc\" (UID: \"835a703c-f349-475e-b945-9291e474ad83\") " pod="openshift-dns/dns-default-666gc"
Jul 21 20:14:45.215519 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.215416    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqgps\" (UniqueName: \"kubernetes.io/projected/e23c3058-7bcf-4207-878a-1fb665d74d22-kube-api-access-mqgps\") pod \"ingress-canary-dnn52\" (UID: \"e23c3058-7bcf-4207-878a-1fb665d74d22\") " pod="openshift-ingress-canary/ingress-canary-dnn52"
Jul 21 20:14:45.215519 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.215481    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/835a703c-f349-475e-b945-9291e474ad83-tmp-dir\") pod \"dns-default-666gc\" (UID: \"835a703c-f349-475e-b945-9291e474ad83\") " pod="openshift-dns/dns-default-666gc"
Jul 21 20:14:45.215519 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.215517    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/835a703c-f349-475e-b945-9291e474ad83-config-volume\") pod \"dns-default-666gc\" (UID: \"835a703c-f349-475e-b945-9291e474ad83\") " pod="openshift-dns/dns-default-666gc"
Jul 21 20:14:45.215823 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.215582    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls\") pod \"dns-default-666gc\" (UID: \"835a703c-f349-475e-b945-9291e474ad83\") " pod="openshift-dns/dns-default-666gc"
Jul 21 20:14:45.215823 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:45.215683    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 20:14:45.215823 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.215714    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwqgn\" (UniqueName: \"kubernetes.io/projected/835a703c-f349-475e-b945-9291e474ad83-kube-api-access-jwqgn\") pod \"dns-default-666gc\" (UID: \"835a703c-f349-475e-b945-9291e474ad83\") " pod="openshift-dns/dns-default-666gc"
Jul 21 20:14:45.215823 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:45.215748    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls podName:835a703c-f349-475e-b945-9291e474ad83 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:45.715733773 +0000 UTC m=+36.648131907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls") pod "dns-default-666gc" (UID: "835a703c-f349-475e-b945-9291e474ad83") : secret "dns-default-metrics-tls" not found
Jul 21 20:14:45.215823 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.215769    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e23c3058-7bcf-4207-878a-1fb665d74d22-cert\") pod \"ingress-canary-dnn52\" (UID: \"e23c3058-7bcf-4207-878a-1fb665d74d22\") " pod="openshift-ingress-canary/ingress-canary-dnn52"
Jul 21 20:14:45.216054 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.215858    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/835a703c-f349-475e-b945-9291e474ad83-tmp-dir\") pod \"dns-default-666gc\" (UID: \"835a703c-f349-475e-b945-9291e474ad83\") " pod="openshift-dns/dns-default-666gc"
Jul 21 20:14:45.216308 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.216291    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/835a703c-f349-475e-b945-9291e474ad83-config-volume\") pod \"dns-default-666gc\" (UID: \"835a703c-f349-475e-b945-9291e474ad83\") " pod="openshift-dns/dns-default-666gc"
Jul 21 20:14:45.220818 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.220796    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e23c3058-7bcf-4207-878a-1fb665d74d22-cert\") pod \"ingress-canary-dnn52\" (UID: \"e23c3058-7bcf-4207-878a-1fb665d74d22\") " pod="openshift-ingress-canary/ingress-canary-dnn52"
Jul 21 20:14:45.233604 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.233551    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwqgn\" (UniqueName: \"kubernetes.io/projected/835a703c-f349-475e-b945-9291e474ad83-kube-api-access-jwqgn\") pod \"dns-default-666gc\" (UID: \"835a703c-f349-475e-b945-9291e474ad83\") " pod="openshift-dns/dns-default-666gc"
Jul 21 20:14:45.233847 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.233826    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqgps\" (UniqueName: \"kubernetes.io/projected/e23c3058-7bcf-4207-878a-1fb665d74d22-kube-api-access-mqgps\") pod \"ingress-canary-dnn52\" (UID: \"e23c3058-7bcf-4207-878a-1fb665d74d22\") " pod="openshift-ingress-canary/ingress-canary-dnn52"
Jul 21 20:14:45.238449 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.238418    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:14:45.313180 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.313129    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dnn52"
Jul 21 20:14:45.353127 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.353094    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:14:45.645813 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.645771    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:14:45.645813 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.645814    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:14:45.646046 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.645785    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:14:45.652194 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.652163    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 20:14:45.652352 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.652204    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 20:14:45.652352 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.652246    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bxdt9\""
Jul 21 20:14:45.652352 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.652314    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 20:14:45.652352 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.652331    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 20:14:45.653073 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.653056    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7b7qw\""
Jul 21 20:14:45.719374 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:45.719343    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls\") pod \"dns-default-666gc\" (UID: \"835a703c-f349-475e-b945-9291e474ad83\") " pod="openshift-dns/dns-default-666gc"
Jul 21 20:14:45.719565 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:45.719513    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 20:14:45.719626 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:45.719589    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls podName:835a703c-f349-475e-b945-9291e474ad83 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:46.719570103 +0000 UTC m=+37.651968250 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls") pod "dns-default-666gc" (UID: "835a703c-f349-475e-b945-9291e474ad83") : secret "dns-default-metrics-tls" not found
Jul 21 20:14:46.619508 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:46.619470    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dnn52"]
Jul 21 20:14:46.623095 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:14:46.623059    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode23c3058_7bcf_4207_878a_1fb665d74d22.slice/crio-1170b64209979e51c82ce97555a3ad4736ea78bd59e568ef53180c96ac5a5c61 WatchSource:0}: Error finding container 1170b64209979e51c82ce97555a3ad4736ea78bd59e568ef53180c96ac5a5c61: Status 404 returned error can't find the container with id 1170b64209979e51c82ce97555a3ad4736ea78bd59e568ef53180c96ac5a5c61
Jul 21 20:14:46.729043 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:46.728809    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls\") pod \"dns-default-666gc\" (UID: \"835a703c-f349-475e-b945-9291e474ad83\") " pod="openshift-dns/dns-default-666gc"
Jul 21 20:14:46.729043 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:46.728970    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 20:14:46.729229 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:46.729089    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls podName:835a703c-f349-475e-b945-9291e474ad83 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:48.729070206 +0000 UTC m=+39.661468360 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls") pod "dns-default-666gc" (UID: "835a703c-f349-475e-b945-9291e474ad83") : secret "dns-default-metrics-tls" not found
Jul 21 20:14:46.822590 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:46.822555    2576 generic.go:356] "Generic (PLEG): container finished" podID="adf41cf7-7a06-4eb9-9e21-a2a861e137f6" containerID="dbff18e9d6c2a387e3e38f2574d2c67ce500d92afb0f352a7ba7a1c29cc5d039" exitCode=0
Jul 21 20:14:46.822785 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:46.822643    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bdpzc" event={"ID":"adf41cf7-7a06-4eb9-9e21-a2a861e137f6","Type":"ContainerDied","Data":"dbff18e9d6c2a387e3e38f2574d2c67ce500d92afb0f352a7ba7a1c29cc5d039"}
Jul 21 20:14:46.823738 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:46.823717    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dnn52" event={"ID":"e23c3058-7bcf-4207-878a-1fb665d74d22","Type":"ContainerStarted","Data":"1170b64209979e51c82ce97555a3ad4736ea78bd59e568ef53180c96ac5a5c61"}
Jul 21 20:14:47.829512 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:47.829475    2576 generic.go:356] "Generic (PLEG): container finished" podID="adf41cf7-7a06-4eb9-9e21-a2a861e137f6" containerID="147508deb30d1e7885f704ca41000d278b601ebbc1d5dfd54e6b6a6d70dc1935" exitCode=0
Jul 21 20:14:47.829940 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:47.829544    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bdpzc" event={"ID":"adf41cf7-7a06-4eb9-9e21-a2a861e137f6","Type":"ContainerDied","Data":"147508deb30d1e7885f704ca41000d278b601ebbc1d5dfd54e6b6a6d70dc1935"}
Jul 21 20:14:48.745293 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:48.745249    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls\") pod \"dns-default-666gc\" (UID: \"835a703c-f349-475e-b945-9291e474ad83\") " pod="openshift-dns/dns-default-666gc"
Jul 21 20:14:48.745485 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:48.745415    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 20:14:48.745485 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:48.745482    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls podName:835a703c-f349-475e-b945-9291e474ad83 nodeName:}" failed. No retries permitted until 2026-07-21 20:14:52.745466471 +0000 UTC m=+43.677864615 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls") pod "dns-default-666gc" (UID: "835a703c-f349-475e-b945-9291e474ad83") : secret "dns-default-metrics-tls" not found
Jul 21 20:14:48.835970 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:48.835933    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bdpzc" event={"ID":"adf41cf7-7a06-4eb9-9e21-a2a861e137f6","Type":"ContainerStarted","Data":"4cf58562f2bd394b663bbfdddf075bce7058f8d287d86e00541db87cef9e38b5"}
Jul 21 20:14:48.875835 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:48.875778    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bdpzc" podStartSLOduration=8.161419387 podStartE2EDuration="39.875752256s" totalImagesPullingTime="31.714332869s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:14:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:14:48.874167786 +0000 UTC m=+39.806565946" watchObservedRunningTime="2026-07-21 20:14:48.875752256 +0000 UTC m=+39.808150415"
Jul 21 20:14:48.916929 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:48.916879    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:14:49.073254 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:49.073219    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:14:49.171605 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:49.171573    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:14:49.839833 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:49.839791    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dnn52" event={"ID":"e23c3058-7bcf-4207-878a-1fb665d74d22","Type":"ContainerStarted","Data":"ccc6124c45cd415462fe72aeed00ec7de60d8c020a3e2ee210c1c001ba7e3735"}
Jul 21 20:14:49.876742 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:49.876667    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dnn52" podStartSLOduration=3.173177212 podStartE2EDuration="5.876652594s" totalImagesPullingTime="2.703475382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:14:49.8764552 +0000 UTC m=+40.808853358" watchObservedRunningTime="2026-07-21 20:14:49.876652594 +0000 UTC m=+40.809050750"
Jul 21 20:14:52.773588 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:52.773545    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls\") pod \"dns-default-666gc\" (UID: \"835a703c-f349-475e-b945-9291e474ad83\") " pod="openshift-dns/dns-default-666gc"
Jul 21 20:14:52.774101 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:52.773747    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 20:14:52.774101 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:14:52.773830    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls podName:835a703c-f349-475e-b945-9291e474ad83 nodeName:}" failed. No retries permitted until 2026-07-21 20:15:00.773809668 +0000 UTC m=+51.706207802 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls") pod "dns-default-666gc" (UID: "835a703c-f349-475e-b945-9291e474ad83") : secret "dns-default-metrics-tls" not found
Jul 21 20:14:53.827997 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:53.827963    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:14:53.918442 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:53.918413    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:14:55.139507 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:55.139467    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:14:55.210068 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:14:55.210039    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:00.831749 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:00.831709    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls\") pod \"dns-default-666gc\" (UID: \"835a703c-f349-475e-b945-9291e474ad83\") " pod="openshift-dns/dns-default-666gc"
Jul 21 20:15:00.832206 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:15:00.831827    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 20:15:00.832206 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:15:00.831890    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls podName:835a703c-f349-475e-b945-9291e474ad83 nodeName:}" failed. No retries permitted until 2026-07-21 20:15:16.831872993 +0000 UTC m=+67.764271128 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls") pod "dns-default-666gc" (UID: "835a703c-f349-475e-b945-9291e474ad83") : secret "dns-default-metrics-tls" not found
Jul 21 20:15:06.189787 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:06.189754    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:06.263192 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:06.263153    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:10.820231 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:10.820197    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-54f9x"
Jul 21 20:15:11.020835 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:11.020807    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:11.099586 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:11.099500    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:14.228208 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:14.228173    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs\") pod \"network-metrics-daemon-q9fp4\" (UID: \"3712cffa-e355-4c1e-9d88-b133a9eec5b4\") " pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:15:14.231028 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:14.231008    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 20:15:14.239321 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:15:14.239305    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 20:15:14.239386 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:15:14.239376    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs podName:3712cffa-e355-4c1e-9d88-b133a9eec5b4 nodeName:}" failed. No retries permitted until 2026-07-21 20:16:18.239359351 +0000 UTC m=+129.171757487 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs") pod "network-metrics-daemon-q9fp4" (UID: "3712cffa-e355-4c1e-9d88-b133a9eec5b4") : secret "metrics-daemon-secret" not found
Jul 21 20:15:14.329137 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:14.329087    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q72jr\" (UniqueName: \"kubernetes.io/projected/4e6c7adb-e703-4f33-af51-22fc05e06d23-kube-api-access-q72jr\") pod \"network-check-target-5ls7f\" (UID: \"4e6c7adb-e703-4f33-af51-22fc05e06d23\") " pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:15:14.329230 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:14.329146    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/329479f3-ad8b-4d55-8902-fd524ced9b32-original-pull-secret\") pod \"global-pull-secret-syncer-7fmhc\" (UID: \"329479f3-ad8b-4d55-8902-fd524ced9b32\") " pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:15:14.331857 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:14.331835    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 20:15:14.331857 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:14.331850    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 20:15:14.342464 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:14.342438    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 20:15:14.343087 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:14.343067    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/329479f3-ad8b-4d55-8902-fd524ced9b32-original-pull-secret\") pod \"global-pull-secret-syncer-7fmhc\" (UID: \"329479f3-ad8b-4d55-8902-fd524ced9b32\") " pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:15:14.353006 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:14.352976    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q72jr\" (UniqueName: \"kubernetes.io/projected/4e6c7adb-e703-4f33-af51-22fc05e06d23-kube-api-access-q72jr\") pod \"network-check-target-5ls7f\" (UID: \"4e6c7adb-e703-4f33-af51-22fc05e06d23\") " pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:15:14.465366 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:14.465324    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7fmhc"
Jul 21 20:15:14.474492 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:14.474473    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7b7qw\""
Jul 21 20:15:14.482526 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:14.482459    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:15:14.610267 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:14.610234    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7fmhc"]
Jul 21 20:15:14.613377 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:15:14.613352    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod329479f3_ad8b_4d55_8902_fd524ced9b32.slice/crio-91355b178c9848035841c3103d4e44d3860adc7dd4ad2f5b1d5ccb25fbbe371e WatchSource:0}: Error finding container 91355b178c9848035841c3103d4e44d3860adc7dd4ad2f5b1d5ccb25fbbe371e: Status 404 returned error can't find the container with id 91355b178c9848035841c3103d4e44d3860adc7dd4ad2f5b1d5ccb25fbbe371e
Jul 21 20:15:14.622560 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:14.622536    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5ls7f"]
Jul 21 20:15:14.625653 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:15:14.625620    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e6c7adb_e703_4f33_af51_22fc05e06d23.slice/crio-9312b0573716bcf5649d4f0d1a9293e95fc83c323d67fc284647994971623ff4 WatchSource:0}: Error finding container 9312b0573716bcf5649d4f0d1a9293e95fc83c323d67fc284647994971623ff4: Status 404 returned error can't find the container with id 9312b0573716bcf5649d4f0d1a9293e95fc83c323d67fc284647994971623ff4
Jul 21 20:15:14.897434 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:14.897397    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5ls7f" event={"ID":"4e6c7adb-e703-4f33-af51-22fc05e06d23","Type":"ContainerStarted","Data":"9312b0573716bcf5649d4f0d1a9293e95fc83c323d67fc284647994971623ff4"}
Jul 21 20:15:14.898428 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:14.898402    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7fmhc" event={"ID":"329479f3-ad8b-4d55-8902-fd524ced9b32","Type":"ContainerStarted","Data":"91355b178c9848035841c3103d4e44d3860adc7dd4ad2f5b1d5ccb25fbbe371e"}
Jul 21 20:15:15.801982 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:15.801948    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:15.908137 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:15.908099    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:16.848170 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:16.848129    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls\") pod \"dns-default-666gc\" (UID: \"835a703c-f349-475e-b945-9291e474ad83\") " pod="openshift-dns/dns-default-666gc"
Jul 21 20:15:16.848654 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:15:16.848310    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 20:15:16.848654 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:15:16.848393    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls podName:835a703c-f349-475e-b945-9291e474ad83 nodeName:}" failed. No retries permitted until 2026-07-21 20:15:48.848369849 +0000 UTC m=+99.780767992 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls") pod "dns-default-666gc" (UID: "835a703c-f349-475e-b945-9291e474ad83") : secret "dns-default-metrics-tls" not found
Jul 21 20:15:19.913379 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:19.913337    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5ls7f" event={"ID":"4e6c7adb-e703-4f33-af51-22fc05e06d23","Type":"ContainerStarted","Data":"e946b52b6981537cae2c7d74e6edb02ecfcf114643d20203deecbf406eb2a0c0"}
Jul 21 20:15:19.913928 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:19.913430    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:15:19.914666 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:19.914635    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7fmhc" event={"ID":"329479f3-ad8b-4d55-8902-fd524ced9b32","Type":"ContainerStarted","Data":"5b8b4ba18da8bfeca8b2078f95c95903acc8b2fe4845236859caf264ee7b4e13"}
Jul 21 20:15:19.931153 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:19.931101    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5ls7f" podStartSLOduration=65.092749644 podStartE2EDuration="1m9.931084769s" totalImagesPullingTime="4.838335125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:14:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:15:19.930090135 +0000 UTC m=+70.862488285" watchObservedRunningTime="2026-07-21 20:15:19.931084769 +0000 UTC m=+70.863482923"
Jul 21 20:15:19.947811 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:19.947758    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7fmhc" podStartSLOduration=65.084960588 podStartE2EDuration="1m9.947740904s" totalImagesPullingTime="4.862780316s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:14:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:15:19.947725478 +0000 UTC m=+70.880123636" watchObservedRunningTime="2026-07-21 20:15:19.947740904 +0000 UTC m=+70.880139061"
Jul 21 20:15:20.430954 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:20.430919    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:20.531867 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:20.531836    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:35.370473 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:35.370348    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f57c74456-bqf5g"]
Jul 21 20:15:35.372611 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:35.372588    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f57c74456-bqf5g"
Jul 21 20:15:35.375650 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:35.375622    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 21 20:15:35.375973 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:35.375953    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 21 20:15:35.376086 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:35.375977    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-2pvmr\""
Jul 21 20:15:35.376086 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:35.376018    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 21 20:15:35.376086 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:35.376039    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 21 20:15:35.385582 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:35.385558    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f57c74456-bqf5g"]
Jul 21 20:15:35.473964 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:35.473921    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvtqq\" (UniqueName: \"kubernetes.io/projected/3d6f2c4f-a07e-4066-925f-3ae9d2715237-kube-api-access-wvtqq\") pod \"managed-serviceaccount-addon-agent-7f57c74456-bqf5g\" (UID: \"3d6f2c4f-a07e-4066-925f-3ae9d2715237\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f57c74456-bqf5g"
Jul 21 20:15:35.474139 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:35.473988    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d6f2c4f-a07e-4066-925f-3ae9d2715237-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f57c74456-bqf5g\" (UID: \"3d6f2c4f-a07e-4066-925f-3ae9d2715237\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f57c74456-bqf5g"
Jul 21 20:15:35.574574 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:35.574526    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvtqq\" (UniqueName: \"kubernetes.io/projected/3d6f2c4f-a07e-4066-925f-3ae9d2715237-kube-api-access-wvtqq\") pod \"managed-serviceaccount-addon-agent-7f57c74456-bqf5g\" (UID: \"3d6f2c4f-a07e-4066-925f-3ae9d2715237\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f57c74456-bqf5g"
Jul 21 20:15:35.574741 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:35.574600    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d6f2c4f-a07e-4066-925f-3ae9d2715237-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f57c74456-bqf5g\" (UID: \"3d6f2c4f-a07e-4066-925f-3ae9d2715237\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f57c74456-bqf5g"
Jul 21 20:15:35.577089 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:35.577057    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d6f2c4f-a07e-4066-925f-3ae9d2715237-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f57c74456-bqf5g\" (UID: \"3d6f2c4f-a07e-4066-925f-3ae9d2715237\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f57c74456-bqf5g"
Jul 21 20:15:35.582530 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:35.582504    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvtqq\" (UniqueName: \"kubernetes.io/projected/3d6f2c4f-a07e-4066-925f-3ae9d2715237-kube-api-access-wvtqq\") pod \"managed-serviceaccount-addon-agent-7f57c74456-bqf5g\" (UID: \"3d6f2c4f-a07e-4066-925f-3ae9d2715237\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f57c74456-bqf5g"
Jul 21 20:15:35.687885 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:35.687795    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f57c74456-bqf5g"
Jul 21 20:15:35.804931 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:35.804898    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f57c74456-bqf5g"]
Jul 21 20:15:35.807874 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:15:35.807846    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d6f2c4f_a07e_4066_925f_3ae9d2715237.slice/crio-9736df5041812eedc7e7c30cd678e90748070ae2e7d922aad5d3df9d281c2690 WatchSource:0}: Error finding container 9736df5041812eedc7e7c30cd678e90748070ae2e7d922aad5d3df9d281c2690: Status 404 returned error can't find the container with id 9736df5041812eedc7e7c30cd678e90748070ae2e7d922aad5d3df9d281c2690
Jul 21 20:15:35.955815 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:35.955730    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f57c74456-bqf5g" event={"ID":"3d6f2c4f-a07e-4066-925f-3ae9d2715237","Type":"ContainerStarted","Data":"9736df5041812eedc7e7c30cd678e90748070ae2e7d922aad5d3df9d281c2690"}
Jul 21 20:15:38.965824 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:38.965784    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f57c74456-bqf5g" event={"ID":"3d6f2c4f-a07e-4066-925f-3ae9d2715237","Type":"ContainerStarted","Data":"5a289d2400ef718b0b9af41150c98501c7dc00f3b06bf1e9d74c3bfb6943e1e5"}
Jul 21 20:15:38.981194 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:38.981147    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f57c74456-bqf5g" podStartSLOduration=1.30149054 podStartE2EDuration="3.981128686s" totalImagesPullingTime="2.679638146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:15:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:15:38.980443707 +0000 UTC m=+89.912841864" watchObservedRunningTime="2026-07-21 20:15:38.981128686 +0000 UTC m=+89.913526844"
Jul 21 20:15:43.340639 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:43.340581    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:43.441605 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:43.441564    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:15:48.865606 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:48.865567    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls\") pod \"dns-default-666gc\" (UID: \"835a703c-f349-475e-b945-9291e474ad83\") " pod="openshift-dns/dns-default-666gc"
Jul 21 20:15:48.866094 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:15:48.865686    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 20:15:48.866094 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:15:48.865774    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls podName:835a703c-f349-475e-b945-9291e474ad83 nodeName:}" failed. No retries permitted until 2026-07-21 20:16:52.86575624 +0000 UTC m=+163.798154377 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls") pod "dns-default-666gc" (UID: "835a703c-f349-475e-b945-9291e474ad83") : secret "dns-default-metrics-tls" not found
Jul 21 20:15:50.919985 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:15:50.919955    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5ls7f"
Jul 21 20:16:16.594063 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:16:16.594023    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:16:18.260811 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:16:18.260762    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs\") pod \"network-metrics-daemon-q9fp4\" (UID: \"3712cffa-e355-4c1e-9d88-b133a9eec5b4\") " pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:16:18.261228 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:16:18.260895    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 20:16:18.261228 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:16:18.260955    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs podName:3712cffa-e355-4c1e-9d88-b133a9eec5b4 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:20.260939221 +0000 UTC m=+251.193337356 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs") pod "network-metrics-daemon-q9fp4" (UID: "3712cffa-e355-4c1e-9d88-b133a9eec5b4") : secret "metrics-daemon-secret" not found
Jul 21 20:16:48.019494 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:16:48.019435    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-666gc" podUID="835a703c-f349-475e-b945-9291e474ad83"
Jul 21 20:16:48.138732 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:16:48.138684    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-666gc"
Jul 21 20:16:48.658218 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:16:48.658166    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-q9fp4" podUID="3712cffa-e355-4c1e-9d88-b133a9eec5b4"
Jul 21 20:16:52.910510 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:16:52.910475    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls\") pod \"dns-default-666gc\" (UID: \"835a703c-f349-475e-b945-9291e474ad83\") " pod="openshift-dns/dns-default-666gc"
Jul 21 20:16:52.910950 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:16:52.910639    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 20:16:52.910950 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:16:52.910742    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls podName:835a703c-f349-475e-b945-9291e474ad83 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:54.910723681 +0000 UTC m=+285.843121830 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls") pod "dns-default-666gc" (UID: "835a703c-f349-475e-b945-9291e474ad83") : secret "dns-default-metrics-tls" not found
Jul 21 20:17:00.645128 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:17:00.645091    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:17:39.260913 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:17:39.260878    2576 generic.go:356] "Generic (PLEG): container finished" podID="3d6f2c4f-a07e-4066-925f-3ae9d2715237" containerID="5a289d2400ef718b0b9af41150c98501c7dc00f3b06bf1e9d74c3bfb6943e1e5" exitCode=255
Jul 21 20:17:39.261323 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:17:39.260926    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f57c74456-bqf5g" event={"ID":"3d6f2c4f-a07e-4066-925f-3ae9d2715237","Type":"ContainerDied","Data":"5a289d2400ef718b0b9af41150c98501c7dc00f3b06bf1e9d74c3bfb6943e1e5"}
Jul 21 20:17:39.266513 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:17:39.266491    2576 scope.go:117] "RemoveContainer" containerID="5a289d2400ef718b0b9af41150c98501c7dc00f3b06bf1e9d74c3bfb6943e1e5"
Jul 21 20:17:40.265712 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:17:40.265655    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f57c74456-bqf5g" event={"ID":"3d6f2c4f-a07e-4066-925f-3ae9d2715237","Type":"ContainerStarted","Data":"d3098123c3472bb8a059f8944aa80b06a0dbdbe06623df30078aae1e965fec40"}
Jul 21 20:18:15.212393 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.212357    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5b5b675cf6-8dh6k"]
Jul 21 20:18:15.215442 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.215423    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:15.218396 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.218372    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 21 20:18:15.218530 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.218439    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-s794m\""
Jul 21 20:18:15.218678 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.218662    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 21 20:18:15.218800 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.218767    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 21 20:18:15.218800 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.218789    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 21 20:18:15.218979 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.218826    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 21 20:18:15.219195 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.219180    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 21 20:18:15.240302 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.240269    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b5b675cf6-8dh6k"]
Jul 21 20:18:15.270746 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.270704    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5lrv\" (UniqueName: \"kubernetes.io/projected/736f340d-c51f-430c-927b-313fffbe0f68-kube-api-access-j5lrv\") pod \"router-default-5b5b675cf6-8dh6k\" (UID: \"736f340d-c51f-430c-927b-313fffbe0f68\") " pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:15.270955 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.270758    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/736f340d-c51f-430c-927b-313fffbe0f68-stats-auth\") pod \"router-default-5b5b675cf6-8dh6k\" (UID: \"736f340d-c51f-430c-927b-313fffbe0f68\") " pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:15.270955 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.270778    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/736f340d-c51f-430c-927b-313fffbe0f68-metrics-certs\") pod \"router-default-5b5b675cf6-8dh6k\" (UID: \"736f340d-c51f-430c-927b-313fffbe0f68\") " pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:15.270955 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.270840    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736f340d-c51f-430c-927b-313fffbe0f68-service-ca-bundle\") pod \"router-default-5b5b675cf6-8dh6k\" (UID: \"736f340d-c51f-430c-927b-313fffbe0f68\") " pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:15.270955 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.270886    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/736f340d-c51f-430c-927b-313fffbe0f68-default-certificate\") pod \"router-default-5b5b675cf6-8dh6k\" (UID: \"736f340d-c51f-430c-927b-313fffbe0f68\") " pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:15.311960 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.311925    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-w885b"]
Jul 21 20:18:15.314782 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.314764    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-w885b"
Jul 21 20:18:15.317308 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.317285    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"]
Jul 21 20:18:15.318045 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.318025    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 21 20:18:15.318201 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.318182    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 21 20:18:15.318292 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.318273    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 21 20:18:15.320150 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.320134    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hth4f"]
Jul 21 20:18:15.320278 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.320258    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:15.320369 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.320281    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 21 20:18:15.320369 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.320333    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6hkhb\""
Jul 21 20:18:15.323097 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.323079    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hth4f"
Jul 21 20:18:15.324920 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.324897    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 21 20:18:15.325009 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.324923    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 21 20:18:15.325050 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.325012    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 21 20:18:15.327264 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.327241    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 21 20:18:15.327430 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.327415    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 21 20:18:15.327501 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.327441    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 21 20:18:15.327601 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.327584    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-s5q6f\""
Jul 21 20:18:15.333467 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.333449    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k44nk\""
Jul 21 20:18:15.335597 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.335579    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 21 20:18:15.336728 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.336707    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 21 20:18:15.338418 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.338399    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-w885b"]
Jul 21 20:18:15.350997 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.350970    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hth4f"]
Jul 21 20:18:15.351837 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.351814    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"]
Jul 21 20:18:15.371963 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.371928    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5lrv\" (UniqueName: \"kubernetes.io/projected/736f340d-c51f-430c-927b-313fffbe0f68-kube-api-access-j5lrv\") pod \"router-default-5b5b675cf6-8dh6k\" (UID: \"736f340d-c51f-430c-927b-313fffbe0f68\") " pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:15.372141 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.371970    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-image-registry-private-configuration\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:15.372141 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.371999    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-ca-trust-extracted\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:15.372141 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.372046    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9f6p\" (UniqueName: \"kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-kube-api-access-t9f6p\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:15.372141 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.372074    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-registry-tls\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:15.372141 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.372099    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/736f340d-c51f-430c-927b-313fffbe0f68-stats-auth\") pod \"router-default-5b5b675cf6-8dh6k\" (UID: \"736f340d-c51f-430c-927b-313fffbe0f68\") " pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:15.372141 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.372123    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-registry-certificates\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:15.372435 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.372231    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/736f340d-c51f-430c-927b-313fffbe0f68-metrics-certs\") pod \"router-default-5b5b675cf6-8dh6k\" (UID: \"736f340d-c51f-430c-927b-313fffbe0f68\") " pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:15.372435 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.372257    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-trusted-ca\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:15.372435 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.372287    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736f340d-c51f-430c-927b-313fffbe0f68-service-ca-bundle\") pod \"router-default-5b5b675cf6-8dh6k\" (UID: \"736f340d-c51f-430c-927b-313fffbe0f68\") " pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:15.372435 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.372320    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/62db291a-14b7-4e35-9550-9fb810f82b8d-trusted-ca\") pod \"console-operator-565b7b569d-w885b\" (UID: \"62db291a-14b7-4e35-9550-9fb810f82b8d\") " pod="openshift-console-operator/console-operator-565b7b569d-w885b"
Jul 21 20:18:15.372435 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:15.372339    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 20:18:15.372435 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.372351    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/736f340d-c51f-430c-927b-313fffbe0f68-default-certificate\") pod \"router-default-5b5b675cf6-8dh6k\" (UID: \"736f340d-c51f-430c-927b-313fffbe0f68\") " pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:15.372435 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.372382    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62db291a-14b7-4e35-9550-9fb810f82b8d-serving-cert\") pod \"console-operator-565b7b569d-w885b\" (UID: \"62db291a-14b7-4e35-9550-9fb810f82b8d\") " pod="openshift-console-operator/console-operator-565b7b569d-w885b"
Jul 21 20:18:15.372435 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:15.372413    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/736f340d-c51f-430c-927b-313fffbe0f68-metrics-certs podName:736f340d-c51f-430c-927b-313fffbe0f68 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:15.872391676 +0000 UTC m=+246.804789828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/736f340d-c51f-430c-927b-313fffbe0f68-metrics-certs") pod "router-default-5b5b675cf6-8dh6k" (UID: "736f340d-c51f-430c-927b-313fffbe0f68") : secret "router-metrics-certs-default" not found
Jul 21 20:18:15.372792 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:15.372493    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/736f340d-c51f-430c-927b-313fffbe0f68-service-ca-bundle podName:736f340d-c51f-430c-927b-313fffbe0f68 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:15.872471907 +0000 UTC m=+246.804870043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/736f340d-c51f-430c-927b-313fffbe0f68-service-ca-bundle") pod "router-default-5b5b675cf6-8dh6k" (UID: "736f340d-c51f-430c-927b-313fffbe0f68") : configmap references non-existent config key: service-ca.crt
Jul 21 20:18:15.372792 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.372535    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f78ft\" (UniqueName: \"kubernetes.io/projected/62db291a-14b7-4e35-9550-9fb810f82b8d-kube-api-access-f78ft\") pod \"console-operator-565b7b569d-w885b\" (UID: \"62db291a-14b7-4e35-9550-9fb810f82b8d\") " pod="openshift-console-operator/console-operator-565b7b569d-w885b"
Jul 21 20:18:15.372792 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.372581    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-bound-sa-token\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:15.372792 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.372629    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wxj9\" (UniqueName: \"kubernetes.io/projected/51496923-9549-4107-ba0b-29970f8afce2-kube-api-access-6wxj9\") pod \"cluster-samples-operator-79b7c55f87-hth4f\" (UID: \"51496923-9549-4107-ba0b-29970f8afce2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hth4f"
Jul 21 20:18:15.372792 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.372664    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/51496923-9549-4107-ba0b-29970f8afce2-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-hth4f\" (UID: \"51496923-9549-4107-ba0b-29970f8afce2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hth4f"
Jul 21 20:18:15.372792 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.372704    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-installation-pull-secrets\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:15.372792 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.372770    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62db291a-14b7-4e35-9550-9fb810f82b8d-config\") pod \"console-operator-565b7b569d-w885b\" (UID: \"62db291a-14b7-4e35-9550-9fb810f82b8d\") " pod="openshift-console-operator/console-operator-565b7b569d-w885b"
Jul 21 20:18:15.374629 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.374613    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/736f340d-c51f-430c-927b-313fffbe0f68-stats-auth\") pod \"router-default-5b5b675cf6-8dh6k\" (UID: \"736f340d-c51f-430c-927b-313fffbe0f68\") " pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:15.374785 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.374768    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/736f340d-c51f-430c-927b-313fffbe0f68-default-certificate\") pod \"router-default-5b5b675cf6-8dh6k\" (UID: \"736f340d-c51f-430c-927b-313fffbe0f68\") " pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:15.407388 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.407356    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5lrv\" (UniqueName: \"kubernetes.io/projected/736f340d-c51f-430c-927b-313fffbe0f68-kube-api-access-j5lrv\") pod \"router-default-5b5b675cf6-8dh6k\" (UID: \"736f340d-c51f-430c-927b-313fffbe0f68\") " pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:15.474003 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.473915    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-image-registry-private-configuration\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:15.474003 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.473952    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-ca-trust-extracted\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:15.474003 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.473985    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9f6p\" (UniqueName: \"kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-kube-api-access-t9f6p\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:15.474252 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.474097    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-registry-tls\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:15.474252 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.474137    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-registry-certificates\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:15.474252 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.474171    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-trusted-ca\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:15.474252 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.474219    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/62db291a-14b7-4e35-9550-9fb810f82b8d-trusted-ca\") pod \"console-operator-565b7b569d-w885b\" (UID: \"62db291a-14b7-4e35-9550-9fb810f82b8d\") " pod="openshift-console-operator/console-operator-565b7b569d-w885b"
Jul 21 20:18:15.474503 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:15.474246    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 20:18:15.474503 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:15.474268    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74dcbdb6fc-6tzkz: secret "image-registry-tls" not found
Jul 21 20:18:15.474503 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:15.474337    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-registry-tls podName:cfe49a9e-c954-4b0c-b8db-8bc33d8f686d nodeName:}" failed. No retries permitted until 2026-07-21 20:18:15.974316052 +0000 UTC m=+246.906714199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-registry-tls") pod "image-registry-74dcbdb6fc-6tzkz" (UID: "cfe49a9e-c954-4b0c-b8db-8bc33d8f686d") : secret "image-registry-tls" not found
Jul 21 20:18:15.474503 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.474411    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62db291a-14b7-4e35-9550-9fb810f82b8d-serving-cert\") pod \"console-operator-565b7b569d-w885b\" (UID: \"62db291a-14b7-4e35-9550-9fb810f82b8d\") " pod="openshift-console-operator/console-operator-565b7b569d-w885b"
Jul 21 20:18:15.474503 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.474437    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-ca-trust-extracted\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:15.474503 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.474479    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f78ft\" (UniqueName: \"kubernetes.io/projected/62db291a-14b7-4e35-9550-9fb810f82b8d-kube-api-access-f78ft\") pod \"console-operator-565b7b569d-w885b\" (UID: \"62db291a-14b7-4e35-9550-9fb810f82b8d\") " pod="openshift-console-operator/console-operator-565b7b569d-w885b"
Jul 21 20:18:15.474846 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.474527    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-bound-sa-token\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:15.474846 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.474560    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wxj9\" (UniqueName: \"kubernetes.io/projected/51496923-9549-4107-ba0b-29970f8afce2-kube-api-access-6wxj9\") pod \"cluster-samples-operator-79b7c55f87-hth4f\" (UID: \"51496923-9549-4107-ba0b-29970f8afce2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hth4f"
Jul 21 20:18:15.474846 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.474596    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/51496923-9549-4107-ba0b-29970f8afce2-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-hth4f\" (UID: \"51496923-9549-4107-ba0b-29970f8afce2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hth4f"
Jul 21 20:18:15.474846 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.474626    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-installation-pull-secrets\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:15.474846 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.474658    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62db291a-14b7-4e35-9550-9fb810f82b8d-config\") pod \"console-operator-565b7b569d-w885b\" (UID: \"62db291a-14b7-4e35-9550-9fb810f82b8d\") " pod="openshift-console-operator/console-operator-565b7b569d-w885b"
Jul 21 20:18:15.474846 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.474757    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-registry-certificates\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:15.475139 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:15.474876    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 20:18:15.475139 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:15.474942    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51496923-9549-4107-ba0b-29970f8afce2-samples-operator-tls podName:51496923-9549-4107-ba0b-29970f8afce2 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:15.974925301 +0000 UTC m=+246.907323441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/51496923-9549-4107-ba0b-29970f8afce2-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-hth4f" (UID: "51496923-9549-4107-ba0b-29970f8afce2") : secret "samples-operator-tls" not found
Jul 21 20:18:15.475139 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.475115    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/62db291a-14b7-4e35-9550-9fb810f82b8d-trusted-ca\") pod \"console-operator-565b7b569d-w885b\" (UID: \"62db291a-14b7-4e35-9550-9fb810f82b8d\") " pod="openshift-console-operator/console-operator-565b7b569d-w885b"
Jul 21 20:18:15.475369 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.475347    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62db291a-14b7-4e35-9550-9fb810f82b8d-config\") pod \"console-operator-565b7b569d-w885b\" (UID: \"62db291a-14b7-4e35-9550-9fb810f82b8d\") " pod="openshift-console-operator/console-operator-565b7b569d-w885b"
Jul 21 20:18:15.475411 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.475374    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-trusted-ca\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:15.476748 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.476726    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-image-registry-private-configuration\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:15.476901 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.476882    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62db291a-14b7-4e35-9550-9fb810f82b8d-serving-cert\") pod \"console-operator-565b7b569d-w885b\" (UID: \"62db291a-14b7-4e35-9550-9fb810f82b8d\") " pod="openshift-console-operator/console-operator-565b7b569d-w885b"
Jul 21 20:18:15.477149 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.477129    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-installation-pull-secrets\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:15.490532 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.490505    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wxj9\" (UniqueName: \"kubernetes.io/projected/51496923-9549-4107-ba0b-29970f8afce2-kube-api-access-6wxj9\") pod \"cluster-samples-operator-79b7c55f87-hth4f\" (UID: \"51496923-9549-4107-ba0b-29970f8afce2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hth4f"
Jul 21 20:18:15.490914 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.490895    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-bound-sa-token\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:15.491568 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.491544    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9f6p\" (UniqueName: \"kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-kube-api-access-t9f6p\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:15.491624 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.491609    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f78ft\" (UniqueName: \"kubernetes.io/projected/62db291a-14b7-4e35-9550-9fb810f82b8d-kube-api-access-f78ft\") pod \"console-operator-565b7b569d-w885b\" (UID: \"62db291a-14b7-4e35-9550-9fb810f82b8d\") " pod="openshift-console-operator/console-operator-565b7b569d-w885b"
Jul 21 20:18:15.625232 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.625207    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-w885b"
Jul 21 20:18:15.626329 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.626307    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:15.751419 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.751337    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-w885b"]
Jul 21 20:18:15.754007 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:18:15.753983    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62db291a_14b7_4e35_9550_9fb810f82b8d.slice/crio-79113344eba95b2e1f8db74c9f577001282c86dbeab5958edce2cdd4d3c9c649 WatchSource:0}: Error finding container 79113344eba95b2e1f8db74c9f577001282c86dbeab5958edce2cdd4d3c9c649: Status 404 returned error can't find the container with id 79113344eba95b2e1f8db74c9f577001282c86dbeab5958edce2cdd4d3c9c649
Jul 21 20:18:15.878289 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.878238    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/736f340d-c51f-430c-927b-313fffbe0f68-metrics-certs\") pod \"router-default-5b5b675cf6-8dh6k\" (UID: \"736f340d-c51f-430c-927b-313fffbe0f68\") " pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:15.878289 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.878285    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736f340d-c51f-430c-927b-313fffbe0f68-service-ca-bundle\") pod \"router-default-5b5b675cf6-8dh6k\" (UID: \"736f340d-c51f-430c-927b-313fffbe0f68\") " pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:15.878539 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:15.878399    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 20:18:15.878539 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:15.878454    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/736f340d-c51f-430c-927b-313fffbe0f68-service-ca-bundle podName:736f340d-c51f-430c-927b-313fffbe0f68 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:16.878439777 +0000 UTC m=+247.810837913 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/736f340d-c51f-430c-927b-313fffbe0f68-service-ca-bundle") pod "router-default-5b5b675cf6-8dh6k" (UID: "736f340d-c51f-430c-927b-313fffbe0f68") : configmap references non-existent config key: service-ca.crt
Jul 21 20:18:15.878539 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:15.878471    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/736f340d-c51f-430c-927b-313fffbe0f68-metrics-certs podName:736f340d-c51f-430c-927b-313fffbe0f68 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:16.878463699 +0000 UTC m=+247.810861833 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/736f340d-c51f-430c-927b-313fffbe0f68-metrics-certs") pod "router-default-5b5b675cf6-8dh6k" (UID: "736f340d-c51f-430c-927b-313fffbe0f68") : secret "router-metrics-certs-default" not found
Jul 21 20:18:15.979474 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.979433    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/51496923-9549-4107-ba0b-29970f8afce2-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-hth4f\" (UID: \"51496923-9549-4107-ba0b-29970f8afce2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hth4f"
Jul 21 20:18:15.979676 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:15.979506    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-registry-tls\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:15.979676 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:15.979583    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 20:18:15.979676 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:15.979616    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 20:18:15.979676 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:15.979637    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74dcbdb6fc-6tzkz: secret "image-registry-tls" not found
Jul 21 20:18:15.979676 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:15.979663    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51496923-9549-4107-ba0b-29970f8afce2-samples-operator-tls podName:51496923-9549-4107-ba0b-29970f8afce2 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:16.979645105 +0000 UTC m=+247.912043256 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/51496923-9549-4107-ba0b-29970f8afce2-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-hth4f" (UID: "51496923-9549-4107-ba0b-29970f8afce2") : secret "samples-operator-tls" not found
Jul 21 20:18:15.979922 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:15.979708    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-registry-tls podName:cfe49a9e-c954-4b0c-b8db-8bc33d8f686d nodeName:}" failed. No retries permitted until 2026-07-21 20:18:16.979669979 +0000 UTC m=+247.912068117 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-registry-tls") pod "image-registry-74dcbdb6fc-6tzkz" (UID: "cfe49a9e-c954-4b0c-b8db-8bc33d8f686d") : secret "image-registry-tls" not found
Jul 21 20:18:16.364375 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:16.364343    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-w885b" event={"ID":"62db291a-14b7-4e35-9550-9fb810f82b8d","Type":"ContainerStarted","Data":"79113344eba95b2e1f8db74c9f577001282c86dbeab5958edce2cdd4d3c9c649"}
Jul 21 20:18:16.886753 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:16.886712    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/736f340d-c51f-430c-927b-313fffbe0f68-metrics-certs\") pod \"router-default-5b5b675cf6-8dh6k\" (UID: \"736f340d-c51f-430c-927b-313fffbe0f68\") " pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:16.886753 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:16.886757    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736f340d-c51f-430c-927b-313fffbe0f68-service-ca-bundle\") pod \"router-default-5b5b675cf6-8dh6k\" (UID: \"736f340d-c51f-430c-927b-313fffbe0f68\") " pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:16.886993 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:16.886875    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 20:18:16.886993 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:16.886884    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/736f340d-c51f-430c-927b-313fffbe0f68-service-ca-bundle podName:736f340d-c51f-430c-927b-313fffbe0f68 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:18.88686875 +0000 UTC m=+249.819266885 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/736f340d-c51f-430c-927b-313fffbe0f68-service-ca-bundle") pod "router-default-5b5b675cf6-8dh6k" (UID: "736f340d-c51f-430c-927b-313fffbe0f68") : configmap references non-existent config key: service-ca.crt
Jul 21 20:18:16.886993 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:16.886955    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/736f340d-c51f-430c-927b-313fffbe0f68-metrics-certs podName:736f340d-c51f-430c-927b-313fffbe0f68 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:18.886937035 +0000 UTC m=+249.819335181 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/736f340d-c51f-430c-927b-313fffbe0f68-metrics-certs") pod "router-default-5b5b675cf6-8dh6k" (UID: "736f340d-c51f-430c-927b-313fffbe0f68") : secret "router-metrics-certs-default" not found
Jul 21 20:18:16.940154 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:16.940114    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:16.987351 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:16.987311    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/51496923-9549-4107-ba0b-29970f8afce2-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-hth4f\" (UID: \"51496923-9549-4107-ba0b-29970f8afce2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hth4f"
Jul 21 20:18:16.987546 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:16.987409    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-registry-tls\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:16.987546 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:16.987475    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 20:18:16.987546 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:16.987529    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 20:18:16.987546 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:16.987547    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74dcbdb6fc-6tzkz: secret "image-registry-tls" not found
Jul 21 20:18:16.987779 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:16.987557    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51496923-9549-4107-ba0b-29970f8afce2-samples-operator-tls podName:51496923-9549-4107-ba0b-29970f8afce2 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:18.987535972 +0000 UTC m=+249.919934108 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/51496923-9549-4107-ba0b-29970f8afce2-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-hth4f" (UID: "51496923-9549-4107-ba0b-29970f8afce2") : secret "samples-operator-tls" not found
Jul 21 20:18:16.987779 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:16.987597    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-registry-tls podName:cfe49a9e-c954-4b0c-b8db-8bc33d8f686d nodeName:}" failed. No retries permitted until 2026-07-21 20:18:18.987582042 +0000 UTC m=+249.919980181 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-registry-tls") pod "image-registry-74dcbdb6fc-6tzkz" (UID: "cfe49a9e-c954-4b0c-b8db-8bc33d8f686d") : secret "image-registry-tls" not found
Jul 21 20:18:17.657313 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:17.657282    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:17.735510 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:17.735478    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:18.372340 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:18.372312    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w885b_62db291a-14b7-4e35-9550-9fb810f82b8d/console-operator/0.log"
Jul 21 20:18:18.372537 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:18.372351    2576 generic.go:356] "Generic (PLEG): container finished" podID="62db291a-14b7-4e35-9550-9fb810f82b8d" containerID="9cc5b5d2f2ae6f2e0b0115b02acfbca8c758121385cad5d397fa598a37d0c312" exitCode=255
Jul 21 20:18:18.372537 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:18.372392    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-w885b" event={"ID":"62db291a-14b7-4e35-9550-9fb810f82b8d","Type":"ContainerDied","Data":"9cc5b5d2f2ae6f2e0b0115b02acfbca8c758121385cad5d397fa598a37d0c312"}
Jul 21 20:18:18.372730 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:18.372683    2576 scope.go:117] "RemoveContainer" containerID="9cc5b5d2f2ae6f2e0b0115b02acfbca8c758121385cad5d397fa598a37d0c312"
Jul 21 20:18:18.906288 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:18.906242    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/736f340d-c51f-430c-927b-313fffbe0f68-metrics-certs\") pod \"router-default-5b5b675cf6-8dh6k\" (UID: \"736f340d-c51f-430c-927b-313fffbe0f68\") " pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:18.906288 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:18.906295    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736f340d-c51f-430c-927b-313fffbe0f68-service-ca-bundle\") pod \"router-default-5b5b675cf6-8dh6k\" (UID: \"736f340d-c51f-430c-927b-313fffbe0f68\") " pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:18.906781 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:18.906397    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 20:18:18.906781 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:18.906436    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/736f340d-c51f-430c-927b-313fffbe0f68-service-ca-bundle podName:736f340d-c51f-430c-927b-313fffbe0f68 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:22.906422644 +0000 UTC m=+253.838820779 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/736f340d-c51f-430c-927b-313fffbe0f68-service-ca-bundle") pod "router-default-5b5b675cf6-8dh6k" (UID: "736f340d-c51f-430c-927b-313fffbe0f68") : configmap references non-existent config key: service-ca.crt
Jul 21 20:18:18.906781 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:18.906451    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/736f340d-c51f-430c-927b-313fffbe0f68-metrics-certs podName:736f340d-c51f-430c-927b-313fffbe0f68 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:22.906444721 +0000 UTC m=+253.838842856 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/736f340d-c51f-430c-927b-313fffbe0f68-metrics-certs") pod "router-default-5b5b675cf6-8dh6k" (UID: "736f340d-c51f-430c-927b-313fffbe0f68") : secret "router-metrics-certs-default" not found
Jul 21 20:18:19.006990 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:19.006951    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/51496923-9549-4107-ba0b-29970f8afce2-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-hth4f\" (UID: \"51496923-9549-4107-ba0b-29970f8afce2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hth4f"
Jul 21 20:18:19.007133 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:19.007021    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-registry-tls\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:19.007133 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:19.007122    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 20:18:19.007231 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:19.007131    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 20:18:19.007231 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:19.007217    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51496923-9549-4107-ba0b-29970f8afce2-samples-operator-tls podName:51496923-9549-4107-ba0b-29970f8afce2 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:23.007197429 +0000 UTC m=+253.939595572 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/51496923-9549-4107-ba0b-29970f8afce2-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-hth4f" (UID: "51496923-9549-4107-ba0b-29970f8afce2") : secret "samples-operator-tls" not found
Jul 21 20:18:19.007231 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:19.007134    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74dcbdb6fc-6tzkz: secret "image-registry-tls" not found
Jul 21 20:18:19.007390 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:19.007264    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-registry-tls podName:cfe49a9e-c954-4b0c-b8db-8bc33d8f686d nodeName:}" failed. No retries permitted until 2026-07-21 20:18:23.007253069 +0000 UTC m=+253.939651204 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-registry-tls") pod "image-registry-74dcbdb6fc-6tzkz" (UID: "cfe49a9e-c954-4b0c-b8db-8bc33d8f686d") : secret "image-registry-tls" not found
Jul 21 20:18:19.380044 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:19.380016    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w885b_62db291a-14b7-4e35-9550-9fb810f82b8d/console-operator/1.log"
Jul 21 20:18:19.380459 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:19.380440    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w885b_62db291a-14b7-4e35-9550-9fb810f82b8d/console-operator/0.log"
Jul 21 20:18:19.380597 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:19.380474    2576 generic.go:356] "Generic (PLEG): container finished" podID="62db291a-14b7-4e35-9550-9fb810f82b8d" containerID="fb820b4ea251cc677843224aa9b53ef0a83cded72a639c53ea8bf3d38dfbdb5f" exitCode=255
Jul 21 20:18:19.380597 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:19.380529    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-w885b" event={"ID":"62db291a-14b7-4e35-9550-9fb810f82b8d","Type":"ContainerDied","Data":"fb820b4ea251cc677843224aa9b53ef0a83cded72a639c53ea8bf3d38dfbdb5f"}
Jul 21 20:18:19.380597 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:19.380588    2576 scope.go:117] "RemoveContainer" containerID="9cc5b5d2f2ae6f2e0b0115b02acfbca8c758121385cad5d397fa598a37d0c312"
Jul 21 20:18:19.380832 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:19.380812    2576 scope.go:117] "RemoveContainer" containerID="fb820b4ea251cc677843224aa9b53ef0a83cded72a639c53ea8bf3d38dfbdb5f"
Jul 21 20:18:19.381041 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:19.381019    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-w885b_openshift-console-operator(62db291a-14b7-4e35-9550-9fb810f82b8d)\"" pod="openshift-console-operator/console-operator-565b7b569d-w885b" podUID="62db291a-14b7-4e35-9550-9fb810f82b8d"
Jul 21 20:18:20.317241 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.317190    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs\") pod \"network-metrics-daemon-q9fp4\" (UID: \"3712cffa-e355-4c1e-9d88-b133a9eec5b4\") " pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:18:20.317623 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:20.317347    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 20:18:20.317623 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:20.317412    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs podName:3712cffa-e355-4c1e-9d88-b133a9eec5b4 nodeName:}" failed. No retries permitted until 2026-07-21 20:20:22.317397448 +0000 UTC m=+373.249795583 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs") pod "network-metrics-daemon-q9fp4" (UID: "3712cffa-e355-4c1e-9d88-b133a9eec5b4") : secret "metrics-daemon-secret" not found
Jul 21 20:18:20.384670 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.384638    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w885b_62db291a-14b7-4e35-9550-9fb810f82b8d/console-operator/1.log"
Jul 21 20:18:20.384973 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.384958    2576 scope.go:117] "RemoveContainer" containerID="fb820b4ea251cc677843224aa9b53ef0a83cded72a639c53ea8bf3d38dfbdb5f"
Jul 21 20:18:20.385115 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:20.385097    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-w885b_openshift-console-operator(62db291a-14b7-4e35-9550-9fb810f82b8d)\"" pod="openshift-console-operator/console-operator-565b7b569d-w885b" podUID="62db291a-14b7-4e35-9550-9fb810f82b8d"
Jul 21 20:18:20.487621 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.487585    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bhw49"]
Jul 21 20:18:20.491761 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.491744    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bhw49"
Jul 21 20:18:20.494009 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.493977    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 20:18:20.494275 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.494257    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 20:18:20.494275 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.494270    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 20:18:20.494437 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.494275    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7vzqq\""
Jul 21 20:18:20.494437 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.494329    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 20:18:20.502931 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.502907    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bhw49"]
Jul 21 20:18:20.521875 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.521833    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:20.579154 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.579052    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:20.619403 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.619361    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ea8468e5-954c-4015-8e56-626f7db866a1-crio-socket\") pod \"insights-runtime-extractor-bhw49\" (UID: \"ea8468e5-954c-4015-8e56-626f7db866a1\") " pod="openshift-insights/insights-runtime-extractor-bhw49"
Jul 21 20:18:20.619546 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.619472    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea8468e5-954c-4015-8e56-626f7db866a1-data-volume\") pod \"insights-runtime-extractor-bhw49\" (UID: \"ea8468e5-954c-4015-8e56-626f7db866a1\") " pod="openshift-insights/insights-runtime-extractor-bhw49"
Jul 21 20:18:20.619546 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.619501    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ea8468e5-954c-4015-8e56-626f7db866a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bhw49\" (UID: \"ea8468e5-954c-4015-8e56-626f7db866a1\") " pod="openshift-insights/insights-runtime-extractor-bhw49"
Jul 21 20:18:20.619546 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.619533    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ea8468e5-954c-4015-8e56-626f7db866a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bhw49\" (UID: \"ea8468e5-954c-4015-8e56-626f7db866a1\") " pod="openshift-insights/insights-runtime-extractor-bhw49"
Jul 21 20:18:20.619649 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.619569    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twv6w\" (UniqueName: \"kubernetes.io/projected/ea8468e5-954c-4015-8e56-626f7db866a1-kube-api-access-twv6w\") pod \"insights-runtime-extractor-bhw49\" (UID: \"ea8468e5-954c-4015-8e56-626f7db866a1\") " pod="openshift-insights/insights-runtime-extractor-bhw49"
Jul 21 20:18:20.720749 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.720715    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea8468e5-954c-4015-8e56-626f7db866a1-data-volume\") pod \"insights-runtime-extractor-bhw49\" (UID: \"ea8468e5-954c-4015-8e56-626f7db866a1\") " pod="openshift-insights/insights-runtime-extractor-bhw49"
Jul 21 20:18:20.720749 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.720748    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ea8468e5-954c-4015-8e56-626f7db866a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bhw49\" (UID: \"ea8468e5-954c-4015-8e56-626f7db866a1\") " pod="openshift-insights/insights-runtime-extractor-bhw49"
Jul 21 20:18:20.720924 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:20.720824    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 20:18:20.720924 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:20.720881    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea8468e5-954c-4015-8e56-626f7db866a1-kube-rbac-proxy-cm podName:ea8468e5-954c-4015-8e56-626f7db866a1 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:21.220866924 +0000 UTC m=+252.153265060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ea8468e5-954c-4015-8e56-626f7db866a1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bhw49" (UID: "ea8468e5-954c-4015-8e56-626f7db866a1") : configmap "kube-rbac-proxy" not found
Jul 21 20:18:20.720924 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.720874    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ea8468e5-954c-4015-8e56-626f7db866a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bhw49\" (UID: \"ea8468e5-954c-4015-8e56-626f7db866a1\") " pod="openshift-insights/insights-runtime-extractor-bhw49"
Jul 21 20:18:20.720924 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.720917    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twv6w\" (UniqueName: \"kubernetes.io/projected/ea8468e5-954c-4015-8e56-626f7db866a1-kube-api-access-twv6w\") pod \"insights-runtime-extractor-bhw49\" (UID: \"ea8468e5-954c-4015-8e56-626f7db866a1\") " pod="openshift-insights/insights-runtime-extractor-bhw49"
Jul 21 20:18:20.721076 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.720959    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ea8468e5-954c-4015-8e56-626f7db866a1-crio-socket\") pod \"insights-runtime-extractor-bhw49\" (UID: \"ea8468e5-954c-4015-8e56-626f7db866a1\") " pod="openshift-insights/insights-runtime-extractor-bhw49"
Jul 21 20:18:20.721076 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:20.720971    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 20:18:20.721076 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:20.721037    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea8468e5-954c-4015-8e56-626f7db866a1-insights-runtime-extractor-tls podName:ea8468e5-954c-4015-8e56-626f7db866a1 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:21.221021441 +0000 UTC m=+252.153419576 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ea8468e5-954c-4015-8e56-626f7db866a1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bhw49" (UID: "ea8468e5-954c-4015-8e56-626f7db866a1") : secret "insights-runtime-extractor-tls" not found
Jul 21 20:18:20.721076 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.721047    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea8468e5-954c-4015-8e56-626f7db866a1-data-volume\") pod \"insights-runtime-extractor-bhw49\" (UID: \"ea8468e5-954c-4015-8e56-626f7db866a1\") " pod="openshift-insights/insights-runtime-extractor-bhw49"
Jul 21 20:18:20.721215 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.721080    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ea8468e5-954c-4015-8e56-626f7db866a1-crio-socket\") pod \"insights-runtime-extractor-bhw49\" (UID: \"ea8468e5-954c-4015-8e56-626f7db866a1\") " pod="openshift-insights/insights-runtime-extractor-bhw49"
Jul 21 20:18:20.730636 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.730611    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twv6w\" (UniqueName: \"kubernetes.io/projected/ea8468e5-954c-4015-8e56-626f7db866a1-kube-api-access-twv6w\") pod \"insights-runtime-extractor-bhw49\" (UID: \"ea8468e5-954c-4015-8e56-626f7db866a1\") " pod="openshift-insights/insights-runtime-extractor-bhw49"
Jul 21 20:18:20.779519 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.779476    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:20.879811 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.879684    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:20.986589 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:20.986551    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:21.079649 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:21.079613    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:21.182893 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:21.182774    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:21.225619 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:21.225587    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ea8468e5-954c-4015-8e56-626f7db866a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bhw49\" (UID: \"ea8468e5-954c-4015-8e56-626f7db866a1\") " pod="openshift-insights/insights-runtime-extractor-bhw49"
Jul 21 20:18:21.225619 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:21.225628    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ea8468e5-954c-4015-8e56-626f7db866a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bhw49\" (UID: \"ea8468e5-954c-4015-8e56-626f7db866a1\") " pod="openshift-insights/insights-runtime-extractor-bhw49"
Jul 21 20:18:21.225855 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:21.225745    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 20:18:21.225855 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:21.225824    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea8468e5-954c-4015-8e56-626f7db866a1-kube-rbac-proxy-cm podName:ea8468e5-954c-4015-8e56-626f7db866a1 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:22.22580453 +0000 UTC m=+253.158202668 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ea8468e5-954c-4015-8e56-626f7db866a1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bhw49" (UID: "ea8468e5-954c-4015-8e56-626f7db866a1") : configmap "kube-rbac-proxy" not found
Jul 21 20:18:21.225939 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:21.225869    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 20:18:21.225939 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:21.225917    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea8468e5-954c-4015-8e56-626f7db866a1-insights-runtime-extractor-tls podName:ea8468e5-954c-4015-8e56-626f7db866a1 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:22.225904426 +0000 UTC m=+253.158302578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ea8468e5-954c-4015-8e56-626f7db866a1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bhw49" (UID: "ea8468e5-954c-4015-8e56-626f7db866a1") : secret "insights-runtime-extractor-tls" not found
Jul 21 20:18:21.280153 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:21.280085    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:21.469595 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:21.469515    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:21.571741 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:21.571711    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:22.234879 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:22.234828    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ea8468e5-954c-4015-8e56-626f7db866a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bhw49\" (UID: \"ea8468e5-954c-4015-8e56-626f7db866a1\") " pod="openshift-insights/insights-runtime-extractor-bhw49"
Jul 21 20:18:22.235092 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:22.234969    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ea8468e5-954c-4015-8e56-626f7db866a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bhw49\" (UID: \"ea8468e5-954c-4015-8e56-626f7db866a1\") " pod="openshift-insights/insights-runtime-extractor-bhw49"
Jul 21 20:18:22.235092 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:22.234985    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 20:18:22.235092 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:22.235039    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 20:18:22.235092 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:22.235057    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea8468e5-954c-4015-8e56-626f7db866a1-insights-runtime-extractor-tls podName:ea8468e5-954c-4015-8e56-626f7db866a1 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:24.235035537 +0000 UTC m=+255.167433671 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ea8468e5-954c-4015-8e56-626f7db866a1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bhw49" (UID: "ea8468e5-954c-4015-8e56-626f7db866a1") : secret "insights-runtime-extractor-tls" not found
Jul 21 20:18:22.235092 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:22.235082    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea8468e5-954c-4015-8e56-626f7db866a1-kube-rbac-proxy-cm podName:ea8468e5-954c-4015-8e56-626f7db866a1 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:24.235070301 +0000 UTC m=+255.167468437 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ea8468e5-954c-4015-8e56-626f7db866a1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bhw49" (UID: "ea8468e5-954c-4015-8e56-626f7db866a1") : configmap "kube-rbac-proxy" not found
Jul 21 20:18:22.460437 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:22.460403    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tttht_38dce886-864e-4891-aa0c-80b892634b99/dns-node-resolver/0.log"
Jul 21 20:18:22.939955 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:22.939906    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/736f340d-c51f-430c-927b-313fffbe0f68-metrics-certs\") pod \"router-default-5b5b675cf6-8dh6k\" (UID: \"736f340d-c51f-430c-927b-313fffbe0f68\") " pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:22.939955 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:22.939953    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736f340d-c51f-430c-927b-313fffbe0f68-service-ca-bundle\") pod \"router-default-5b5b675cf6-8dh6k\" (UID: \"736f340d-c51f-430c-927b-313fffbe0f68\") " pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:22.940365 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:22.940050    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 20:18:22.940365 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:22.940114    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/736f340d-c51f-430c-927b-313fffbe0f68-service-ca-bundle podName:736f340d-c51f-430c-927b-313fffbe0f68 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:30.940095439 +0000 UTC m=+261.872493573 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/736f340d-c51f-430c-927b-313fffbe0f68-service-ca-bundle") pod "router-default-5b5b675cf6-8dh6k" (UID: "736f340d-c51f-430c-927b-313fffbe0f68") : configmap references non-existent config key: service-ca.crt
Jul 21 20:18:22.940365 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:22.940158    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/736f340d-c51f-430c-927b-313fffbe0f68-metrics-certs podName:736f340d-c51f-430c-927b-313fffbe0f68 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:30.940137049 +0000 UTC m=+261.872535198 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/736f340d-c51f-430c-927b-313fffbe0f68-metrics-certs") pod "router-default-5b5b675cf6-8dh6k" (UID: "736f340d-c51f-430c-927b-313fffbe0f68") : secret "router-metrics-certs-default" not found
Jul 21 20:18:23.040962 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:23.040924    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-registry-tls\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:23.041145 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:23.041029    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/51496923-9549-4107-ba0b-29970f8afce2-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-hth4f\" (UID: \"51496923-9549-4107-ba0b-29970f8afce2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hth4f"
Jul 21 20:18:23.041145 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:23.041099    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 20:18:23.041145 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:23.041113    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 20:18:23.041145 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:23.041123    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74dcbdb6fc-6tzkz: secret "image-registry-tls" not found
Jul 21 20:18:23.041345 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:23.041171    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51496923-9549-4107-ba0b-29970f8afce2-samples-operator-tls podName:51496923-9549-4107-ba0b-29970f8afce2 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:31.041157706 +0000 UTC m=+261.973555841 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/51496923-9549-4107-ba0b-29970f8afce2-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-hth4f" (UID: "51496923-9549-4107-ba0b-29970f8afce2") : secret "samples-operator-tls" not found
Jul 21 20:18:23.041345 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:23.041187    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-registry-tls podName:cfe49a9e-c954-4b0c-b8db-8bc33d8f686d nodeName:}" failed. No retries permitted until 2026-07-21 20:18:31.041177967 +0000 UTC m=+261.973576102 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-registry-tls") pod "image-registry-74dcbdb6fc-6tzkz" (UID: "cfe49a9e-c954-4b0c-b8db-8bc33d8f686d") : secret "image-registry-tls" not found
Jul 21 20:18:23.102073 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:23.102023    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:23.164243 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:23.164211    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:23.660633 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:23.660603    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j55fg_20c1b2ab-1a68-456f-bf0c-53417e458643/node-ca/0.log"
Jul 21 20:18:23.665076 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:23.665053    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:23.753212 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:23.753181    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:24.093829 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:24.093796    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:24.249800 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:24.249762    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ea8468e5-954c-4015-8e56-626f7db866a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bhw49\" (UID: \"ea8468e5-954c-4015-8e56-626f7db866a1\") " pod="openshift-insights/insights-runtime-extractor-bhw49"
Jul 21 20:18:24.249906 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:24.249810    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ea8468e5-954c-4015-8e56-626f7db866a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bhw49\" (UID: \"ea8468e5-954c-4015-8e56-626f7db866a1\") " pod="openshift-insights/insights-runtime-extractor-bhw49"
Jul 21 20:18:24.249906 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:24.249890    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 20:18:24.249971 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:24.249930    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 20:18:24.249971 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:24.249958    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea8468e5-954c-4015-8e56-626f7db866a1-kube-rbac-proxy-cm podName:ea8468e5-954c-4015-8e56-626f7db866a1 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:28.249942743 +0000 UTC m=+259.182340878 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ea8468e5-954c-4015-8e56-626f7db866a1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bhw49" (UID: "ea8468e5-954c-4015-8e56-626f7db866a1") : configmap "kube-rbac-proxy" not found
Jul 21 20:18:24.250039 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:24.249972    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea8468e5-954c-4015-8e56-626f7db866a1-insights-runtime-extractor-tls podName:ea8468e5-954c-4015-8e56-626f7db866a1 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:28.249966505 +0000 UTC m=+259.182364641 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ea8468e5-954c-4015-8e56-626f7db866a1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bhw49" (UID: "ea8468e5-954c-4015-8e56-626f7db866a1") : secret "insights-runtime-extractor-tls" not found
Jul 21 20:18:24.262665 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:24.262645    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dnn52_e23c3058-7bcf-4207-878a-1fb665d74d22/serve-healthcheck-canary/0.log"
Jul 21 20:18:24.719820 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:24.719779    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:24.827764 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:24.827716    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:25.008654 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:25.008619    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:25.155498 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:25.155461    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:25.260664 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:25.260592    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:25.427610 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:25.427543    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:25.625877 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:25.625776    2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-w885b"
Jul 21 20:18:25.625877 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:25.625870    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-w885b"
Jul 21 20:18:25.626192 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:25.626179    2576 scope.go:117] "RemoveContainer" containerID="fb820b4ea251cc677843224aa9b53ef0a83cded72a639c53ea8bf3d38dfbdb5f"
Jul 21 20:18:25.626368 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:25.626347    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-w885b_openshift-console-operator(62db291a-14b7-4e35-9550-9fb810f82b8d)\"" pod="openshift-console-operator/console-operator-565b7b569d-w885b" podUID="62db291a-14b7-4e35-9550-9fb810f82b8d"
Jul 21 20:18:26.310139 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:26.310109    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:26.817655 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:26.817622    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:27.020092 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:27.020063    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:27.225943 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:27.225857    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:27.409127 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:27.409094    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:27.607113 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:27.607084    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:28.283615 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:28.283573    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ea8468e5-954c-4015-8e56-626f7db866a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bhw49\" (UID: \"ea8468e5-954c-4015-8e56-626f7db866a1\") " pod="openshift-insights/insights-runtime-extractor-bhw49"
Jul 21 20:18:28.283837 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:28.283626    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ea8468e5-954c-4015-8e56-626f7db866a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bhw49\" (UID: \"ea8468e5-954c-4015-8e56-626f7db866a1\") " pod="openshift-insights/insights-runtime-extractor-bhw49"
Jul 21 20:18:28.283837 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:28.283723    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 20:18:28.283837 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:28.283789    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea8468e5-954c-4015-8e56-626f7db866a1-kube-rbac-proxy-cm podName:ea8468e5-954c-4015-8e56-626f7db866a1 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:36.283772571 +0000 UTC m=+267.216170707 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ea8468e5-954c-4015-8e56-626f7db866a1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bhw49" (UID: "ea8468e5-954c-4015-8e56-626f7db866a1") : configmap "kube-rbac-proxy" not found
Jul 21 20:18:28.283837 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:28.283790    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 20:18:28.283837 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:28.283819    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea8468e5-954c-4015-8e56-626f7db866a1-insights-runtime-extractor-tls podName:ea8468e5-954c-4015-8e56-626f7db866a1 nodeName:}" failed. No retries permitted until 2026-07-21 20:18:36.28381265 +0000 UTC m=+267.216210785 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ea8468e5-954c-4015-8e56-626f7db866a1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bhw49" (UID: "ea8468e5-954c-4015-8e56-626f7db866a1") : secret "insights-runtime-extractor-tls" not found
Jul 21 20:18:28.408677 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:28.408641    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:28.483073 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:28.483044    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:28.625605 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:28.625522    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:28.804229 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:28.804195    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:29.032758 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:29.032730    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:29.218610 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:29.218575    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:29.608611 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:29.608575    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:30.205827 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:30.205793    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:30.597471 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:30.597431    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:30.804884 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:30.804852    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:31.005419 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:31.005286    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/736f340d-c51f-430c-927b-313fffbe0f68-metrics-certs\") pod \"router-default-5b5b675cf6-8dh6k\" (UID: \"736f340d-c51f-430c-927b-313fffbe0f68\") " pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:31.005419 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:31.005330    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736f340d-c51f-430c-927b-313fffbe0f68-service-ca-bundle\") pod \"router-default-5b5b675cf6-8dh6k\" (UID: \"736f340d-c51f-430c-927b-313fffbe0f68\") " pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:31.006028 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:31.006005    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/736f340d-c51f-430c-927b-313fffbe0f68-service-ca-bundle\") pod \"router-default-5b5b675cf6-8dh6k\" (UID: \"736f340d-c51f-430c-927b-313fffbe0f68\") " pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:31.007576 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:31.007559    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/736f340d-c51f-430c-927b-313fffbe0f68-metrics-certs\") pod \"router-default-5b5b675cf6-8dh6k\" (UID: \"736f340d-c51f-430c-927b-313fffbe0f68\") " pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:31.106546 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:31.106499    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-registry-tls\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:31.106784 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:31.106593    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/51496923-9549-4107-ba0b-29970f8afce2-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-hth4f\" (UID: \"51496923-9549-4107-ba0b-29970f8afce2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hth4f"
Jul 21 20:18:31.108936 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:31.108913    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-registry-tls\") pod \"image-registry-74dcbdb6fc-6tzkz\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") " pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:31.109029 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:31.108976    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/51496923-9549-4107-ba0b-29970f8afce2-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-hth4f\" (UID: \"51496923-9549-4107-ba0b-29970f8afce2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hth4f"
Jul 21 20:18:31.123954 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:31.123917    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:31.139761 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:31.139735    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:31.234293 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:31.234266    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:31.239850 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:31.239823    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:31.240639 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:31.240617    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hth4f"
Jul 21 20:18:31.250334 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:31.250309    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b5b675cf6-8dh6k"]
Jul 21 20:18:31.252679 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:18:31.252656    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod736f340d_c51f_430c_927b_313fffbe0f68.slice/crio-71a9b83f5419e6621378d19e27de502b6f22e7fd2bd1d5d66dea3a99ffde690a WatchSource:0}: Error finding container 71a9b83f5419e6621378d19e27de502b6f22e7fd2bd1d5d66dea3a99ffde690a: Status 404 returned error can't find the container with id 71a9b83f5419e6621378d19e27de502b6f22e7fd2bd1d5d66dea3a99ffde690a
Jul 21 20:18:31.378608 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:31.378576    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"]
Jul 21 20:18:31.381322 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:18:31.381291    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfe49a9e_c954_4b0c_b8db_8bc33d8f686d.slice/crio-f8706b58e112f5d4297ac5590cff57cddf4f48ff2b3629a1d6dd21dee7301093 WatchSource:0}: Error finding container f8706b58e112f5d4297ac5590cff57cddf4f48ff2b3629a1d6dd21dee7301093: Status 404 returned error can't find the container with id f8706b58e112f5d4297ac5590cff57cddf4f48ff2b3629a1d6dd21dee7301093
Jul 21 20:18:31.393599 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:31.393565    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hth4f"]
Jul 21 20:18:31.418469 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:31.418441    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz" event={"ID":"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d","Type":"ContainerStarted","Data":"f8706b58e112f5d4297ac5590cff57cddf4f48ff2b3629a1d6dd21dee7301093"}
Jul 21 20:18:31.420202 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:31.420170    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b5b675cf6-8dh6k" event={"ID":"736f340d-c51f-430c-927b-313fffbe0f68","Type":"ContainerStarted","Data":"d6ba37cf9ac48ebf5e2853ee12b9b3f481c5fbfbb481da4099b187bf447bccfe"}
Jul 21 20:18:31.420315 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:31.420224    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b5b675cf6-8dh6k" event={"ID":"736f340d-c51f-430c-927b-313fffbe0f68","Type":"ContainerStarted","Data":"71a9b83f5419e6621378d19e27de502b6f22e7fd2bd1d5d66dea3a99ffde690a"}
Jul 21 20:18:31.439603 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:31.439556    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5b5b675cf6-8dh6k" podStartSLOduration=16.43953862 podStartE2EDuration="16.43953862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:18:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:18:31.438223872 +0000 UTC m=+262.370622037" watchObservedRunningTime="2026-07-21 20:18:31.43953862 +0000 UTC m=+262.371936776"
Jul 21 20:18:31.805402 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:31.805361    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:32.125129 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:32.125041    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:32.128036 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:32.128009    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:32.420722 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:32.420618    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:32.425141 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:32.425110    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz" event={"ID":"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d","Type":"ContainerStarted","Data":"223016f2ca0b179b5e9362ea6a30d21e96bf80eef10966cd6413f7396952f7ec"}
Jul 21 20:18:32.425310 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:32.425201    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:18:32.426418 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:32.426388    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hth4f" event={"ID":"51496923-9549-4107-ba0b-29970f8afce2","Type":"ContainerStarted","Data":"73337da237d70769bf5b4490fb4b1deadbc7c70b8678b63ce3f1159f0a77b9bb"}
Jul 21 20:18:32.426775 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:32.426682    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:32.428028 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:32.428009    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5b5b675cf6-8dh6k"
Jul 21 20:18:32.448874 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:32.448817    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz" podStartSLOduration=17.448801039 podStartE2EDuration="17.448801039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:18:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:18:32.447592426 +0000 UTC m=+263.379990610" watchObservedRunningTime="2026-07-21 20:18:32.448801039 +0000 UTC m=+263.381199197"
Jul 21 20:18:32.606741 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:32.606712    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:33.024993 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:33.024962    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:33.206278 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:33.206245    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:33.431541 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:33.431499    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hth4f" event={"ID":"51496923-9549-4107-ba0b-29970f8afce2","Type":"ContainerStarted","Data":"964a927adf3ea2b914621eb8195b88b2ff2a554d225a192da63eaf7d31f01d55"}
Jul 21 20:18:33.431735 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:33.431554    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hth4f" event={"ID":"51496923-9549-4107-ba0b-29970f8afce2","Type":"ContainerStarted","Data":"08cff3b356919dcc2928ba68efe9cb9def485419c435ee471f13e83630c9d95a"}
Jul 21 20:18:33.449786 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:33.449727    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-hth4f" podStartSLOduration=16.615894991 podStartE2EDuration="18.449711469s" totalImagesPullingTime="1.833816478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:18:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:18:33.448095116 +0000 UTC m=+264.380493274" watchObservedRunningTime="2026-07-21 20:18:33.449711469 +0000 UTC m=+264.382109625"
Jul 21 20:18:33.599194 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:33.599117    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:33.726209 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:33.726178    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:34.400529 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:34.400492    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:34.608788 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:34.608754    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:34.832105 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:34.832073    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:35.011362 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:35.011335    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:35.208339 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:35.208265    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:35.407197 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:35.407163    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:36.351277 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:36.351233    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ea8468e5-954c-4015-8e56-626f7db866a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bhw49\" (UID: \"ea8468e5-954c-4015-8e56-626f7db866a1\") " pod="openshift-insights/insights-runtime-extractor-bhw49"
Jul 21 20:18:36.351468 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:36.351287    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ea8468e5-954c-4015-8e56-626f7db866a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bhw49\" (UID: \"ea8468e5-954c-4015-8e56-626f7db866a1\") " pod="openshift-insights/insights-runtime-extractor-bhw49"
Jul 21 20:18:36.351815 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:36.351792    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ea8468e5-954c-4015-8e56-626f7db866a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bhw49\" (UID: \"ea8468e5-954c-4015-8e56-626f7db866a1\") " pod="openshift-insights/insights-runtime-extractor-bhw49"
Jul 21 20:18:36.353556 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:36.353534    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ea8468e5-954c-4015-8e56-626f7db866a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bhw49\" (UID: \"ea8468e5-954c-4015-8e56-626f7db866a1\") " pod="openshift-insights/insights-runtime-extractor-bhw49"
Jul 21 20:18:36.400504 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:36.400467    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bhw49"
Jul 21 20:18:36.448385 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:36.448349    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:36.543645 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:36.543000    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bhw49"]
Jul 21 20:18:36.545146 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:18:36.545114    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea8468e5_954c_4015_8e56_626f7db866a1.slice/crio-b12198b244e365de4944f6977bc5ffe8538cfa762e7fbb62f46daaebc02bcdeb WatchSource:0}: Error finding container b12198b244e365de4944f6977bc5ffe8538cfa762e7fbb62f46daaebc02bcdeb: Status 404 returned error can't find the container with id b12198b244e365de4944f6977bc5ffe8538cfa762e7fbb62f46daaebc02bcdeb
Jul 21 20:18:36.601730 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:36.601623    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:37.447153 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:37.447003    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bhw49" event={"ID":"ea8468e5-954c-4015-8e56-626f7db866a1","Type":"ContainerStarted","Data":"b12198b244e365de4944f6977bc5ffe8538cfa762e7fbb62f46daaebc02bcdeb"}
Jul 21 20:18:40.645725 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:40.645473    2576 scope.go:117] "RemoveContainer" containerID="fb820b4ea251cc677843224aa9b53ef0a83cded72a639c53ea8bf3d38dfbdb5f"
Jul 21 20:18:42.469276 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:42.469239    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w885b_62db291a-14b7-4e35-9550-9fb810f82b8d/console-operator/1.log"
Jul 21 20:18:42.469719 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:42.469354    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-w885b" event={"ID":"62db291a-14b7-4e35-9550-9fb810f82b8d","Type":"ContainerStarted","Data":"00fb65b7b86e380cbf60d0e0e049c3ee29b33e056cad1fdbcfe57f360814f5df"}
Jul 21 20:18:42.469901 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:42.469838    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-w885b"
Jul 21 20:18:42.471953 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:42.471890    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bhw49" event={"ID":"ea8468e5-954c-4015-8e56-626f7db866a1","Type":"ContainerStarted","Data":"c66e0582860fafa102c76888671cc185ca57706bab8ca5f60e50f1214b43fc9e"}
Jul 21 20:18:42.488200 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:42.488133    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-w885b" podStartSLOduration=25.297866077 podStartE2EDuration="27.488113744s" totalImagesPullingTime="2.190247667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:18:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:18:42.487706455 +0000 UTC m=+273.420104613" watchObservedRunningTime="2026-07-21 20:18:42.488113744 +0000 UTC m=+273.420511902"
Jul 21 20:18:42.577968 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:42.577923    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:42.729138 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:42.729046    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-w885b"
Jul 21 20:18:42.914208 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:42.914148    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:43.014741 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:43.014707    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:43.413671 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:43.413584    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:43.587246 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:43.587216    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:43.648724 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:43.648676    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:43.813746 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:43.813715    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:44.416290 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:44.416261    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:44.474250 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:44.474181    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:44.592929 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:44.592897    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:44.863619 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:44.863587    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:44.960456 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:44.960424    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"]
Jul 21 20:18:45.023666 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.023619    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6956754d67-pfgpq"]
Jul 21 20:18:45.040886 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.040833    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6956754d67-pfgpq"]
Jul 21 20:18:45.041061 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.040940    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6956754d67-pfgpq"
Jul 21 20:18:45.045807 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.045773    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:45.125483 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.125383    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:45.225545 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.225520    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a084aa9c-59d0-484b-a16d-ee606fb51418-ca-trust-extracted\") pod \"image-registry-6956754d67-pfgpq\" (UID: \"a084aa9c-59d0-484b-a16d-ee606fb51418\") " pod="openshift-image-registry/image-registry-6956754d67-pfgpq"
Jul 21 20:18:45.225671 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.225561    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a084aa9c-59d0-484b-a16d-ee606fb51418-trusted-ca\") pod \"image-registry-6956754d67-pfgpq\" (UID: \"a084aa9c-59d0-484b-a16d-ee606fb51418\") " pod="openshift-image-registry/image-registry-6956754d67-pfgpq"
Jul 21 20:18:45.225671 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.225635    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a084aa9c-59d0-484b-a16d-ee606fb51418-image-registry-private-configuration\") pod \"image-registry-6956754d67-pfgpq\" (UID: \"a084aa9c-59d0-484b-a16d-ee606fb51418\") " pod="openshift-image-registry/image-registry-6956754d67-pfgpq"
Jul 21 20:18:45.225767 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.225671    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a084aa9c-59d0-484b-a16d-ee606fb51418-bound-sa-token\") pod \"image-registry-6956754d67-pfgpq\" (UID: \"a084aa9c-59d0-484b-a16d-ee606fb51418\") " pod="openshift-image-registry/image-registry-6956754d67-pfgpq"
Jul 21 20:18:45.225767 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.225725    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a084aa9c-59d0-484b-a16d-ee606fb51418-registry-certificates\") pod \"image-registry-6956754d67-pfgpq\" (UID: \"a084aa9c-59d0-484b-a16d-ee606fb51418\") " pod="openshift-image-registry/image-registry-6956754d67-pfgpq"
Jul 21 20:18:45.225767 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.225759    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a084aa9c-59d0-484b-a16d-ee606fb51418-installation-pull-secrets\") pod \"image-registry-6956754d67-pfgpq\" (UID: \"a084aa9c-59d0-484b-a16d-ee606fb51418\") " pod="openshift-image-registry/image-registry-6956754d67-pfgpq"
Jul 21 20:18:45.225859 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.225798    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s2ts\" (UniqueName: \"kubernetes.io/projected/a084aa9c-59d0-484b-a16d-ee606fb51418-kube-api-access-6s2ts\") pod \"image-registry-6956754d67-pfgpq\" (UID: \"a084aa9c-59d0-484b-a16d-ee606fb51418\") " pod="openshift-image-registry/image-registry-6956754d67-pfgpq"
Jul 21 20:18:45.225859 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.225848    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a084aa9c-59d0-484b-a16d-ee606fb51418-registry-tls\") pod \"image-registry-6956754d67-pfgpq\" (UID: \"a084aa9c-59d0-484b-a16d-ee606fb51418\") " pod="openshift-image-registry/image-registry-6956754d67-pfgpq"
Jul 21 20:18:45.327051 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.327019    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a084aa9c-59d0-484b-a16d-ee606fb51418-ca-trust-extracted\") pod \"image-registry-6956754d67-pfgpq\" (UID: \"a084aa9c-59d0-484b-a16d-ee606fb51418\") " pod="openshift-image-registry/image-registry-6956754d67-pfgpq"
Jul 21 20:18:45.327051 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.327068    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a084aa9c-59d0-484b-a16d-ee606fb51418-trusted-ca\") pod \"image-registry-6956754d67-pfgpq\" (UID: \"a084aa9c-59d0-484b-a16d-ee606fb51418\") " pod="openshift-image-registry/image-registry-6956754d67-pfgpq"
Jul 21 20:18:45.327284 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.327092    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a084aa9c-59d0-484b-a16d-ee606fb51418-image-registry-private-configuration\") pod \"image-registry-6956754d67-pfgpq\" (UID: \"a084aa9c-59d0-484b-a16d-ee606fb51418\") " pod="openshift-image-registry/image-registry-6956754d67-pfgpq"
Jul 21 20:18:45.327284 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.327118    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a084aa9c-59d0-484b-a16d-ee606fb51418-bound-sa-token\") pod \"image-registry-6956754d67-pfgpq\" (UID: \"a084aa9c-59d0-484b-a16d-ee606fb51418\") " pod="openshift-image-registry/image-registry-6956754d67-pfgpq"
Jul 21 20:18:45.327284 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.327162    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a084aa9c-59d0-484b-a16d-ee606fb51418-registry-certificates\") pod \"image-registry-6956754d67-pfgpq\" (UID: \"a084aa9c-59d0-484b-a16d-ee606fb51418\") " pod="openshift-image-registry/image-registry-6956754d67-pfgpq"
Jul 21 20:18:45.327284 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.327199    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a084aa9c-59d0-484b-a16d-ee606fb51418-installation-pull-secrets\") pod \"image-registry-6956754d67-pfgpq\" (UID: \"a084aa9c-59d0-484b-a16d-ee606fb51418\") " pod="openshift-image-registry/image-registry-6956754d67-pfgpq"
Jul 21 20:18:45.327284 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.327237    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s2ts\" (UniqueName: \"kubernetes.io/projected/a084aa9c-59d0-484b-a16d-ee606fb51418-kube-api-access-6s2ts\") pod \"image-registry-6956754d67-pfgpq\" (UID: \"a084aa9c-59d0-484b-a16d-ee606fb51418\") " pod="openshift-image-registry/image-registry-6956754d67-pfgpq"
Jul 21 20:18:45.327519 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.327308    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a084aa9c-59d0-484b-a16d-ee606fb51418-registry-tls\") pod \"image-registry-6956754d67-pfgpq\" (UID: \"a084aa9c-59d0-484b-a16d-ee606fb51418\") " pod="openshift-image-registry/image-registry-6956754d67-pfgpq"
Jul 21 20:18:45.327583 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.327529    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a084aa9c-59d0-484b-a16d-ee606fb51418-ca-trust-extracted\") pod \"image-registry-6956754d67-pfgpq\" (UID: \"a084aa9c-59d0-484b-a16d-ee606fb51418\") " pod="openshift-image-registry/image-registry-6956754d67-pfgpq"
Jul 21 20:18:45.328119 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.328096    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a084aa9c-59d0-484b-a16d-ee606fb51418-registry-certificates\") pod \"image-registry-6956754d67-pfgpq\" (UID: \"a084aa9c-59d0-484b-a16d-ee606fb51418\") " pod="openshift-image-registry/image-registry-6956754d67-pfgpq"
Jul 21 20:18:45.328222 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.328128    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a084aa9c-59d0-484b-a16d-ee606fb51418-trusted-ca\") pod \"image-registry-6956754d67-pfgpq\" (UID: \"a084aa9c-59d0-484b-a16d-ee606fb51418\") " pod="openshift-image-registry/image-registry-6956754d67-pfgpq"
Jul 21 20:18:45.329589 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.329569    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a084aa9c-59d0-484b-a16d-ee606fb51418-installation-pull-secrets\") pod \"image-registry-6956754d67-pfgpq\" (UID: \"a084aa9c-59d0-484b-a16d-ee606fb51418\") " pod="openshift-image-registry/image-registry-6956754d67-pfgpq"
Jul 21 20:18:45.329682 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.329607    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a084aa9c-59d0-484b-a16d-ee606fb51418-image-registry-private-configuration\") pod \"image-registry-6956754d67-pfgpq\" (UID: \"a084aa9c-59d0-484b-a16d-ee606fb51418\") " pod="openshift-image-registry/image-registry-6956754d67-pfgpq"
Jul 21 20:18:45.329762 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.329749    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a084aa9c-59d0-484b-a16d-ee606fb51418-registry-tls\") pod \"image-registry-6956754d67-pfgpq\" (UID: \"a084aa9c-59d0-484b-a16d-ee606fb51418\") " pod="openshift-image-registry/image-registry-6956754d67-pfgpq"
Jul 21 20:18:45.336858 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.336834    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s2ts\" (UniqueName: \"kubernetes.io/projected/a084aa9c-59d0-484b-a16d-ee606fb51418-kube-api-access-6s2ts\") pod \"image-registry-6956754d67-pfgpq\" (UID: \"a084aa9c-59d0-484b-a16d-ee606fb51418\") " pod="openshift-image-registry/image-registry-6956754d67-pfgpq"
Jul 21 20:18:45.336949 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.336843    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a084aa9c-59d0-484b-a16d-ee606fb51418-bound-sa-token\") pod \"image-registry-6956754d67-pfgpq\" (UID: \"a084aa9c-59d0-484b-a16d-ee606fb51418\") " pod="openshift-image-registry/image-registry-6956754d67-pfgpq"
Jul 21 20:18:45.345932 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.345910    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:45.351875 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.351857    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6956754d67-pfgpq"
Jul 21 20:18:45.486871 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.486840    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bhw49" event={"ID":"ea8468e5-954c-4015-8e56-626f7db866a1","Type":"ContainerStarted","Data":"b12486391dc21203b4fc2178b56bba5872ec2e113aa517f089366be54bcc2e53"}
Jul 21 20:18:45.527006 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:45.526976    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6956754d67-pfgpq"]
Jul 21 20:18:45.530683 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:18:45.530657    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda084aa9c_59d0_484b_a16d_ee606fb51418.slice/crio-526be5f84d6954a94dfbd7e95fdb8d9dd2ff738dbccdfc0f0dcf3007396de504 WatchSource:0}: Error finding container 526be5f84d6954a94dfbd7e95fdb8d9dd2ff738dbccdfc0f0dcf3007396de504: Status 404 returned error can't find the container with id 526be5f84d6954a94dfbd7e95fdb8d9dd2ff738dbccdfc0f0dcf3007396de504
Jul 21 20:18:46.492615 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:46.492565    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6956754d67-pfgpq" event={"ID":"a084aa9c-59d0-484b-a16d-ee606fb51418","Type":"ContainerStarted","Data":"3a4ce929210ab2b1e73df52563e9575f3d6abba41a099609ce1117b2e0083911"}
Jul 21 20:18:46.493148 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:46.492625    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6956754d67-pfgpq" event={"ID":"a084aa9c-59d0-484b-a16d-ee606fb51418","Type":"ContainerStarted","Data":"526be5f84d6954a94dfbd7e95fdb8d9dd2ff738dbccdfc0f0dcf3007396de504"}
Jul 21 20:18:46.493148 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:46.492663    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6956754d67-pfgpq"
Jul 21 20:18:46.518230 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:46.518167    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6956754d67-pfgpq" podStartSLOduration=2.518146131 podStartE2EDuration="2.518146131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:18:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:18:46.517058259 +0000 UTC m=+277.449456416" watchObservedRunningTime="2026-07-21 20:18:46.518146131 +0000 UTC m=+277.450544282"
Jul 21 20:18:49.504816 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:49.504778    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bhw49" event={"ID":"ea8468e5-954c-4015-8e56-626f7db866a1","Type":"ContainerStarted","Data":"02987c97773f4ad1910309a3e43108915cee039f5455551272f8b34660405b2d"}
Jul 21 20:18:49.523319 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:49.523266    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bhw49" podStartSLOduration=17.424069415 podStartE2EDuration="29.523250742s" totalImagesPullingTime="12.099181327s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:18:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:18:49.522326942 +0000 UTC m=+280.454725099" watchObservedRunningTime="2026-07-21 20:18:49.523250742 +0000 UTC m=+280.455648899"
Jul 21 20:18:50.784334 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:50.784297    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:50.884267 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:50.884231    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:50.950931 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:50.950890    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:51.140188 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:18:51.140090    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-666gc" podUID="835a703c-f349-475e-b945-9291e474ad83"
Jul 21 20:18:51.143159 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:51.143134    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:51.511317 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:51.511287    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-666gc"
Jul 21 20:18:53.982077 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:53.982042    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:54.055642 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:54.055598    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:54.203612 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:54.203563    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:54.966648 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:54.966612    2576 patch_prober.go:28] interesting pod/image-registry-74dcbdb6fc-6tzkz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 21 20:18:54.966822 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:54.966666    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz" podUID="cfe49a9e-c954-4b0c-b8db-8bc33d8f686d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 20:18:55.002122 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:55.002088    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls\") pod \"dns-default-666gc\" (UID: \"835a703c-f349-475e-b945-9291e474ad83\") " pod="openshift-dns/dns-default-666gc"
Jul 21 20:18:55.004287 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:55.004268    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/835a703c-f349-475e-b945-9291e474ad83-metrics-tls\") pod \"dns-default-666gc\" (UID: \"835a703c-f349-475e-b945-9291e474ad83\") " pod="openshift-dns/dns-default-666gc"
Jul 21 20:18:55.114935 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:55.114900    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v6nlp\""
Jul 21 20:18:55.122849 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:55.122825    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-666gc"
Jul 21 20:18:55.251474 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:55.251399    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-666gc"]
Jul 21 20:18:55.254410 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:18:55.254381    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod835a703c_f349_475e_b945_9291e474ad83.slice/crio-6d52f749de85a6be179e9fe3a6593b7540400424e367cb5ac6f22d77ee995d11 WatchSource:0}: Error finding container 6d52f749de85a6be179e9fe3a6593b7540400424e367cb5ac6f22d77ee995d11: Status 404 returned error can't find the container with id 6d52f749de85a6be179e9fe3a6593b7540400424e367cb5ac6f22d77ee995d11
Jul 21 20:18:55.524646 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:55.524614    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-666gc" event={"ID":"835a703c-f349-475e-b945-9291e474ad83","Type":"ContainerStarted","Data":"6d52f749de85a6be179e9fe3a6593b7540400424e367cb5ac6f22d77ee995d11"}
Jul 21 20:18:57.241244 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:57.241212    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:18:57.533732 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:57.533676    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-666gc" event={"ID":"835a703c-f349-475e-b945-9291e474ad83","Type":"ContainerStarted","Data":"25a4e7b37ae90974ad88023fdd034d1ab319fa97c7264aa8d1fcbdede0a42fbe"}
Jul 21 20:18:57.533928 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:57.533752    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-666gc" event={"ID":"835a703c-f349-475e-b945-9291e474ad83","Type":"ContainerStarted","Data":"c26beaedccb9d6de8ea85ba71de6562bbbee78f2620b385ffdca82dfd8342413"}
Jul 21 20:18:57.533928 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:57.533796    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-666gc"
Jul 21 20:18:57.570142 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:57.567592    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-666gc" podStartSLOduration=252.093145128 podStartE2EDuration="4m13.567568998s" totalImagesPullingTime="1.47442387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:18:57.565265955 +0000 UTC m=+288.497664112" watchObservedRunningTime="2026-07-21 20:18:57.567568998 +0000 UTC m=+288.499967158"
Jul 21 20:18:57.903744 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:18:57.903645    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:00.133294 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.133242    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:00.258794 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.258762    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:00.370985 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.370935    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:00.419492 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.419391    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vfdbh"]
Jul 21 20:19:00.421506 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.421481    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.423833 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.423806    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 20:19:00.424472 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.424455    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 20:19:00.424656 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.424644    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 20:19:00.424871 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.424856    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 20:19:00.425375 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.425356    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 20:19:00.425457 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.425384    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xnqx8\""
Jul 21 20:19:00.427952 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.427936    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 20:19:00.446641 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.446607    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e66a2c6b-c268-41f4-bded-727ee846c342-metrics-client-ca\") pod \"node-exporter-vfdbh\" (UID: \"e66a2c6b-c268-41f4-bded-727ee846c342\") " pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.446641 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.446646    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e66a2c6b-c268-41f4-bded-727ee846c342-root\") pod \"node-exporter-vfdbh\" (UID: \"e66a2c6b-c268-41f4-bded-727ee846c342\") " pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.446902 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.446664    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e66a2c6b-c268-41f4-bded-727ee846c342-node-exporter-textfile\") pod \"node-exporter-vfdbh\" (UID: \"e66a2c6b-c268-41f4-bded-727ee846c342\") " pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.446902 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.446710    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e66a2c6b-c268-41f4-bded-727ee846c342-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vfdbh\" (UID: \"e66a2c6b-c268-41f4-bded-727ee846c342\") " pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.446902 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.446796    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwjlk\" (UniqueName: \"kubernetes.io/projected/e66a2c6b-c268-41f4-bded-727ee846c342-kube-api-access-bwjlk\") pod \"node-exporter-vfdbh\" (UID: \"e66a2c6b-c268-41f4-bded-727ee846c342\") " pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.446902 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.446838    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e66a2c6b-c268-41f4-bded-727ee846c342-sys\") pod \"node-exporter-vfdbh\" (UID: \"e66a2c6b-c268-41f4-bded-727ee846c342\") " pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.447091 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.446953    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e66a2c6b-c268-41f4-bded-727ee846c342-node-exporter-wtmp\") pod \"node-exporter-vfdbh\" (UID: \"e66a2c6b-c268-41f4-bded-727ee846c342\") " pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.447091 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.446985    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e66a2c6b-c268-41f4-bded-727ee846c342-node-exporter-accelerators-collector-config\") pod \"node-exporter-vfdbh\" (UID: \"e66a2c6b-c268-41f4-bded-727ee846c342\") " pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.447091 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.447019    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e66a2c6b-c268-41f4-bded-727ee846c342-node-exporter-tls\") pod \"node-exporter-vfdbh\" (UID: \"e66a2c6b-c268-41f4-bded-727ee846c342\") " pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.465885 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.465854    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:00.548416 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.548384    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e66a2c6b-c268-41f4-bded-727ee846c342-node-exporter-wtmp\") pod \"node-exporter-vfdbh\" (UID: \"e66a2c6b-c268-41f4-bded-727ee846c342\") " pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.548416 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.548418    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e66a2c6b-c268-41f4-bded-727ee846c342-node-exporter-accelerators-collector-config\") pod \"node-exporter-vfdbh\" (UID: \"e66a2c6b-c268-41f4-bded-727ee846c342\") " pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.548647 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.548447    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e66a2c6b-c268-41f4-bded-727ee846c342-node-exporter-tls\") pod \"node-exporter-vfdbh\" (UID: \"e66a2c6b-c268-41f4-bded-727ee846c342\") " pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.548647 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.548480    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e66a2c6b-c268-41f4-bded-727ee846c342-metrics-client-ca\") pod \"node-exporter-vfdbh\" (UID: \"e66a2c6b-c268-41f4-bded-727ee846c342\") " pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.548647 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.548511    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e66a2c6b-c268-41f4-bded-727ee846c342-root\") pod \"node-exporter-vfdbh\" (UID: \"e66a2c6b-c268-41f4-bded-727ee846c342\") " pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.548647 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.548531    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e66a2c6b-c268-41f4-bded-727ee846c342-node-exporter-textfile\") pod \"node-exporter-vfdbh\" (UID: \"e66a2c6b-c268-41f4-bded-727ee846c342\") " pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.548647 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.548554    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e66a2c6b-c268-41f4-bded-727ee846c342-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vfdbh\" (UID: \"e66a2c6b-c268-41f4-bded-727ee846c342\") " pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.548647 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.548587    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e66a2c6b-c268-41f4-bded-727ee846c342-node-exporter-wtmp\") pod \"node-exporter-vfdbh\" (UID: \"e66a2c6b-c268-41f4-bded-727ee846c342\") " pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.548647 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.548604    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwjlk\" (UniqueName: \"kubernetes.io/projected/e66a2c6b-c268-41f4-bded-727ee846c342-kube-api-access-bwjlk\") pod \"node-exporter-vfdbh\" (UID: \"e66a2c6b-c268-41f4-bded-727ee846c342\") " pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.548647 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.548610    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e66a2c6b-c268-41f4-bded-727ee846c342-root\") pod \"node-exporter-vfdbh\" (UID: \"e66a2c6b-c268-41f4-bded-727ee846c342\") " pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.548647 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.548633    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e66a2c6b-c268-41f4-bded-727ee846c342-sys\") pod \"node-exporter-vfdbh\" (UID: \"e66a2c6b-c268-41f4-bded-727ee846c342\") " pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.549078 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.548720    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e66a2c6b-c268-41f4-bded-727ee846c342-sys\") pod \"node-exporter-vfdbh\" (UID: \"e66a2c6b-c268-41f4-bded-727ee846c342\") " pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.549130 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.549112    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e66a2c6b-c268-41f4-bded-727ee846c342-node-exporter-accelerators-collector-config\") pod \"node-exporter-vfdbh\" (UID: \"e66a2c6b-c268-41f4-bded-727ee846c342\") " pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.549181 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.549135    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e66a2c6b-c268-41f4-bded-727ee846c342-metrics-client-ca\") pod \"node-exporter-vfdbh\" (UID: \"e66a2c6b-c268-41f4-bded-727ee846c342\") " pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.549221 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.549185    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e66a2c6b-c268-41f4-bded-727ee846c342-node-exporter-textfile\") pod \"node-exporter-vfdbh\" (UID: \"e66a2c6b-c268-41f4-bded-727ee846c342\") " pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.550834 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.550811    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e66a2c6b-c268-41f4-bded-727ee846c342-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vfdbh\" (UID: \"e66a2c6b-c268-41f4-bded-727ee846c342\") " pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.550966 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.550951    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e66a2c6b-c268-41f4-bded-727ee846c342-node-exporter-tls\") pod \"node-exporter-vfdbh\" (UID: \"e66a2c6b-c268-41f4-bded-727ee846c342\") " pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.557073 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.557053    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwjlk\" (UniqueName: \"kubernetes.io/projected/e66a2c6b-c268-41f4-bded-727ee846c342-kube-api-access-bwjlk\") pod \"node-exporter-vfdbh\" (UID: \"e66a2c6b-c268-41f4-bded-727ee846c342\") " pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.561554 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.561531    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:00.717423 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.717319    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:00.731470 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.731439    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vfdbh"
Jul 21 20:19:00.741103 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:19:00.741061    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode66a2c6b_c268_41f4_bded_727ee846c342.slice/crio-bb9032e9c7625ebf49295b39f75f569d88ef9f605c2334343b1ebacb881ab25a WatchSource:0}: Error finding container bb9032e9c7625ebf49295b39f75f569d88ef9f605c2334343b1ebacb881ab25a: Status 404 returned error can't find the container with id bb9032e9c7625ebf49295b39f75f569d88ef9f605c2334343b1ebacb881ab25a
Jul 21 20:19:00.954247 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:00.954213    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:01.095892 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.095845    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:01.185865 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.185834    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:01.439039 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.438952    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:01.526759 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.526726    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:01.533938 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.533910    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 20:19:01.536410 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.536390    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.538790 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.538717    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 21 20:19:01.538790 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.538728    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 21 20:19:01.538790 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.538744    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 21 20:19:01.539020 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.538811    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 21 20:19:01.539020 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.538828    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2wnps\""
Jul 21 20:19:01.539020 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.538866    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 21 20:19:01.539162 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.539056    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 21 20:19:01.539162 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.539096    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 21 20:19:01.539162 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.539094    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 21 20:19:01.539162 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.539144    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 21 20:19:01.551703 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.551653    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vfdbh" event={"ID":"e66a2c6b-c268-41f4-bded-727ee846c342","Type":"ContainerStarted","Data":"bb9032e9c7625ebf49295b39f75f569d88ef9f605c2334343b1ebacb881ab25a"}
Jul 21 20:19:01.568547 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.568518    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 20:19:01.655429 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.655400    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-config-volume\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.655429 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.655438    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.655655 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.655475    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-web-config\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.655655 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.655494    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca368375-4908-4493-9f41-97363f5dc755-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.655655 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.655509    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca368375-4908-4493-9f41-97363f5dc755-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.655655 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.655530    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.655655 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.655546    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca368375-4908-4493-9f41-97363f5dc755-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.655655 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.655634    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.655949 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.655705    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca368375-4908-4493-9f41-97363f5dc755-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.655949 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.655747    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.655949 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.655799    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbmpz\" (UniqueName: \"kubernetes.io/projected/ca368375-4908-4493-9f41-97363f5dc755-kube-api-access-gbmpz\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.655949 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.655831    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca368375-4908-4493-9f41-97363f5dc755-config-out\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.655949 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.655869    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.661425 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.661399    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:01.756866 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.756834    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca368375-4908-4493-9f41-97363f5dc755-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.757032 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.756877    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.757032 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.756914    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbmpz\" (UniqueName: \"kubernetes.io/projected/ca368375-4908-4493-9f41-97363f5dc755-kube-api-access-gbmpz\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.757032 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.756933    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca368375-4908-4493-9f41-97363f5dc755-config-out\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.757032 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.756956    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.757032 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.756978    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-config-volume\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.757032 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.757005    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.758726 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.757398    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-web-config\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.758726 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.757488    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca368375-4908-4493-9f41-97363f5dc755-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.758726 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.757517    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca368375-4908-4493-9f41-97363f5dc755-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.758726 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.757558    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.758726 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.757590    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca368375-4908-4493-9f41-97363f5dc755-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.758726 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.757642    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.758726 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.758286    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca368375-4908-4493-9f41-97363f5dc755-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.758726 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.758633    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca368375-4908-4493-9f41-97363f5dc755-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.759196 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.759111    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca368375-4908-4493-9f41-97363f5dc755-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.759968 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.759943    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca368375-4908-4493-9f41-97363f5dc755-config-out\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.760308 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.760283    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.760640 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.760610    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.761065 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.761044    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.761818 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.761775    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-config-volume\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.761950 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.761929    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.762079 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.762063    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.762258 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.762238    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-web-config\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.762298 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.762277    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca368375-4908-4493-9f41-97363f5dc755-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.765947 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.765924    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbmpz\" (UniqueName: \"kubernetes.io/projected/ca368375-4908-4493-9f41-97363f5dc755-kube-api-access-gbmpz\") pod \"alertmanager-main-0\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.848319 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.848284    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:19:01.993406 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:01.993341    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 20:19:01.995553 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:19:01.995523    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca368375_4908_4493_9f41_97363f5dc755.slice/crio-2b3452210e18e6d579877c9ca22d87dde9b275e13b677ac9dd0b7304858cf9e0 WatchSource:0}: Error finding container 2b3452210e18e6d579877c9ca22d87dde9b275e13b677ac9dd0b7304858cf9e0: Status 404 returned error can't find the container with id 2b3452210e18e6d579877c9ca22d87dde9b275e13b677ac9dd0b7304858cf9e0
Jul 21 20:19:02.361604 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:02.361574    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:02.461308 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:02.461273    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:02.556264 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:02.556228    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca368375-4908-4493-9f41-97363f5dc755","Type":"ContainerStarted","Data":"2b3452210e18e6d579877c9ca22d87dde9b275e13b677ac9dd0b7304858cf9e0"}
Jul 21 20:19:02.557769 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:02.557744    2576 generic.go:356] "Generic (PLEG): container finished" podID="e66a2c6b-c268-41f4-bded-727ee846c342" containerID="81450cddc86159989af3dea1cfd0fdb41bbfc20890805848c7ffa6bf5c96450c" exitCode=0
Jul 21 20:19:02.557899 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:02.557771    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vfdbh" event={"ID":"e66a2c6b-c268-41f4-bded-727ee846c342","Type":"ContainerDied","Data":"81450cddc86159989af3dea1cfd0fdb41bbfc20890805848c7ffa6bf5c96450c"}
Jul 21 20:19:03.475569 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:03.475486    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:03.547426 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:03.547384    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:03.563373 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:03.563341    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vfdbh" event={"ID":"e66a2c6b-c268-41f4-bded-727ee846c342","Type":"ContainerStarted","Data":"7e7e139c659cf790eea186e497e610d5a6d2612daf46e27765a4e2bea7c9747a"}
Jul 21 20:19:03.563523 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:03.563402    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vfdbh" event={"ID":"e66a2c6b-c268-41f4-bded-727ee846c342","Type":"ContainerStarted","Data":"3beb05f2905ab76a56983cc56994d73e4b4cfcd70809bbf0a5fcdc8aac7168ec"}
Jul 21 20:19:03.564857 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:03.564830    2576 generic.go:356] "Generic (PLEG): container finished" podID="ca368375-4908-4493-9f41-97363f5dc755" containerID="4a531c2519a6960056c7d0927d02fae631f96fd8fd8c230f4e523ad8cca3ac74" exitCode=0
Jul 21 20:19:03.564966 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:03.564900    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca368375-4908-4493-9f41-97363f5dc755","Type":"ContainerDied","Data":"4a531c2519a6960056c7d0927d02fae631f96fd8fd8c230f4e523ad8cca3ac74"}
Jul 21 20:19:03.585459 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:03.585406    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vfdbh" podStartSLOduration=2.4815099480000002 podStartE2EDuration="3.585387622s" totalImagesPullingTime="1.031503284s" totalInitContainerRuntime="72.37439ms" isStatefulPod=true podCreationTimestamp="2026-07-21 20:19:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:19:03.584538902 +0000 UTC m=+294.516937059" watchObservedRunningTime="2026-07-21 20:19:03.585387622 +0000 UTC m=+294.517785775"
Jul 21 20:19:03.645762 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:19:03.645720    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-q9fp4" podUID="3712cffa-e355-4c1e-9d88-b133a9eec5b4"
Jul 21 20:19:03.757791 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:03.757755    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:03.855937 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:03.855904    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:03.955963 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:03.955931    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:04.058180 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:04.058091    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:04.967727 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:04.967680    2576 patch_prober.go:28] interesting pod/image-registry-74dcbdb6fc-6tzkz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 21 20:19:04.968047 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:04.967749    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz" podUID="cfe49a9e-c954-4b0c-b8db-8bc33d8f686d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 20:19:05.143514 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:05.143490    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:05.153724 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:05.151867    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zn7kf"]
Jul 21 20:19:05.155655 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:05.155628    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zn7kf"
Jul 21 20:19:05.158354 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:05.158319    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-nz66j\""
Jul 21 20:19:05.158497 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:05.158453    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 21 20:19:05.163851 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:05.163822    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zn7kf"]
Jul 21 20:19:05.190527 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:05.190495    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/097cf97f-e669-4efd-80be-6962502529fb-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-zn7kf\" (UID: \"097cf97f-e669-4efd-80be-6962502529fb\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zn7kf"
Jul 21 20:19:05.190734 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:05.190599    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgmgj\" (UniqueName: \"kubernetes.io/projected/097cf97f-e669-4efd-80be-6962502529fb-kube-api-access-vgmgj\") pod \"monitoring-plugin-7b7b7bc8bf-zn7kf\" (UID: \"097cf97f-e669-4efd-80be-6962502529fb\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zn7kf"
Jul 21 20:19:05.204279 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:05.204198    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:05.291830 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:05.291793    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/097cf97f-e669-4efd-80be-6962502529fb-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-zn7kf\" (UID: \"097cf97f-e669-4efd-80be-6962502529fb\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zn7kf"
Jul 21 20:19:05.292000 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:05.291891    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgmgj\" (UniqueName: \"kubernetes.io/projected/097cf97f-e669-4efd-80be-6962502529fb-kube-api-access-vgmgj\") pod \"monitoring-plugin-7b7b7bc8bf-zn7kf\" (UID: \"097cf97f-e669-4efd-80be-6962502529fb\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zn7kf"
Jul 21 20:19:05.294326 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:05.294295    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/097cf97f-e669-4efd-80be-6962502529fb-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-zn7kf\" (UID: \"097cf97f-e669-4efd-80be-6962502529fb\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zn7kf"
Jul 21 20:19:05.300531 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:05.300502    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgmgj\" (UniqueName: \"kubernetes.io/projected/097cf97f-e669-4efd-80be-6962502529fb-kube-api-access-vgmgj\") pod \"monitoring-plugin-7b7b7bc8bf-zn7kf\" (UID: \"097cf97f-e669-4efd-80be-6962502529fb\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zn7kf"
Jul 21 20:19:05.356266 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:05.356181    2576 patch_prober.go:28] interesting pod/image-registry-6956754d67-pfgpq container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 21 20:19:05.356266 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:05.356231    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6956754d67-pfgpq" podUID="a084aa9c-59d0-484b-a16d-ee606fb51418" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 20:19:05.466114 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:05.466077    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zn7kf"
Jul 21 20:19:05.576067 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:05.576034    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca368375-4908-4493-9f41-97363f5dc755","Type":"ContainerStarted","Data":"f6f3ab9614ed0bbacf43cf7739188076618a28b94a97473f96c2cbaf912eb8ce"}
Jul 21 20:19:05.576215 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:05.576099    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca368375-4908-4493-9f41-97363f5dc755","Type":"ContainerStarted","Data":"ffcfd25ee3e30038cead3e2c78dfdcb9589e07d1c8323940e3639f6645b79d47"}
Jul 21 20:19:05.576215 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:05.576132    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca368375-4908-4493-9f41-97363f5dc755","Type":"ContainerStarted","Data":"080bff45978103f91527f3e788b8fe193dc73d12892e01d8b5700c143f958b97"}
Jul 21 20:19:05.576215 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:05.576155    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca368375-4908-4493-9f41-97363f5dc755","Type":"ContainerStarted","Data":"a1ba8cd2210d557bc5c577fb4fa4c6b9258e57d7e86a7a3c9097727dc255ef96"}
Jul 21 20:19:05.576215 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:05.576180    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca368375-4908-4493-9f41-97363f5dc755","Type":"ContainerStarted","Data":"0cc6b49e760e7058b03a278de48340a839222d1397846fe3821dd644a5d90862"}
Jul 21 20:19:05.608627 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:05.608514    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zn7kf"]
Jul 21 20:19:05.610684 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:19:05.610660    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod097cf97f_e669_4efd_80be_6962502529fb.slice/crio-2f17c19116930fbecaa75ebe3f8f64068cbe00a54eb5f4583ff4d035f894574b WatchSource:0}: Error finding container 2f17c19116930fbecaa75ebe3f8f64068cbe00a54eb5f4583ff4d035f894574b: Status 404 returned error can't find the container with id 2f17c19116930fbecaa75ebe3f8f64068cbe00a54eb5f4583ff4d035f894574b
Jul 21 20:19:06.581550 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.581510    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zn7kf" event={"ID":"097cf97f-e669-4efd-80be-6962502529fb","Type":"ContainerStarted","Data":"2f17c19116930fbecaa75ebe3f8f64068cbe00a54eb5f4583ff4d035f894574b"}
Jul 21 20:19:06.585322 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.585288    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca368375-4908-4493-9f41-97363f5dc755","Type":"ContainerStarted","Data":"a9a4ae069ce1e83bec37087c56393f05ca9e1e6503dcbff51e575602ddb554d1"}
Jul 21 20:19:06.801525 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.801487    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:06.805412 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.805362    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.101391359 podStartE2EDuration="5.805346058s" totalImagesPullingTime="3.68655715s" totalInitContainerRuntime="17.397549ms" isStatefulPod=false podCreationTimestamp="2026-07-21 20:19:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:19:06.62643783 +0000 UTC m=+297.558835988" watchObservedRunningTime="2026-07-21 20:19:06.805346058 +0000 UTC m=+297.737744214"
Jul 21 20:19:06.806425 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.806402    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 20:19:06.809889 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.809866    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:06.813373 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.813331    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3gc70pcmkcvct\""
Jul 21 20:19:06.813533 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.813442    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 21 20:19:06.813680 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.813659    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 21 20:19:06.813898 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.813807    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kbdjc\""
Jul 21 20:19:06.813898 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.813883    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 21 20:19:06.814061 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.813929    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 21 20:19:06.814443 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.814170    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 21 20:19:06.814443 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.814261    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 21 20:19:06.814443 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.814267    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 21 20:19:06.815884 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.815861    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 21 20:19:06.815973 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.815869    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 21 20:19:06.815973 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.815940    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 21 20:19:06.816091 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.816053    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 21 20:19:06.816149 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.816109    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 21 20:19:06.816199 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.816189    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 21 20:19:06.816249 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.816201    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 21 20:19:06.818974 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.818956    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 21 20:19:06.833913 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.833807    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 20:19:06.908144 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.908107    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b510dd0-e811-4350-8e9c-4560587d0de1-config-out\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:06.908144 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.908149    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:06.908409 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.908173    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-web-config\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:06.908605 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.908526    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:06.908666 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.908649    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:06.908743 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.908716    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-config\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:06.908805 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.908759    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w8pj\" (UniqueName: \"kubernetes.io/projected/2b510dd0-e811-4350-8e9c-4560587d0de1-kube-api-access-5w8pj\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:06.908891 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.908862    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:06.908988 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.908972    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:06.909039 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.909015    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:06.909088 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.909062    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:06.909136 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.909113    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:06.909188 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.909138    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:06.909188 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.909170    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:06.909279 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.909203    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:06.909279 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.909232    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:06.909279 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.909270    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:06.909401 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.909296    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:06.909401 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.909353    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b510dd0-e811-4350-8e9c-4560587d0de1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:06.909495 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:06.909397    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.010331 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.010300    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.010331 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.010333    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.010514 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.010353    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.010514 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.010370    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.010514 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.010395    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.010514 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.010424    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.010514 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.010448    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.010514 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.010490    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b510dd0-e811-4350-8e9c-4560587d0de1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.010868 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.010523    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.010868 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.010554    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b510dd0-e811-4350-8e9c-4560587d0de1-config-out\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.010868 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.010581    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.010868 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.010610    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-web-config\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.010868 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.010636    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.010868 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.010663    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.010868 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.010711    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-config\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.010868 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.010743    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w8pj\" (UniqueName: \"kubernetes.io/projected/2b510dd0-e811-4350-8e9c-4560587d0de1-kube-api-access-5w8pj\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.010868 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.010778    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.011313 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.011100    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.011378 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.011343    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.011435 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.011372    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.011435 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.011422    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.011960 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.011762    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.011960 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.011812    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.011960 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.011857    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.011960 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.011863    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.012239 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.012144    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.012559 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.012529    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.014511 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.014486    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.015082 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.015056    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.015180 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.015135    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.015435 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.015411    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b510dd0-e811-4350-8e9c-4560587d0de1-config-out\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.015613 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.015517    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b510dd0-e811-4350-8e9c-4560587d0de1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.015613 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.015536    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-web-config\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.015781 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.015681    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.016438 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.016417    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.017137 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.017111    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.017222 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.017138    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.017518 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.017502    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.017601 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.017581    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-config\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.020672 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.020647    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w8pj\" (UniqueName: \"kubernetes.io/projected/2b510dd0-e811-4350-8e9c-4560587d0de1-kube-api-access-5w8pj\") pod \"prometheus-k8s-0\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.121853 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.121757    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:07.263816 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.263785    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 20:19:07.266130 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:19:07.266102    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b510dd0_e811_4350_8e9c_4560587d0de1.slice/crio-1e4fdbfd7fdca09997577714a2052baa6d3a8fbaf0cb0ff61102b372d2db46f6 WatchSource:0}: Error finding container 1e4fdbfd7fdca09997577714a2052baa6d3a8fbaf0cb0ff61102b372d2db46f6: Status 404 returned error can't find the container with id 1e4fdbfd7fdca09997577714a2052baa6d3a8fbaf0cb0ff61102b372d2db46f6
Jul 21 20:19:07.500672 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.500641    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6956754d67-pfgpq"
Jul 21 20:19:07.539365 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.539334    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-666gc"
Jul 21 20:19:07.591087 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.591055    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zn7kf" event={"ID":"097cf97f-e669-4efd-80be-6962502529fb","Type":"ContainerStarted","Data":"b4d3d464eac3ba27d9c112c93861bc9ebcfdd2815f6c0484ddee84db7233af02"}
Jul 21 20:19:07.591556 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.591244    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zn7kf"
Jul 21 20:19:07.592916 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.592887    2576 generic.go:356] "Generic (PLEG): container finished" podID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerID="45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded" exitCode=0
Jul 21 20:19:07.593045 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.592983    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b510dd0-e811-4350-8e9c-4560587d0de1","Type":"ContainerDied","Data":"45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded"}
Jul 21 20:19:07.593105 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.593057    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b510dd0-e811-4350-8e9c-4560587d0de1","Type":"ContainerStarted","Data":"1e4fdbfd7fdca09997577714a2052baa6d3a8fbaf0cb0ff61102b372d2db46f6"}
Jul 21 20:19:07.596259 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.596240    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zn7kf"
Jul 21 20:19:07.611892 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.611840    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-zn7kf" podStartSLOduration=1.25568641 podStartE2EDuration="2.611822708s" totalImagesPullingTime="1.356136298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:19:07.611299033 +0000 UTC m=+298.543697187" watchObservedRunningTime="2026-07-21 20:19:07.611822708 +0000 UTC m=+298.544220864"
Jul 21 20:19:07.641486 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.641415    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:07.742944 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.742913    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:07.842972 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.842941    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:07.903718 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:07.903620    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:09.280041 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:09.279999    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:09.347961 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:09.347915    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:09.457755 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:09.457723    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w885b_62db291a-14b7-4e35-9550-9fb810f82b8d/console-operator/1.log"
Jul 21 20:19:09.459341 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:09.459307    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w885b_62db291a-14b7-4e35-9550-9fb810f82b8d/console-operator/1.log"
Jul 21 20:19:09.469667 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:09.469638    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-54f9x_55f51c26-71cd-4e1b-84f2-32f2de4138d5/ovn-acl-logging/0.log"
Jul 21 20:19:09.472807 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:09.472781    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-54f9x_55f51c26-71cd-4e1b-84f2-32f2de4138d5/ovn-acl-logging/0.log"
Jul 21 20:19:09.478423 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:09.478402    2576 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 20:19:09.989962 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:09.989898    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz" podUID="cfe49a9e-c954-4b0c-b8db-8bc33d8f686d" containerName="registry" containerID="cri-o://223016f2ca0b179b5e9362ea6a30d21e96bf80eef10966cd6413f7396952f7ec" gracePeriod=30
Jul 21 20:19:10.789037 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:10.789007    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:19:10.848867 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:10.848780    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-trusted-ca\") pod \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") "
Jul 21 20:19:10.848867 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:10.848823    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-registry-tls\") pod \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") "
Jul 21 20:19:10.848867 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:10.848847    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-registry-certificates\") pod \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") "
Jul 21 20:19:10.849162 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:10.848910    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-ca-trust-extracted\") pod \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") "
Jul 21 20:19:10.849162 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:10.849014    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-image-registry-private-configuration\") pod \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") "
Jul 21 20:19:10.849162 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:10.849038    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-installation-pull-secrets\") pod \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") "
Jul 21 20:19:10.849162 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:10.849069    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9f6p\" (UniqueName: \"kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-kube-api-access-t9f6p\") pod \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") "
Jul 21 20:19:10.849162 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:10.849095    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-bound-sa-token\") pod \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\" (UID: \"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d\") "
Jul 21 20:19:10.849414 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:10.849235    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "cfe49a9e-c954-4b0c-b8db-8bc33d8f686d" (UID: "cfe49a9e-c954-4b0c-b8db-8bc33d8f686d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:19:10.849414 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:10.849380    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-trusted-ca\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:19:10.849948 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:10.849912    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "cfe49a9e-c954-4b0c-b8db-8bc33d8f686d" (UID: "cfe49a9e-c954-4b0c-b8db-8bc33d8f686d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:19:10.851922 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:10.851885    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "cfe49a9e-c954-4b0c-b8db-8bc33d8f686d" (UID: "cfe49a9e-c954-4b0c-b8db-8bc33d8f686d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:19:10.852053 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:10.852020    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-kube-api-access-t9f6p" (OuterVolumeSpecName: "kube-api-access-t9f6p") pod "cfe49a9e-c954-4b0c-b8db-8bc33d8f686d" (UID: "cfe49a9e-c954-4b0c-b8db-8bc33d8f686d"). InnerVolumeSpecName "kube-api-access-t9f6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:19:10.852164 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:10.852136    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "cfe49a9e-c954-4b0c-b8db-8bc33d8f686d" (UID: "cfe49a9e-c954-4b0c-b8db-8bc33d8f686d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:19:10.852467 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:10.852444    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cfe49a9e-c954-4b0c-b8db-8bc33d8f686d" (UID: "cfe49a9e-c954-4b0c-b8db-8bc33d8f686d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:19:10.852847 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:10.852827    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "cfe49a9e-c954-4b0c-b8db-8bc33d8f686d" (UID: "cfe49a9e-c954-4b0c-b8db-8bc33d8f686d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:19:10.861553 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:10.861519    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "cfe49a9e-c954-4b0c-b8db-8bc33d8f686d" (UID: "cfe49a9e-c954-4b0c-b8db-8bc33d8f686d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:19:10.950631 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:10.950523    2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-image-registry-private-configuration\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:19:10.950631 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:10.950568    2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-installation-pull-secrets\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:19:10.950631 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:10.950584    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9f6p\" (UniqueName: \"kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-kube-api-access-t9f6p\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:19:10.950631 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:10.950598    2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-bound-sa-token\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:19:10.950631 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:10.950612    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-registry-tls\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:19:10.950631 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:10.950624    2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-registry-certificates\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:19:10.950631 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:10.950637    2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d-ca-trust-extracted\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:19:11.611241 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:11.611201    2576 generic.go:356] "Generic (PLEG): container finished" podID="cfe49a9e-c954-4b0c-b8db-8bc33d8f686d" containerID="223016f2ca0b179b5e9362ea6a30d21e96bf80eef10966cd6413f7396952f7ec" exitCode=0
Jul 21 20:19:11.611453 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:11.611256    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"
Jul 21 20:19:11.611453 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:11.611294    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz" event={"ID":"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d","Type":"ContainerDied","Data":"223016f2ca0b179b5e9362ea6a30d21e96bf80eef10966cd6413f7396952f7ec"}
Jul 21 20:19:11.611453 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:11.611403    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74dcbdb6fc-6tzkz" event={"ID":"cfe49a9e-c954-4b0c-b8db-8bc33d8f686d","Type":"ContainerDied","Data":"f8706b58e112f5d4297ac5590cff57cddf4f48ff2b3629a1d6dd21dee7301093"}
Jul 21 20:19:11.611453 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:11.611434    2576 scope.go:117] "RemoveContainer" containerID="223016f2ca0b179b5e9362ea6a30d21e96bf80eef10966cd6413f7396952f7ec"
Jul 21 20:19:11.614137 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:11.614110    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b510dd0-e811-4350-8e9c-4560587d0de1","Type":"ContainerStarted","Data":"f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202"}
Jul 21 20:19:11.614282 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:11.614174    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b510dd0-e811-4350-8e9c-4560587d0de1","Type":"ContainerStarted","Data":"47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d"}
Jul 21 20:19:11.622032 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:11.621756    2576 scope.go:117] "RemoveContainer" containerID="223016f2ca0b179b5e9362ea6a30d21e96bf80eef10966cd6413f7396952f7ec"
Jul 21 20:19:11.622319 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:19:11.622216    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"223016f2ca0b179b5e9362ea6a30d21e96bf80eef10966cd6413f7396952f7ec\": container with ID starting with 223016f2ca0b179b5e9362ea6a30d21e96bf80eef10966cd6413f7396952f7ec not found: ID does not exist" containerID="223016f2ca0b179b5e9362ea6a30d21e96bf80eef10966cd6413f7396952f7ec"
Jul 21 20:19:11.622319 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:11.622272    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"223016f2ca0b179b5e9362ea6a30d21e96bf80eef10966cd6413f7396952f7ec"} err="failed to get container status \"223016f2ca0b179b5e9362ea6a30d21e96bf80eef10966cd6413f7396952f7ec\": rpc error: code = NotFound desc = could not find container \"223016f2ca0b179b5e9362ea6a30d21e96bf80eef10966cd6413f7396952f7ec\": container with ID starting with 223016f2ca0b179b5e9362ea6a30d21e96bf80eef10966cd6413f7396952f7ec not found: ID does not exist"
Jul 21 20:19:11.639139 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:11.639085    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"]
Jul 21 20:19:11.652563 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:11.652509    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-74dcbdb6fc-6tzkz"]
Jul 21 20:19:12.827847 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:12.827814    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:12.925442 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:12.925417    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:13.626436 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:13.626401    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b510dd0-e811-4350-8e9c-4560587d0de1","Type":"ContainerStarted","Data":"589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729"}
Jul 21 20:19:13.626594 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:13.626467    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b510dd0-e811-4350-8e9c-4560587d0de1","Type":"ContainerStarted","Data":"c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7"}
Jul 21 20:19:13.626594 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:13.626491    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b510dd0-e811-4350-8e9c-4560587d0de1","Type":"ContainerStarted","Data":"1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a"}
Jul 21 20:19:13.626594 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:13.626520    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b510dd0-e811-4350-8e9c-4560587d0de1","Type":"ContainerStarted","Data":"97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c"}
Jul 21 20:19:13.653784 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:13.653747    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfe49a9e-c954-4b0c-b8db-8bc33d8f686d" path="/var/lib/kubelet/pods/cfe49a9e-c954-4b0c-b8db-8bc33d8f686d/volumes"
Jul 21 20:19:13.661309 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:13.661227    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.632383829 podStartE2EDuration="7.661203361s" totalImagesPullingTime="5.00760957s" totalInitContainerRuntime="21.209962ms" isStatefulPod=false podCreationTimestamp="2026-07-21 20:19:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:19:13.660344738 +0000 UTC m=+304.592742907" watchObservedRunningTime="2026-07-21 20:19:13.661203361 +0000 UTC m=+304.593601520"
Jul 21 20:19:14.895107 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:14.895069    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:14.995801 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:14.995770    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:16.661823 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:16.661787    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:16.746127 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:16.746092    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:17.122143 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:17.122096    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:19:17.645296 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:17.645259    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:19:17.962481 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:17.962391    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:18.018542 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:18.018505    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:21.384797 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:21.384758    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:21.485544 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:21.485512    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:21.873831 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:21.873797    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:21.971633 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:21.971595    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:22.431978 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:22.431950    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:22.527817 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:22.527770    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:23.021737 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:23.021708    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:23.123320 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:23.123291    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:23.223975 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:23.223938    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:25.769419 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:25.769383    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:25.830485 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:25.830445    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:30.848603 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:30.848572    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:30.907846 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:30.907815    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:36.391414 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:36.391382    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:36.496599 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:36.496569    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:51.388069 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:51.388040    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:19:51.485893 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:19:51.485860    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:20:07.122574 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:07.122467    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:07.139198 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:07.139160    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:07.847160 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:07.847133    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:16.716435 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:16.716398    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:20:16.778546 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:16.778507    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:20:21.102723 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:21.102674    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 20:20:21.103129 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:21.102963    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca368375-4908-4493-9f41-97363f5dc755" containerName="alertmanager" containerID="cri-o://0cc6b49e760e7058b03a278de48340a839222d1397846fe3821dd644a5d90862" gracePeriod=120
Jul 21 20:20:21.103129 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:21.103042    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca368375-4908-4493-9f41-97363f5dc755" containerName="kube-rbac-proxy-metric" containerID="cri-o://f6f3ab9614ed0bbacf43cf7739188076618a28b94a97473f96c2cbaf912eb8ce" gracePeriod=120
Jul 21 20:20:21.103129 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:21.103082    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca368375-4908-4493-9f41-97363f5dc755" containerName="prom-label-proxy" containerID="cri-o://a9a4ae069ce1e83bec37087c56393f05ca9e1e6503dcbff51e575602ddb554d1" gracePeriod=120
Jul 21 20:20:21.103129 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:21.103098    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca368375-4908-4493-9f41-97363f5dc755" containerName="config-reloader" containerID="cri-o://a1ba8cd2210d557bc5c577fb4fa4c6b9258e57d7e86a7a3c9097727dc255ef96" gracePeriod=120
Jul 21 20:20:21.103388 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:21.103125    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca368375-4908-4493-9f41-97363f5dc755" containerName="kube-rbac-proxy" containerID="cri-o://ffcfd25ee3e30038cead3e2c78dfdcb9589e07d1c8323940e3639f6645b79d47" gracePeriod=120
Jul 21 20:20:21.103388 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:21.103037    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ca368375-4908-4493-9f41-97363f5dc755" containerName="kube-rbac-proxy-web" containerID="cri-o://080bff45978103f91527f3e788b8fe193dc73d12892e01d8b5700c143f958b97" gracePeriod=120
Jul 21 20:20:21.288867 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:21.288833    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:20:21.353070 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:21.352987    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:20:21.889482 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:21.889443    2576 generic.go:356] "Generic (PLEG): container finished" podID="ca368375-4908-4493-9f41-97363f5dc755" containerID="a9a4ae069ce1e83bec37087c56393f05ca9e1e6503dcbff51e575602ddb554d1" exitCode=0
Jul 21 20:20:21.889482 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:21.889470    2576 generic.go:356] "Generic (PLEG): container finished" podID="ca368375-4908-4493-9f41-97363f5dc755" containerID="f6f3ab9614ed0bbacf43cf7739188076618a28b94a97473f96c2cbaf912eb8ce" exitCode=0
Jul 21 20:20:21.889482 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:21.889477    2576 generic.go:356] "Generic (PLEG): container finished" podID="ca368375-4908-4493-9f41-97363f5dc755" containerID="ffcfd25ee3e30038cead3e2c78dfdcb9589e07d1c8323940e3639f6645b79d47" exitCode=0
Jul 21 20:20:21.889482 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:21.889484    2576 generic.go:356] "Generic (PLEG): container finished" podID="ca368375-4908-4493-9f41-97363f5dc755" containerID="a1ba8cd2210d557bc5c577fb4fa4c6b9258e57d7e86a7a3c9097727dc255ef96" exitCode=0
Jul 21 20:20:21.889792 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:21.889494    2576 generic.go:356] "Generic (PLEG): container finished" podID="ca368375-4908-4493-9f41-97363f5dc755" containerID="0cc6b49e760e7058b03a278de48340a839222d1397846fe3821dd644a5d90862" exitCode=0
Jul 21 20:20:21.889792 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:21.889518    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca368375-4908-4493-9f41-97363f5dc755","Type":"ContainerDied","Data":"a9a4ae069ce1e83bec37087c56393f05ca9e1e6503dcbff51e575602ddb554d1"}
Jul 21 20:20:21.889792 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:21.889607    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca368375-4908-4493-9f41-97363f5dc755","Type":"ContainerDied","Data":"f6f3ab9614ed0bbacf43cf7739188076618a28b94a97473f96c2cbaf912eb8ce"}
Jul 21 20:20:21.889792 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:21.889632    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca368375-4908-4493-9f41-97363f5dc755","Type":"ContainerDied","Data":"ffcfd25ee3e30038cead3e2c78dfdcb9589e07d1c8323940e3639f6645b79d47"}
Jul 21 20:20:21.889792 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:21.889656    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca368375-4908-4493-9f41-97363f5dc755","Type":"ContainerDied","Data":"a1ba8cd2210d557bc5c577fb4fa4c6b9258e57d7e86a7a3c9097727dc255ef96"}
Jul 21 20:20:21.889792 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:21.889679    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca368375-4908-4493-9f41-97363f5dc755","Type":"ContainerDied","Data":"0cc6b49e760e7058b03a278de48340a839222d1397846fe3821dd644a5d90862"}
Jul 21 20:20:22.351235 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.351199    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:22.377304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.377269    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-config-volume\") pod \"ca368375-4908-4493-9f41-97363f5dc755\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") "
Jul 21 20:20:22.377304 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.377309    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ca368375-4908-4493-9f41-97363f5dc755\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") "
Jul 21 20:20:22.377509 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.377329    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-secret-alertmanager-kube-rbac-proxy\") pod \"ca368375-4908-4493-9f41-97363f5dc755\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") "
Jul 21 20:20:22.377509 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.377358    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbmpz\" (UniqueName: \"kubernetes.io/projected/ca368375-4908-4493-9f41-97363f5dc755-kube-api-access-gbmpz\") pod \"ca368375-4908-4493-9f41-97363f5dc755\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") "
Jul 21 20:20:22.377509 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.377494    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-secret-alertmanager-kube-rbac-proxy-web\") pod \"ca368375-4908-4493-9f41-97363f5dc755\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") "
Jul 21 20:20:22.377660 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.377549    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca368375-4908-4493-9f41-97363f5dc755-tls-assets\") pod \"ca368375-4908-4493-9f41-97363f5dc755\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") "
Jul 21 20:20:22.377660 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.377615    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca368375-4908-4493-9f41-97363f5dc755-config-out\") pod \"ca368375-4908-4493-9f41-97363f5dc755\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") "
Jul 21 20:20:22.377660 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.377653    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca368375-4908-4493-9f41-97363f5dc755-alertmanager-trusted-ca-bundle\") pod \"ca368375-4908-4493-9f41-97363f5dc755\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") "
Jul 21 20:20:22.377843 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.377725    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-web-config\") pod \"ca368375-4908-4493-9f41-97363f5dc755\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") "
Jul 21 20:20:22.377843 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.377775    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-secret-alertmanager-main-tls\") pod \"ca368375-4908-4493-9f41-97363f5dc755\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") "
Jul 21 20:20:22.377843 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.377808    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-cluster-tls-config\") pod \"ca368375-4908-4493-9f41-97363f5dc755\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") "
Jul 21 20:20:22.377843 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.377839    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca368375-4908-4493-9f41-97363f5dc755-metrics-client-ca\") pod \"ca368375-4908-4493-9f41-97363f5dc755\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") "
Jul 21 20:20:22.378164 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.377864    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca368375-4908-4493-9f41-97363f5dc755-alertmanager-main-db\") pod \"ca368375-4908-4493-9f41-97363f5dc755\" (UID: \"ca368375-4908-4493-9f41-97363f5dc755\") "
Jul 21 20:20:22.378164 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.378020    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs\") pod \"network-metrics-daemon-q9fp4\" (UID: \"3712cffa-e355-4c1e-9d88-b133a9eec5b4\") " pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:20:22.378967 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.378934    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca368375-4908-4493-9f41-97363f5dc755-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ca368375-4908-4493-9f41-97363f5dc755" (UID: "ca368375-4908-4493-9f41-97363f5dc755"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:20:22.379264 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.379214    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca368375-4908-4493-9f41-97363f5dc755-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ca368375-4908-4493-9f41-97363f5dc755" (UID: "ca368375-4908-4493-9f41-97363f5dc755"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:20:22.379618 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.379041    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca368375-4908-4493-9f41-97363f5dc755-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ca368375-4908-4493-9f41-97363f5dc755" (UID: "ca368375-4908-4493-9f41-97363f5dc755"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:20:22.383702 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.382082    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3712cffa-e355-4c1e-9d88-b133a9eec5b4-metrics-certs\") pod \"network-metrics-daemon-q9fp4\" (UID: \"3712cffa-e355-4c1e-9d88-b133a9eec5b4\") " pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:20:22.383702 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.382082    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-config-volume" (OuterVolumeSpecName: "config-volume") pod "ca368375-4908-4493-9f41-97363f5dc755" (UID: "ca368375-4908-4493-9f41-97363f5dc755"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:20:22.383702 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.382158    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ca368375-4908-4493-9f41-97363f5dc755" (UID: "ca368375-4908-4493-9f41-97363f5dc755"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:20:22.383702 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.382216    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca368375-4908-4493-9f41-97363f5dc755-kube-api-access-gbmpz" (OuterVolumeSpecName: "kube-api-access-gbmpz") pod "ca368375-4908-4493-9f41-97363f5dc755" (UID: "ca368375-4908-4493-9f41-97363f5dc755"). InnerVolumeSpecName "kube-api-access-gbmpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:20:22.383702 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.382259    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ca368375-4908-4493-9f41-97363f5dc755" (UID: "ca368375-4908-4493-9f41-97363f5dc755"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:20:22.383702 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.383309    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca368375-4908-4493-9f41-97363f5dc755-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ca368375-4908-4493-9f41-97363f5dc755" (UID: "ca368375-4908-4493-9f41-97363f5dc755"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:20:22.383702 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.383332    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ca368375-4908-4493-9f41-97363f5dc755" (UID: "ca368375-4908-4493-9f41-97363f5dc755"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:20:22.384143 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.383744    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca368375-4908-4493-9f41-97363f5dc755-config-out" (OuterVolumeSpecName: "config-out") pod "ca368375-4908-4493-9f41-97363f5dc755" (UID: "ca368375-4908-4493-9f41-97363f5dc755"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:20:22.384314 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.384275    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ca368375-4908-4493-9f41-97363f5dc755" (UID: "ca368375-4908-4493-9f41-97363f5dc755"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:20:22.388223 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.388182    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ca368375-4908-4493-9f41-97363f5dc755" (UID: "ca368375-4908-4493-9f41-97363f5dc755"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:20:22.396733 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.396544    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-web-config" (OuterVolumeSpecName: "web-config") pod "ca368375-4908-4493-9f41-97363f5dc755" (UID: "ca368375-4908-4493-9f41-97363f5dc755"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:20:22.448870 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.448786    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bxdt9\""
Jul 21 20:20:22.457219 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.457191    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9fp4"
Jul 21 20:20:22.478676 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.478645    2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-cluster-tls-config\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:22.478676 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.478673    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca368375-4908-4493-9f41-97363f5dc755-metrics-client-ca\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:22.478870 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.478682    2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca368375-4908-4493-9f41-97363f5dc755-alertmanager-main-db\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:22.478870 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.478719    2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-config-volume\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:22.478870 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.478730    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:22.478870 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.478740    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:22.478870 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.478748    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbmpz\" (UniqueName: \"kubernetes.io/projected/ca368375-4908-4493-9f41-97363f5dc755-kube-api-access-gbmpz\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:22.478870 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.478756    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:22.478870 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.478765    2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca368375-4908-4493-9f41-97363f5dc755-tls-assets\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:22.478870 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.478772    2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca368375-4908-4493-9f41-97363f5dc755-config-out\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:22.478870 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.478779    2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca368375-4908-4493-9f41-97363f5dc755-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:22.478870 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.478787    2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-web-config\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:22.478870 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.478797    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca368375-4908-4493-9f41-97363f5dc755-secret-alertmanager-main-tls\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:22.587127 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.587093    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q9fp4"]
Jul 21 20:20:22.590634 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:20:22.590609    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3712cffa_e355_4c1e_9d88_b133a9eec5b4.slice/crio-3c195afb89eb1760e187dff09f4652f6d9d608bd8eccc74a55fcf359e448f9a9 WatchSource:0}: Error finding container 3c195afb89eb1760e187dff09f4652f6d9d608bd8eccc74a55fcf359e448f9a9: Status 404 returned error can't find the container with id 3c195afb89eb1760e187dff09f4652f6d9d608bd8eccc74a55fcf359e448f9a9
Jul 21 20:20:22.592525 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.592511    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 20:20:22.896201 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.896170    2576 generic.go:356] "Generic (PLEG): container finished" podID="ca368375-4908-4493-9f41-97363f5dc755" containerID="080bff45978103f91527f3e788b8fe193dc73d12892e01d8b5700c143f958b97" exitCode=0
Jul 21 20:20:22.896389 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.896247    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca368375-4908-4493-9f41-97363f5dc755","Type":"ContainerDied","Data":"080bff45978103f91527f3e788b8fe193dc73d12892e01d8b5700c143f958b97"}
Jul 21 20:20:22.896389 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.896322    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca368375-4908-4493-9f41-97363f5dc755","Type":"ContainerDied","Data":"2b3452210e18e6d579877c9ca22d87dde9b275e13b677ac9dd0b7304858cf9e0"}
Jul 21 20:20:22.896389 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.896259    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:22.896389 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.896370    2576 scope.go:117] "RemoveContainer" containerID="a9a4ae069ce1e83bec37087c56393f05ca9e1e6503dcbff51e575602ddb554d1"
Jul 21 20:20:22.897675 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.897648    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q9fp4" event={"ID":"3712cffa-e355-4c1e-9d88-b133a9eec5b4","Type":"ContainerStarted","Data":"3c195afb89eb1760e187dff09f4652f6d9d608bd8eccc74a55fcf359e448f9a9"}
Jul 21 20:20:22.906685 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.906616    2576 scope.go:117] "RemoveContainer" containerID="f6f3ab9614ed0bbacf43cf7739188076618a28b94a97473f96c2cbaf912eb8ce"
Jul 21 20:20:22.914427 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.914406    2576 scope.go:117] "RemoveContainer" containerID="ffcfd25ee3e30038cead3e2c78dfdcb9589e07d1c8323940e3639f6645b79d47"
Jul 21 20:20:22.922094 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.922071    2576 scope.go:117] "RemoveContainer" containerID="080bff45978103f91527f3e788b8fe193dc73d12892e01d8b5700c143f958b97"
Jul 21 20:20:22.924217 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.924192    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 20:20:22.928635 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.928611    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 20:20:22.930114 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.930098    2576 scope.go:117] "RemoveContainer" containerID="a1ba8cd2210d557bc5c577fb4fa4c6b9258e57d7e86a7a3c9097727dc255ef96"
Jul 21 20:20:22.937413 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.937391    2576 scope.go:117] "RemoveContainer" containerID="0cc6b49e760e7058b03a278de48340a839222d1397846fe3821dd644a5d90862"
Jul 21 20:20:22.944895 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.944872    2576 scope.go:117] "RemoveContainer" containerID="4a531c2519a6960056c7d0927d02fae631f96fd8fd8c230f4e523ad8cca3ac74"
Jul 21 20:20:22.952563 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.952540    2576 scope.go:117] "RemoveContainer" containerID="a9a4ae069ce1e83bec37087c56393f05ca9e1e6503dcbff51e575602ddb554d1"
Jul 21 20:20:22.952884 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:20:22.952864    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9a4ae069ce1e83bec37087c56393f05ca9e1e6503dcbff51e575602ddb554d1\": container with ID starting with a9a4ae069ce1e83bec37087c56393f05ca9e1e6503dcbff51e575602ddb554d1 not found: ID does not exist" containerID="a9a4ae069ce1e83bec37087c56393f05ca9e1e6503dcbff51e575602ddb554d1"
Jul 21 20:20:22.952937 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.952895    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9a4ae069ce1e83bec37087c56393f05ca9e1e6503dcbff51e575602ddb554d1"} err="failed to get container status \"a9a4ae069ce1e83bec37087c56393f05ca9e1e6503dcbff51e575602ddb554d1\": rpc error: code = NotFound desc = could not find container \"a9a4ae069ce1e83bec37087c56393f05ca9e1e6503dcbff51e575602ddb554d1\": container with ID starting with a9a4ae069ce1e83bec37087c56393f05ca9e1e6503dcbff51e575602ddb554d1 not found: ID does not exist"
Jul 21 20:20:22.952937 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.952922    2576 scope.go:117] "RemoveContainer" containerID="f6f3ab9614ed0bbacf43cf7739188076618a28b94a97473f96c2cbaf912eb8ce"
Jul 21 20:20:22.953143 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:20:22.953126    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6f3ab9614ed0bbacf43cf7739188076618a28b94a97473f96c2cbaf912eb8ce\": container with ID starting with f6f3ab9614ed0bbacf43cf7739188076618a28b94a97473f96c2cbaf912eb8ce not found: ID does not exist" containerID="f6f3ab9614ed0bbacf43cf7739188076618a28b94a97473f96c2cbaf912eb8ce"
Jul 21 20:20:22.953183 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.953148    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6f3ab9614ed0bbacf43cf7739188076618a28b94a97473f96c2cbaf912eb8ce"} err="failed to get container status \"f6f3ab9614ed0bbacf43cf7739188076618a28b94a97473f96c2cbaf912eb8ce\": rpc error: code = NotFound desc = could not find container \"f6f3ab9614ed0bbacf43cf7739188076618a28b94a97473f96c2cbaf912eb8ce\": container with ID starting with f6f3ab9614ed0bbacf43cf7739188076618a28b94a97473f96c2cbaf912eb8ce not found: ID does not exist"
Jul 21 20:20:22.953183 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.953164    2576 scope.go:117] "RemoveContainer" containerID="ffcfd25ee3e30038cead3e2c78dfdcb9589e07d1c8323940e3639f6645b79d47"
Jul 21 20:20:22.953417 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:20:22.953396    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffcfd25ee3e30038cead3e2c78dfdcb9589e07d1c8323940e3639f6645b79d47\": container with ID starting with ffcfd25ee3e30038cead3e2c78dfdcb9589e07d1c8323940e3639f6645b79d47 not found: ID does not exist" containerID="ffcfd25ee3e30038cead3e2c78dfdcb9589e07d1c8323940e3639f6645b79d47"
Jul 21 20:20:22.953476 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.953427    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffcfd25ee3e30038cead3e2c78dfdcb9589e07d1c8323940e3639f6645b79d47"} err="failed to get container status \"ffcfd25ee3e30038cead3e2c78dfdcb9589e07d1c8323940e3639f6645b79d47\": rpc error: code = NotFound desc = could not find container \"ffcfd25ee3e30038cead3e2c78dfdcb9589e07d1c8323940e3639f6645b79d47\": container with ID starting with ffcfd25ee3e30038cead3e2c78dfdcb9589e07d1c8323940e3639f6645b79d47 not found: ID does not exist"
Jul 21 20:20:22.953476 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.953450    2576 scope.go:117] "RemoveContainer" containerID="080bff45978103f91527f3e788b8fe193dc73d12892e01d8b5700c143f958b97"
Jul 21 20:20:22.953682 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:20:22.953666    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"080bff45978103f91527f3e788b8fe193dc73d12892e01d8b5700c143f958b97\": container with ID starting with 080bff45978103f91527f3e788b8fe193dc73d12892e01d8b5700c143f958b97 not found: ID does not exist" containerID="080bff45978103f91527f3e788b8fe193dc73d12892e01d8b5700c143f958b97"
Jul 21 20:20:22.953767 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.953698    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"080bff45978103f91527f3e788b8fe193dc73d12892e01d8b5700c143f958b97"} err="failed to get container status \"080bff45978103f91527f3e788b8fe193dc73d12892e01d8b5700c143f958b97\": rpc error: code = NotFound desc = could not find container \"080bff45978103f91527f3e788b8fe193dc73d12892e01d8b5700c143f958b97\": container with ID starting with 080bff45978103f91527f3e788b8fe193dc73d12892e01d8b5700c143f958b97 not found: ID does not exist"
Jul 21 20:20:22.953767 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.953719    2576 scope.go:117] "RemoveContainer" containerID="a1ba8cd2210d557bc5c577fb4fa4c6b9258e57d7e86a7a3c9097727dc255ef96"
Jul 21 20:20:22.953987 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:20:22.953967    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1ba8cd2210d557bc5c577fb4fa4c6b9258e57d7e86a7a3c9097727dc255ef96\": container with ID starting with a1ba8cd2210d557bc5c577fb4fa4c6b9258e57d7e86a7a3c9097727dc255ef96 not found: ID does not exist" containerID="a1ba8cd2210d557bc5c577fb4fa4c6b9258e57d7e86a7a3c9097727dc255ef96"
Jul 21 20:20:22.954035 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.953992    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1ba8cd2210d557bc5c577fb4fa4c6b9258e57d7e86a7a3c9097727dc255ef96"} err="failed to get container status \"a1ba8cd2210d557bc5c577fb4fa4c6b9258e57d7e86a7a3c9097727dc255ef96\": rpc error: code = NotFound desc = could not find container \"a1ba8cd2210d557bc5c577fb4fa4c6b9258e57d7e86a7a3c9097727dc255ef96\": container with ID starting with a1ba8cd2210d557bc5c577fb4fa4c6b9258e57d7e86a7a3c9097727dc255ef96 not found: ID does not exist"
Jul 21 20:20:22.954035 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.954013    2576 scope.go:117] "RemoveContainer" containerID="0cc6b49e760e7058b03a278de48340a839222d1397846fe3821dd644a5d90862"
Jul 21 20:20:22.954327 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:20:22.954298    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cc6b49e760e7058b03a278de48340a839222d1397846fe3821dd644a5d90862\": container with ID starting with 0cc6b49e760e7058b03a278de48340a839222d1397846fe3821dd644a5d90862 not found: ID does not exist" containerID="0cc6b49e760e7058b03a278de48340a839222d1397846fe3821dd644a5d90862"
Jul 21 20:20:22.954413 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.954335    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cc6b49e760e7058b03a278de48340a839222d1397846fe3821dd644a5d90862"} err="failed to get container status \"0cc6b49e760e7058b03a278de48340a839222d1397846fe3821dd644a5d90862\": rpc error: code = NotFound desc = could not find container \"0cc6b49e760e7058b03a278de48340a839222d1397846fe3821dd644a5d90862\": container with ID starting with 0cc6b49e760e7058b03a278de48340a839222d1397846fe3821dd644a5d90862 not found: ID does not exist"
Jul 21 20:20:22.954413 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.954351    2576 scope.go:117] "RemoveContainer" containerID="4a531c2519a6960056c7d0927d02fae631f96fd8fd8c230f4e523ad8cca3ac74"
Jul 21 20:20:22.954855 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:20:22.954637    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a531c2519a6960056c7d0927d02fae631f96fd8fd8c230f4e523ad8cca3ac74\": container with ID starting with 4a531c2519a6960056c7d0927d02fae631f96fd8fd8c230f4e523ad8cca3ac74 not found: ID does not exist" containerID="4a531c2519a6960056c7d0927d02fae631f96fd8fd8c230f4e523ad8cca3ac74"
Jul 21 20:20:22.954855 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.954670    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a531c2519a6960056c7d0927d02fae631f96fd8fd8c230f4e523ad8cca3ac74"} err="failed to get container status \"4a531c2519a6960056c7d0927d02fae631f96fd8fd8c230f4e523ad8cca3ac74\": rpc error: code = NotFound desc = could not find container \"4a531c2519a6960056c7d0927d02fae631f96fd8fd8c230f4e523ad8cca3ac74\": container with ID starting with 4a531c2519a6960056c7d0927d02fae631f96fd8fd8c230f4e523ad8cca3ac74 not found: ID does not exist"
Jul 21 20:20:22.956309 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.956288    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 20:20:22.956570 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.956558    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfe49a9e-c954-4b0c-b8db-8bc33d8f686d" containerName="registry"
Jul 21 20:20:22.956605 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.956572    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfe49a9e-c954-4b0c-b8db-8bc33d8f686d" containerName="registry"
Jul 21 20:20:22.956605 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.956582    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca368375-4908-4493-9f41-97363f5dc755" containerName="kube-rbac-proxy-metric"
Jul 21 20:20:22.956605 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.956587    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca368375-4908-4493-9f41-97363f5dc755" containerName="kube-rbac-proxy-metric"
Jul 21 20:20:22.956605 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.956594    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca368375-4908-4493-9f41-97363f5dc755" containerName="alertmanager"
Jul 21 20:20:22.956605 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.956600    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca368375-4908-4493-9f41-97363f5dc755" containerName="alertmanager"
Jul 21 20:20:22.956605 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.956605    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca368375-4908-4493-9f41-97363f5dc755" containerName="kube-rbac-proxy-web"
Jul 21 20:20:22.956800 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.956611    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca368375-4908-4493-9f41-97363f5dc755" containerName="kube-rbac-proxy-web"
Jul 21 20:20:22.956800 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.956626    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca368375-4908-4493-9f41-97363f5dc755" containerName="kube-rbac-proxy"
Jul 21 20:20:22.956800 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.956632    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca368375-4908-4493-9f41-97363f5dc755" containerName="kube-rbac-proxy"
Jul 21 20:20:22.956800 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.956644    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca368375-4908-4493-9f41-97363f5dc755" containerName="init-config-reloader"
Jul 21 20:20:22.956800 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.956649    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca368375-4908-4493-9f41-97363f5dc755" containerName="init-config-reloader"
Jul 21 20:20:22.956800 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.956655    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca368375-4908-4493-9f41-97363f5dc755" containerName="prom-label-proxy"
Jul 21 20:20:22.956800 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.956660    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca368375-4908-4493-9f41-97363f5dc755" containerName="prom-label-proxy"
Jul 21 20:20:22.956800 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.956666    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca368375-4908-4493-9f41-97363f5dc755" containerName="config-reloader"
Jul 21 20:20:22.956800 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.956671    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca368375-4908-4493-9f41-97363f5dc755" containerName="config-reloader"
Jul 21 20:20:22.956800 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.956728    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca368375-4908-4493-9f41-97363f5dc755" containerName="config-reloader"
Jul 21 20:20:22.956800 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.956735    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca368375-4908-4493-9f41-97363f5dc755" containerName="kube-rbac-proxy-metric"
Jul 21 20:20:22.956800 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.956742    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfe49a9e-c954-4b0c-b8db-8bc33d8f686d" containerName="registry"
Jul 21 20:20:22.956800 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.956748    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca368375-4908-4493-9f41-97363f5dc755" containerName="prom-label-proxy"
Jul 21 20:20:22.956800 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.956753    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca368375-4908-4493-9f41-97363f5dc755" containerName="alertmanager"
Jul 21 20:20:22.956800 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.956760    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca368375-4908-4493-9f41-97363f5dc755" containerName="kube-rbac-proxy-web"
Jul 21 20:20:22.956800 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.956765    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca368375-4908-4493-9f41-97363f5dc755" containerName="kube-rbac-proxy"
Jul 21 20:20:22.960285 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.960271    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:22.963855 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.963791    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 21 20:20:22.963855 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.963821    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 21 20:20:22.963855 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.963828    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 21 20:20:22.963855 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.963828    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2wnps\""
Jul 21 20:20:22.964081 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.963828    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 21 20:20:22.964081 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.963828    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 21 20:20:22.964081 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.963833    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 21 20:20:22.964280 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.964264    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 21 20:20:22.964350 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.964280    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 21 20:20:22.970785 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.970762    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 21 20:20:22.978434 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.978411    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 20:20:22.982336 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.982309    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e88681af-cbca-4796-b909-ccb5e2a930c3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:22.982457 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.982358    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e88681af-cbca-4796-b909-ccb5e2a930c3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:22.982457 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.982385    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e88681af-cbca-4796-b909-ccb5e2a930c3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:22.982457 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.982409    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e88681af-cbca-4796-b909-ccb5e2a930c3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:22.982457 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.982431    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e88681af-cbca-4796-b909-ccb5e2a930c3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:22.982457 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.982458    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e88681af-cbca-4796-b909-ccb5e2a930c3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:22.982730 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.982496    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e88681af-cbca-4796-b909-ccb5e2a930c3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:22.982730 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.982528    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e88681af-cbca-4796-b909-ccb5e2a930c3-config-volume\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:22.982730 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.982545    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e88681af-cbca-4796-b909-ccb5e2a930c3-config-out\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:22.982730 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.982568    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drxfm\" (UniqueName: \"kubernetes.io/projected/e88681af-cbca-4796-b909-ccb5e2a930c3-kube-api-access-drxfm\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:22.982730 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.982599    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e88681af-cbca-4796-b909-ccb5e2a930c3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:22.982730 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.982648    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e88681af-cbca-4796-b909-ccb5e2a930c3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:22.982730 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:22.982709    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e88681af-cbca-4796-b909-ccb5e2a930c3-web-config\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:23.083939 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.083892    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e88681af-cbca-4796-b909-ccb5e2a930c3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:23.083939 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.083946    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e88681af-cbca-4796-b909-ccb5e2a930c3-web-config\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:23.084159 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.083966    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e88681af-cbca-4796-b909-ccb5e2a930c3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:23.084215 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.084159    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e88681af-cbca-4796-b909-ccb5e2a930c3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:23.084215 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.084203    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e88681af-cbca-4796-b909-ccb5e2a930c3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:23.084320 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.084250    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e88681af-cbca-4796-b909-ccb5e2a930c3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:23.084320 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.084277    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e88681af-cbca-4796-b909-ccb5e2a930c3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:23.084320 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.084310    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e88681af-cbca-4796-b909-ccb5e2a930c3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:23.084461 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.084355    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e88681af-cbca-4796-b909-ccb5e2a930c3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:23.084461 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.084392    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e88681af-cbca-4796-b909-ccb5e2a930c3-config-volume\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:23.084461 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.084420    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e88681af-cbca-4796-b909-ccb5e2a930c3-config-out\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:23.084461 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.084455    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drxfm\" (UniqueName: \"kubernetes.io/projected/e88681af-cbca-4796-b909-ccb5e2a930c3-kube-api-access-drxfm\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:23.084643 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.084487    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e88681af-cbca-4796-b909-ccb5e2a930c3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:23.084643 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.084554    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e88681af-cbca-4796-b909-ccb5e2a930c3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:23.086276 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.085598    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e88681af-cbca-4796-b909-ccb5e2a930c3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:23.086276 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.086229    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e88681af-cbca-4796-b909-ccb5e2a930c3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:23.087184 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.086992    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e88681af-cbca-4796-b909-ccb5e2a930c3-config-out\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:23.087184 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.087109    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e88681af-cbca-4796-b909-ccb5e2a930c3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:23.087370 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.087189    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e88681af-cbca-4796-b909-ccb5e2a930c3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:23.087635 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.087604    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e88681af-cbca-4796-b909-ccb5e2a930c3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:23.087740 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.087648    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e88681af-cbca-4796-b909-ccb5e2a930c3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:23.087740 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.087663    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e88681af-cbca-4796-b909-ccb5e2a930c3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:23.087740 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.087683    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e88681af-cbca-4796-b909-ccb5e2a930c3-web-config\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:23.088658 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.088635    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e88681af-cbca-4796-b909-ccb5e2a930c3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:23.088768 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.088716    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e88681af-cbca-4796-b909-ccb5e2a930c3-config-volume\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:23.095063 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.095044    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drxfm\" (UniqueName: \"kubernetes.io/projected/e88681af-cbca-4796-b909-ccb5e2a930c3-kube-api-access-drxfm\") pod \"alertmanager-main-0\" (UID: \"e88681af-cbca-4796-b909-ccb5e2a930c3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:23.269707 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.269651    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 20:20:23.429468 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.429436    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 20:20:23.431929 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:20:23.431890    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode88681af_cbca_4796_b909_ccb5e2a930c3.slice/crio-0f77f553ab3c53140d026359c36fcef76975d5c03b0439d5c811f493a1ceb9a7 WatchSource:0}: Error finding container 0f77f553ab3c53140d026359c36fcef76975d5c03b0439d5c811f493a1ceb9a7: Status 404 returned error can't find the container with id 0f77f553ab3c53140d026359c36fcef76975d5c03b0439d5c811f493a1ceb9a7
Jul 21 20:20:23.651590 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.651547    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca368375-4908-4493-9f41-97363f5dc755" path="/var/lib/kubelet/pods/ca368375-4908-4493-9f41-97363f5dc755/volumes"
Jul 21 20:20:23.905336 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.905307    2576 generic.go:356] "Generic (PLEG): container finished" podID="e88681af-cbca-4796-b909-ccb5e2a930c3" containerID="a1d4275801cbdd30c6c8bed1c90d6961eec1e5ae9d51b66080b26f3213dccce8" exitCode=0
Jul 21 20:20:23.905490 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.905389    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e88681af-cbca-4796-b909-ccb5e2a930c3","Type":"ContainerDied","Data":"a1d4275801cbdd30c6c8bed1c90d6961eec1e5ae9d51b66080b26f3213dccce8"}
Jul 21 20:20:23.905490 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.905454    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e88681af-cbca-4796-b909-ccb5e2a930c3","Type":"ContainerStarted","Data":"0f77f553ab3c53140d026359c36fcef76975d5c03b0439d5c811f493a1ceb9a7"}
Jul 21 20:20:23.907446 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.907416    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q9fp4" event={"ID":"3712cffa-e355-4c1e-9d88-b133a9eec5b4","Type":"ContainerStarted","Data":"b71a54f90c75f3b8df5f9b6233718d7837502d2d681200ca24490e9fc4ce9191"}
Jul 21 20:20:23.953590 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:23.953529    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-q9fp4" podStartSLOduration=372.798002732 podStartE2EDuration="6m13.953507507s" totalImagesPullingTime="1.155504775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:14:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:20:23.952913226 +0000 UTC m=+374.885311384" watchObservedRunningTime="2026-07-21 20:20:23.953507507 +0000 UTC m=+374.885905664"
Jul 21 20:20:24.099159 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:24.099132    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:20:24.195591 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:24.195568    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:20:24.914942 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:24.914901    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e88681af-cbca-4796-b909-ccb5e2a930c3","Type":"ContainerStarted","Data":"ebe00251a175e38b0b29b24ebd53bc6e9f23ba0a7ddff870fcc765a56dd46f85"}
Jul 21 20:20:24.915364 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:24.915006    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e88681af-cbca-4796-b909-ccb5e2a930c3","Type":"ContainerStarted","Data":"0e4234eee239b3a4228f37a7584482b53a260b5d06f9e1dd3061fa7383a2c927"}
Jul 21 20:20:24.915364 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:24.915050    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e88681af-cbca-4796-b909-ccb5e2a930c3","Type":"ContainerStarted","Data":"74e740d90bb3e98d1e588ac6149e87d3cd6f0efe65d599ba57152271787549d2"}
Jul 21 20:20:24.915364 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:24.915078    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e88681af-cbca-4796-b909-ccb5e2a930c3","Type":"ContainerStarted","Data":"e5997ae47dae96907ff3dcfc701ae706ef9dea7dc34c8855b0e1b741bb2b6ccc"}
Jul 21 20:20:24.915364 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:24.915110    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e88681af-cbca-4796-b909-ccb5e2a930c3","Type":"ContainerStarted","Data":"852c357cf776ca5f516c07a71082c43c6feae458025a1f5e4f24a2beaac49082"}
Jul 21 20:20:24.915364 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:24.915133    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e88681af-cbca-4796-b909-ccb5e2a930c3","Type":"ContainerStarted","Data":"a8c99447714800b3c42e695e0986b8cafa291e99cd980e10f43b85e1b8a7b2b7"}
Jul 21 20:20:24.916839 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:24.916813    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q9fp4" event={"ID":"3712cffa-e355-4c1e-9d88-b133a9eec5b4","Type":"ContainerStarted","Data":"a69e129eb6ad543c7130c8243a70c58fd4aba622289ce7be8a33d8ba3fa05fe1"}
Jul 21 20:20:24.943624 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:24.943559    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.9292561470000003 podStartE2EDuration="2.943543534s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.287387ms" isStatefulPod=false podCreationTimestamp="2026-07-21 20:20:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:20:24.942681402 +0000 UTC m=+375.875079558" watchObservedRunningTime="2026-07-21 20:20:24.943543534 +0000 UTC m=+375.875941690"
Jul 21 20:20:25.411595 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.411557    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 20:20:25.411928 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.411870    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerName="prometheus" containerID="cri-o://47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d" gracePeriod=600
Jul 21 20:20:25.411928 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.411918    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerName="kube-rbac-proxy-thanos" containerID="cri-o://589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729" gracePeriod=600
Jul 21 20:20:25.412115 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.411937    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerName="config-reloader" containerID="cri-o://f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202" gracePeriod=600
Jul 21 20:20:25.412115 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.411883    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerName="kube-rbac-proxy" containerID="cri-o://c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7" gracePeriod=600
Jul 21 20:20:25.412115 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.411928    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerName="kube-rbac-proxy-web" containerID="cri-o://1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a" gracePeriod=600
Jul 21 20:20:25.412115 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.411904    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerName="thanos-sidecar" containerID="cri-o://97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c" gracePeriod=600
Jul 21 20:20:25.654682 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.654655    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:25.705745 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.705710    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-k8s-rulefiles-1\") pod \"2b510dd0-e811-4350-8e9c-4560587d0de1\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") "
Jul 21 20:20:25.705745 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.705755    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-trusted-ca-bundle\") pod \"2b510dd0-e811-4350-8e9c-4560587d0de1\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") "
Jul 21 20:20:25.705985 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.705780    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-kube-rbac-proxy\") pod \"2b510dd0-e811-4350-8e9c-4560587d0de1\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") "
Jul 21 20:20:25.705985 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.705811    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"2b510dd0-e811-4350-8e9c-4560587d0de1\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") "
Jul 21 20:20:25.706163 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.705990    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-configmap-serving-certs-ca-bundle\") pod \"2b510dd0-e811-4350-8e9c-4560587d0de1\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") "
Jul 21 20:20:25.706224 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.706197    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "2b510dd0-e811-4350-8e9c-4560587d0de1" (UID: "2b510dd0-e811-4350-8e9c-4560587d0de1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:20:25.706284 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.706259    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "2b510dd0-e811-4350-8e9c-4560587d0de1" (UID: "2b510dd0-e811-4350-8e9c-4560587d0de1"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:20:25.706393 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.706369    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "2b510dd0-e811-4350-8e9c-4560587d0de1" (UID: "2b510dd0-e811-4350-8e9c-4560587d0de1"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:20:25.706448 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.706433    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b510dd0-e811-4350-8e9c-4560587d0de1-config-out\") pod \"2b510dd0-e811-4350-8e9c-4560587d0de1\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") "
Jul 21 20:20:25.706480 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.706465    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-grpc-tls\") pod \"2b510dd0-e811-4350-8e9c-4560587d0de1\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") "
Jul 21 20:20:25.706515 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.706496    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-web-config\") pod \"2b510dd0-e811-4350-8e9c-4560587d0de1\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") "
Jul 21 20:20:25.706558 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.706544    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b510dd0-e811-4350-8e9c-4560587d0de1-tls-assets\") pod \"2b510dd0-e811-4350-8e9c-4560587d0de1\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") "
Jul 21 20:20:25.706607 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.706581    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-thanos-prometheus-http-client-file\") pod \"2b510dd0-e811-4350-8e9c-4560587d0de1\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") "
Jul 21 20:20:25.706648 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.706629    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5w8pj\" (UniqueName: \"kubernetes.io/projected/2b510dd0-e811-4350-8e9c-4560587d0de1-kube-api-access-5w8pj\") pod \"2b510dd0-e811-4350-8e9c-4560587d0de1\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") "
Jul 21 20:20:25.706719 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.706679    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-configmap-metrics-client-ca\") pod \"2b510dd0-e811-4350-8e9c-4560587d0de1\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") "
Jul 21 20:20:25.706808 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.706791    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-config\") pod \"2b510dd0-e811-4350-8e9c-4560587d0de1\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") "
Jul 21 20:20:25.706862 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.706825    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-k8s-db\") pod \"2b510dd0-e811-4350-8e9c-4560587d0de1\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") "
Jul 21 20:20:25.706862 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.706854    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-configmap-kubelet-serving-ca-bundle\") pod \"2b510dd0-e811-4350-8e9c-4560587d0de1\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") "
Jul 21 20:20:25.706970 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.706882    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"2b510dd0-e811-4350-8e9c-4560587d0de1\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") "
Jul 21 20:20:25.706970 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.706911    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-metrics-client-certs\") pod \"2b510dd0-e811-4350-8e9c-4560587d0de1\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") "
Jul 21 20:20:25.706970 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.706938    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-k8s-rulefiles-2\") pod \"2b510dd0-e811-4350-8e9c-4560587d0de1\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") "
Jul 21 20:20:25.707163 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.706993    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-prometheus-k8s-tls\") pod \"2b510dd0-e811-4350-8e9c-4560587d0de1\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") "
Jul 21 20:20:25.707163 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.707027    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-k8s-rulefiles-0\") pod \"2b510dd0-e811-4350-8e9c-4560587d0de1\" (UID: \"2b510dd0-e811-4350-8e9c-4560587d0de1\") "
Jul 21 20:20:25.707451 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.707427    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "2b510dd0-e811-4350-8e9c-4560587d0de1" (UID: "2b510dd0-e811-4350-8e9c-4560587d0de1"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:20:25.707631 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.707600    2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:25.707713 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.707638    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:25.707713 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.707655    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:25.707713 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.707670    2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:25.709827 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.709759    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "2b510dd0-e811-4350-8e9c-4560587d0de1" (UID: "2b510dd0-e811-4350-8e9c-4560587d0de1"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:20:25.709933 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.709913    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "2b510dd0-e811-4350-8e9c-4560587d0de1" (UID: "2b510dd0-e811-4350-8e9c-4560587d0de1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:20:25.710164 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.710125    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "2b510dd0-e811-4350-8e9c-4560587d0de1" (UID: "2b510dd0-e811-4350-8e9c-4560587d0de1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:20:25.711839 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.710591    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "2b510dd0-e811-4350-8e9c-4560587d0de1" (UID: "2b510dd0-e811-4350-8e9c-4560587d0de1"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:20:25.711839 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.711074    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "2b510dd0-e811-4350-8e9c-4560587d0de1" (UID: "2b510dd0-e811-4350-8e9c-4560587d0de1"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:20:25.712130 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.712101    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "2b510dd0-e811-4350-8e9c-4560587d0de1" (UID: "2b510dd0-e811-4350-8e9c-4560587d0de1"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:20:25.712468 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.712426    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "2b510dd0-e811-4350-8e9c-4560587d0de1" (UID: "2b510dd0-e811-4350-8e9c-4560587d0de1"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:20:25.712557 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.712476    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "2b510dd0-e811-4350-8e9c-4560587d0de1" (UID: "2b510dd0-e811-4350-8e9c-4560587d0de1"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:20:25.712711 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.712624    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b510dd0-e811-4350-8e9c-4560587d0de1-kube-api-access-5w8pj" (OuterVolumeSpecName: "kube-api-access-5w8pj") pod "2b510dd0-e811-4350-8e9c-4560587d0de1" (UID: "2b510dd0-e811-4350-8e9c-4560587d0de1"). InnerVolumeSpecName "kube-api-access-5w8pj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:20:25.712797 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.712723    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b510dd0-e811-4350-8e9c-4560587d0de1-config-out" (OuterVolumeSpecName: "config-out") pod "2b510dd0-e811-4350-8e9c-4560587d0de1" (UID: "2b510dd0-e811-4350-8e9c-4560587d0de1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:20:25.712897 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.712862    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "2b510dd0-e811-4350-8e9c-4560587d0de1" (UID: "2b510dd0-e811-4350-8e9c-4560587d0de1"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:20:25.713745 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.713718    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "2b510dd0-e811-4350-8e9c-4560587d0de1" (UID: "2b510dd0-e811-4350-8e9c-4560587d0de1"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:20:25.714371 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.714344    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-config" (OuterVolumeSpecName: "config") pod "2b510dd0-e811-4350-8e9c-4560587d0de1" (UID: "2b510dd0-e811-4350-8e9c-4560587d0de1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:20:25.714454 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.714434    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "2b510dd0-e811-4350-8e9c-4560587d0de1" (UID: "2b510dd0-e811-4350-8e9c-4560587d0de1"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:20:25.714663 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.714641    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b510dd0-e811-4350-8e9c-4560587d0de1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2b510dd0-e811-4350-8e9c-4560587d0de1" (UID: "2b510dd0-e811-4350-8e9c-4560587d0de1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:20:25.725075 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.725039    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-web-config" (OuterVolumeSpecName: "web-config") pod "2b510dd0-e811-4350-8e9c-4560587d0de1" (UID: "2b510dd0-e811-4350-8e9c-4560587d0de1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:20:25.808674 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.808572    2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-configmap-metrics-client-ca\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:25.808674 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.808618    2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-config\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:25.808674 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.808632    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-k8s-db\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:25.808674 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.808642    2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:25.808674 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.808651    2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-metrics-client-certs\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:25.808674 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.808661    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:25.808674 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.808671    2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:25.808674 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.808679    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2b510dd0-e811-4350-8e9c-4560587d0de1-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:25.808674 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.808718    2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-kube-rbac-proxy\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:25.809087 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.808727    2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:25.809087 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.808737    2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b510dd0-e811-4350-8e9c-4560587d0de1-config-out\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:25.809087 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.808745    2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-secret-grpc-tls\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:25.809087 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.808753    2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-web-config\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:25.809087 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.808759    2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b510dd0-e811-4350-8e9c-4560587d0de1-tls-assets\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:25.809087 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.808767    2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2b510dd0-e811-4350-8e9c-4560587d0de1-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:25.809087 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.808776    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5w8pj\" (UniqueName: \"kubernetes.io/projected/2b510dd0-e811-4350-8e9c-4560587d0de1-kube-api-access-5w8pj\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:20:25.924723 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.924670    2576 generic.go:356] "Generic (PLEG): container finished" podID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerID="589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729" exitCode=0
Jul 21 20:20:25.924723 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.924711    2576 generic.go:356] "Generic (PLEG): container finished" podID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerID="c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7" exitCode=0
Jul 21 20:20:25.924723 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.924722    2576 generic.go:356] "Generic (PLEG): container finished" podID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerID="1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a" exitCode=0
Jul 21 20:20:25.924723 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.924731    2576 generic.go:356] "Generic (PLEG): container finished" podID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerID="97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c" exitCode=0
Jul 21 20:20:25.925290 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.924738    2576 generic.go:356] "Generic (PLEG): container finished" podID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerID="f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202" exitCode=0
Jul 21 20:20:25.925290 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.924746    2576 generic.go:356] "Generic (PLEG): container finished" podID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerID="47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d" exitCode=0
Jul 21 20:20:25.925290 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.924762    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:25.925290 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.924758    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b510dd0-e811-4350-8e9c-4560587d0de1","Type":"ContainerDied","Data":"589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729"}
Jul 21 20:20:25.925290 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.924929    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b510dd0-e811-4350-8e9c-4560587d0de1","Type":"ContainerDied","Data":"c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7"}
Jul 21 20:20:25.925290 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.924961    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b510dd0-e811-4350-8e9c-4560587d0de1","Type":"ContainerDied","Data":"1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a"}
Jul 21 20:20:25.925290 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.924987    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b510dd0-e811-4350-8e9c-4560587d0de1","Type":"ContainerDied","Data":"97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c"}
Jul 21 20:20:25.925290 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.925001    2576 scope.go:117] "RemoveContainer" containerID="589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729"
Jul 21 20:20:25.925290 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.925011    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b510dd0-e811-4350-8e9c-4560587d0de1","Type":"ContainerDied","Data":"f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202"}
Jul 21 20:20:25.925290 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.925034    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b510dd0-e811-4350-8e9c-4560587d0de1","Type":"ContainerDied","Data":"47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d"}
Jul 21 20:20:25.925290 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.925059    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b510dd0-e811-4350-8e9c-4560587d0de1","Type":"ContainerDied","Data":"1e4fdbfd7fdca09997577714a2052baa6d3a8fbaf0cb0ff61102b372d2db46f6"}
Jul 21 20:20:25.933450 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.933429    2576 scope.go:117] "RemoveContainer" containerID="c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7"
Jul 21 20:20:25.940771 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.940753    2576 scope.go:117] "RemoveContainer" containerID="1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a"
Jul 21 20:20:25.947603 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.947583    2576 scope.go:117] "RemoveContainer" containerID="97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c"
Jul 21 20:20:25.953827 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.953801    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 20:20:25.955257 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.955239    2576 scope.go:117] "RemoveContainer" containerID="f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202"
Jul 21 20:20:25.962460 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.962441    2576 scope.go:117] "RemoveContainer" containerID="47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d"
Jul 21 20:20:25.970092 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.970072    2576 scope.go:117] "RemoveContainer" containerID="45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded"
Jul 21 20:20:25.978205 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.978186    2576 scope.go:117] "RemoveContainer" containerID="589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729"
Jul 21 20:20:25.978407 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.978388    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 20:20:25.978496 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:20:25.978479    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729\": container with ID starting with 589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729 not found: ID does not exist" containerID="589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729"
Jul 21 20:20:25.978532 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.978504    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729"} err="failed to get container status \"589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729\": rpc error: code = NotFound desc = could not find container \"589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729\": container with ID starting with 589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729 not found: ID does not exist"
Jul 21 20:20:25.978532 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.978524    2576 scope.go:117] "RemoveContainer" containerID="c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7"
Jul 21 20:20:25.978782 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:20:25.978767    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7\": container with ID starting with c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7 not found: ID does not exist" containerID="c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7"
Jul 21 20:20:25.978848 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.978785    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7"} err="failed to get container status \"c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7\": rpc error: code = NotFound desc = could not find container \"c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7\": container with ID starting with c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7 not found: ID does not exist"
Jul 21 20:20:25.978848 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.978797    2576 scope.go:117] "RemoveContainer" containerID="1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a"
Jul 21 20:20:25.979030 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:20:25.979016    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a\": container with ID starting with 1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a not found: ID does not exist" containerID="1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a"
Jul 21 20:20:25.979074 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.979032    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a"} err="failed to get container status \"1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a\": rpc error: code = NotFound desc = could not find container \"1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a\": container with ID starting with 1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a not found: ID does not exist"
Jul 21 20:20:25.979074 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.979043    2576 scope.go:117] "RemoveContainer" containerID="97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c"
Jul 21 20:20:25.979243 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:20:25.979228    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c\": container with ID starting with 97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c not found: ID does not exist" containerID="97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c"
Jul 21 20:20:25.979290 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.979245    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c"} err="failed to get container status \"97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c\": rpc error: code = NotFound desc = could not find container \"97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c\": container with ID starting with 97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c not found: ID does not exist"
Jul 21 20:20:25.979290 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.979256    2576 scope.go:117] "RemoveContainer" containerID="f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202"
Jul 21 20:20:25.979460 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:20:25.979444    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202\": container with ID starting with f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202 not found: ID does not exist" containerID="f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202"
Jul 21 20:20:25.979497 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.979461    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202"} err="failed to get container status \"f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202\": rpc error: code = NotFound desc = could not find container \"f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202\": container with ID starting with f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202 not found: ID does not exist"
Jul 21 20:20:25.979497 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.979473    2576 scope.go:117] "RemoveContainer" containerID="47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d"
Jul 21 20:20:25.979752 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:20:25.979733    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d\": container with ID starting with 47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d not found: ID does not exist" containerID="47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d"
Jul 21 20:20:25.979812 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.979757    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d"} err="failed to get container status \"47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d\": rpc error: code = NotFound desc = could not find container \"47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d\": container with ID starting with 47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d not found: ID does not exist"
Jul 21 20:20:25.979812 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.979773    2576 scope.go:117] "RemoveContainer" containerID="45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded"
Jul 21 20:20:25.980038 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:20:25.980017    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded\": container with ID starting with 45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded not found: ID does not exist" containerID="45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded"
Jul 21 20:20:25.980085 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.980043    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded"} err="failed to get container status \"45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded\": rpc error: code = NotFound desc = could not find container \"45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded\": container with ID starting with 45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded not found: ID does not exist"
Jul 21 20:20:25.980085 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.980058    2576 scope.go:117] "RemoveContainer" containerID="589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729"
Jul 21 20:20:25.980292 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.980274    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729"} err="failed to get container status \"589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729\": rpc error: code = NotFound desc = could not find container \"589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729\": container with ID starting with 589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729 not found: ID does not exist"
Jul 21 20:20:25.980334 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.980293    2576 scope.go:117] "RemoveContainer" containerID="c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7"
Jul 21 20:20:25.980518 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.980500    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7"} err="failed to get container status \"c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7\": rpc error: code = NotFound desc = could not find container \"c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7\": container with ID starting with c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7 not found: ID does not exist"
Jul 21 20:20:25.980556 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.980519    2576 scope.go:117] "RemoveContainer" containerID="1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a"
Jul 21 20:20:25.980742 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.980719    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a"} err="failed to get container status \"1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a\": rpc error: code = NotFound desc = could not find container \"1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a\": container with ID starting with 1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a not found: ID does not exist"
Jul 21 20:20:25.980797 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.980743    2576 scope.go:117] "RemoveContainer" containerID="97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c"
Jul 21 20:20:25.980989 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.980973    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c"} err="failed to get container status \"97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c\": rpc error: code = NotFound desc = could not find container \"97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c\": container with ID starting with 97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c not found: ID does not exist"
Jul 21 20:20:25.981028 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.980990    2576 scope.go:117] "RemoveContainer" containerID="f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202"
Jul 21 20:20:25.981199 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.981180    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202"} err="failed to get container status \"f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202\": rpc error: code = NotFound desc = could not find container \"f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202\": container with ID starting with f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202 not found: ID does not exist"
Jul 21 20:20:25.981272 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.981200    2576 scope.go:117] "RemoveContainer" containerID="47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d"
Jul 21 20:20:25.981416 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.981397    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d"} err="failed to get container status \"47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d\": rpc error: code = NotFound desc = could not find container \"47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d\": container with ID starting with 47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d not found: ID does not exist"
Jul 21 20:20:25.981468 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.981418    2576 scope.go:117] "RemoveContainer" containerID="45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded"
Jul 21 20:20:25.981627 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.981606    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded"} err="failed to get container status \"45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded\": rpc error: code = NotFound desc = could not find container \"45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded\": container with ID starting with 45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded not found: ID does not exist"
Jul 21 20:20:25.981680 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.981630    2576 scope.go:117] "RemoveContainer" containerID="589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729"
Jul 21 20:20:25.981838 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.981822    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729"} err="failed to get container status \"589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729\": rpc error: code = NotFound desc = could not find container \"589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729\": container with ID starting with 589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729 not found: ID does not exist"
Jul 21 20:20:25.981875 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.981857    2576 scope.go:117] "RemoveContainer" containerID="c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7"
Jul 21 20:20:25.982071 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.982053    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7"} err="failed to get container status \"c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7\": rpc error: code = NotFound desc = could not find container \"c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7\": container with ID starting with c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7 not found: ID does not exist"
Jul 21 20:20:25.982131 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.982072    2576 scope.go:117] "RemoveContainer" containerID="1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a"
Jul 21 20:20:25.982311 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.982287    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a"} err="failed to get container status \"1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a\": rpc error: code = NotFound desc = could not find container \"1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a\": container with ID starting with 1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a not found: ID does not exist"
Jul 21 20:20:25.982349 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.982314    2576 scope.go:117] "RemoveContainer" containerID="97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c"
Jul 21 20:20:25.982534 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.982516    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c"} err="failed to get container status \"97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c\": rpc error: code = NotFound desc = could not find container \"97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c\": container with ID starting with 97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c not found: ID does not exist"
Jul 21 20:20:25.982568 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.982536    2576 scope.go:117] "RemoveContainer" containerID="f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202"
Jul 21 20:20:25.982743 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.982726    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202"} err="failed to get container status \"f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202\": rpc error: code = NotFound desc = could not find container \"f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202\": container with ID starting with f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202 not found: ID does not exist"
Jul 21 20:20:25.982786 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.982744    2576 scope.go:117] "RemoveContainer" containerID="47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d"
Jul 21 20:20:25.982977 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.982961    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d"} err="failed to get container status \"47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d\": rpc error: code = NotFound desc = could not find container \"47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d\": container with ID starting with 47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d not found: ID does not exist"
Jul 21 20:20:25.983011 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.982978    2576 scope.go:117] "RemoveContainer" containerID="45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded"
Jul 21 20:20:25.983180 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.983160    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded"} err="failed to get container status \"45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded\": rpc error: code = NotFound desc = could not find container \"45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded\": container with ID starting with 45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded not found: ID does not exist"
Jul 21 20:20:25.983214 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.983181    2576 scope.go:117] "RemoveContainer" containerID="589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729"
Jul 21 20:20:25.983384 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.983367    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729"} err="failed to get container status \"589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729\": rpc error: code = NotFound desc = could not find container \"589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729\": container with ID starting with 589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729 not found: ID does not exist"
Jul 21 20:20:25.983428 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.983385    2576 scope.go:117] "RemoveContainer" containerID="c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7"
Jul 21 20:20:25.983568 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.983548    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7"} err="failed to get container status \"c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7\": rpc error: code = NotFound desc = could not find container \"c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7\": container with ID starting with c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7 not found: ID does not exist"
Jul 21 20:20:25.983640 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.983571    2576 scope.go:117] "RemoveContainer" containerID="1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a"
Jul 21 20:20:25.983816 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.983796    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a"} err="failed to get container status \"1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a\": rpc error: code = NotFound desc = could not find container \"1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a\": container with ID starting with 1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a not found: ID does not exist"
Jul 21 20:20:25.983867 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.983819    2576 scope.go:117] "RemoveContainer" containerID="97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c"
Jul 21 20:20:25.984000 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.983983    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c"} err="failed to get container status \"97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c\": rpc error: code = NotFound desc = could not find container \"97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c\": container with ID starting with 97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c not found: ID does not exist"
Jul 21 20:20:25.984039 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.984000    2576 scope.go:117] "RemoveContainer" containerID="f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202"
Jul 21 20:20:25.984187 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.984169    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202"} err="failed to get container status \"f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202\": rpc error: code = NotFound desc = could not find container \"f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202\": container with ID starting with f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202 not found: ID does not exist"
Jul 21 20:20:25.984252 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.984188    2576 scope.go:117] "RemoveContainer" containerID="47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d"
Jul 21 20:20:25.984381 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.984366    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d"} err="failed to get container status \"47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d\": rpc error: code = NotFound desc = could not find container \"47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d\": container with ID starting with 47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d not found: ID does not exist"
Jul 21 20:20:25.984425 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.984381    2576 scope.go:117] "RemoveContainer" containerID="45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded"
Jul 21 20:20:25.984524 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.984512    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded"} err="failed to get container status \"45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded\": rpc error: code = NotFound desc = could not find container \"45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded\": container with ID starting with 45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded not found: ID does not exist"
Jul 21 20:20:25.984567 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.984524    2576 scope.go:117] "RemoveContainer" containerID="589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729"
Jul 21 20:20:25.984762 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.984742    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729"} err="failed to get container status \"589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729\": rpc error: code = NotFound desc = could not find container \"589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729\": container with ID starting with 589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729 not found: ID does not exist"
Jul 21 20:20:25.984762 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.984757    2576 scope.go:117] "RemoveContainer" containerID="c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7"
Jul 21 20:20:25.984942 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.984919    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7"} err="failed to get container status \"c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7\": rpc error: code = NotFound desc = could not find container \"c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7\": container with ID starting with c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7 not found: ID does not exist"
Jul 21 20:20:25.985012 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.984945    2576 scope.go:117] "RemoveContainer" containerID="1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a"
Jul 21 20:20:25.985182 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.985163    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a"} err="failed to get container status \"1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a\": rpc error: code = NotFound desc = could not find container \"1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a\": container with ID starting with 1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a not found: ID does not exist"
Jul 21 20:20:25.985248 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.985182    2576 scope.go:117] "RemoveContainer" containerID="97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c"
Jul 21 20:20:25.985381 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.985366    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c"} err="failed to get container status \"97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c\": rpc error: code = NotFound desc = could not find container \"97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c\": container with ID starting with 97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c not found: ID does not exist"
Jul 21 20:20:25.985421 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.985382    2576 scope.go:117] "RemoveContainer" containerID="f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202"
Jul 21 20:20:25.985586 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.985568    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202"} err="failed to get container status \"f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202\": rpc error: code = NotFound desc = could not find container \"f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202\": container with ID starting with f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202 not found: ID does not exist"
Jul 21 20:20:25.985670 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.985587    2576 scope.go:117] "RemoveContainer" containerID="47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d"
Jul 21 20:20:25.985782 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.985768    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d"} err="failed to get container status \"47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d\": rpc error: code = NotFound desc = could not find container \"47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d\": container with ID starting with 47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d not found: ID does not exist"
Jul 21 20:20:25.985819 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.985782    2576 scope.go:117] "RemoveContainer" containerID="45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded"
Jul 21 20:20:25.985949 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.985933    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded"} err="failed to get container status \"45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded\": rpc error: code = NotFound desc = could not find container \"45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded\": container with ID starting with 45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded not found: ID does not exist"
Jul 21 20:20:25.985988 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.985951    2576 scope.go:117] "RemoveContainer" containerID="589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729"
Jul 21 20:20:25.986120 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.986105    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729"} err="failed to get container status \"589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729\": rpc error: code = NotFound desc = could not find container \"589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729\": container with ID starting with 589c106408426e04b5e6e4ada189d0de089f0cffe30b63147a73b2cb778bd729 not found: ID does not exist"
Jul 21 20:20:25.986168 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.986120    2576 scope.go:117] "RemoveContainer" containerID="c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7"
Jul 21 20:20:25.986293 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.986278    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7"} err="failed to get container status \"c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7\": rpc error: code = NotFound desc = could not find container \"c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7\": container with ID starting with c066d8b9e291364e442558bce328ed191f8608225998747305c3e4449e2488c7 not found: ID does not exist"
Jul 21 20:20:25.986333 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.986294    2576 scope.go:117] "RemoveContainer" containerID="1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a"
Jul 21 20:20:25.986457 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.986439    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a"} err="failed to get container status \"1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a\": rpc error: code = NotFound desc = could not find container \"1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a\": container with ID starting with 1d8a35a271865109ae59495b43e7e21a054673a21362b4236439e1c5b965b18a not found: ID does not exist"
Jul 21 20:20:25.986494 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.986459    2576 scope.go:117] "RemoveContainer" containerID="97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c"
Jul 21 20:20:25.986628 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.986612    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c"} err="failed to get container status \"97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c\": rpc error: code = NotFound desc = could not find container \"97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c\": container with ID starting with 97211c45202a785a3b56dc5957fbc20e3f2f001127c013c10c060177b7b3a13c not found: ID does not exist"
Jul 21 20:20:25.986664 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.986629    2576 scope.go:117] "RemoveContainer" containerID="f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202"
Jul 21 20:20:25.986816 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.986800    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202"} err="failed to get container status \"f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202\": rpc error: code = NotFound desc = could not find container \"f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202\": container with ID starting with f545aa2ccd1254816caefea47c5d2f6060aea62ff006466c685045157dd89202 not found: ID does not exist"
Jul 21 20:20:25.986859 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.986817    2576 scope.go:117] "RemoveContainer" containerID="47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d"
Jul 21 20:20:25.986992 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.986977    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d"} err="failed to get container status \"47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d\": rpc error: code = NotFound desc = could not find container \"47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d\": container with ID starting with 47d2b95a6bf1337658e8732edb45b155f8437dd3f2034ff2d250aa2c3e06723d not found: ID does not exist"
Jul 21 20:20:25.987039 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.986992    2576 scope.go:117] "RemoveContainer" containerID="45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded"
Jul 21 20:20:25.987171 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:25.987155    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded"} err="failed to get container status \"45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded\": rpc error: code = NotFound desc = could not find container \"45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded\": container with ID starting with 45cd8fb449c3ecc5fceb097b4c44cb1049665bda46468b6557d7c777b9e6cded not found: ID does not exist"
Jul 21 20:20:26.041722 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.041669    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 20:20:26.041962 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.041949    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerName="prometheus"
Jul 21 20:20:26.042005 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.041963    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerName="prometheus"
Jul 21 20:20:26.042005 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.041974    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerName="thanos-sidecar"
Jul 21 20:20:26.042005 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.041980    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerName="thanos-sidecar"
Jul 21 20:20:26.042005 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.041986    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerName="kube-rbac-proxy"
Jul 21 20:20:26.042005 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.041993    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerName="kube-rbac-proxy"
Jul 21 20:20:26.042005 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.041999    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerName="config-reloader"
Jul 21 20:20:26.042005 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.042004    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerName="config-reloader"
Jul 21 20:20:26.042198 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.042018    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerName="kube-rbac-proxy-thanos"
Jul 21 20:20:26.042198 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.042023    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerName="kube-rbac-proxy-thanos"
Jul 21 20:20:26.042198 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.042035    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerName="init-config-reloader"
Jul 21 20:20:26.042198 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.042041    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerName="init-config-reloader"
Jul 21 20:20:26.042198 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.042047    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerName="kube-rbac-proxy-web"
Jul 21 20:20:26.042198 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.042052    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerName="kube-rbac-proxy-web"
Jul 21 20:20:26.042198 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.042088    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerName="thanos-sidecar"
Jul 21 20:20:26.042198 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.042098    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerName="kube-rbac-proxy-thanos"
Jul 21 20:20:26.042198 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.042106    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerName="kube-rbac-proxy"
Jul 21 20:20:26.042198 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.042112    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerName="config-reloader"
Jul 21 20:20:26.042198 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.042118    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerName="prometheus"
Jul 21 20:20:26.042198 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.042123    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b510dd0-e811-4350-8e9c-4560587d0de1" containerName="kube-rbac-proxy-web"
Jul 21 20:20:26.046469 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.046450    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.049273 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.049243    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 21 20:20:26.049437 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.049283    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 21 20:20:26.049437 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.049284    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 21 20:20:26.049437 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.049327    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 21 20:20:26.049591 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.049512    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 21 20:20:26.049591 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.049520    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 21 20:20:26.049805 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.049786    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 21 20:20:26.049900 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.049836    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 21 20:20:26.049900 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.049844    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 21 20:20:26.049900 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.049879    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 21 20:20:26.050028 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.049950    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 21 20:20:26.050028 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.050011    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 21 20:20:26.050296 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.050282    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 21 20:20:26.050343 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.050328    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3gc70pcmkcvct\""
Jul 21 20:20:26.050479 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.050463    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kbdjc\""
Jul 21 20:20:26.057825 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.057520    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 21 20:20:26.061291 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.061228    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 21 20:20:26.067883 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.067853    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 20:20:26.112097 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.112063    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4061785-d49e-4e3c-88c8-62c0bbf0f933-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.112232 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.112115    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4061785-d49e-4e3c-88c8-62c0bbf0f933-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.112232 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.112146    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4061785-d49e-4e3c-88c8-62c0bbf0f933-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.112232 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.112172    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e4061785-d49e-4e3c-88c8-62c0bbf0f933-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.112232 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.112224    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e4061785-d49e-4e3c-88c8-62c0bbf0f933-config\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.112360 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.112248    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e4061785-d49e-4e3c-88c8-62c0bbf0f933-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.112360 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.112285    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e4061785-d49e-4e3c-88c8-62c0bbf0f933-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.112360 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.112310    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e4061785-d49e-4e3c-88c8-62c0bbf0f933-config-out\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.112360 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.112332    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4061785-d49e-4e3c-88c8-62c0bbf0f933-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.112490 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.112395    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e4061785-d49e-4e3c-88c8-62c0bbf0f933-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.112490 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.112425    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e4061785-d49e-4e3c-88c8-62c0bbf0f933-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.112490 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.112449    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e4061785-d49e-4e3c-88c8-62c0bbf0f933-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.112490 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.112475    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e4061785-d49e-4e3c-88c8-62c0bbf0f933-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.112603 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.112503    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4061785-d49e-4e3c-88c8-62c0bbf0f933-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.112603 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.112543    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e4061785-d49e-4e3c-88c8-62c0bbf0f933-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.112603 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.112562    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkptw\" (UniqueName: \"kubernetes.io/projected/e4061785-d49e-4e3c-88c8-62c0bbf0f933-kube-api-access-jkptw\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.112704 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.112648    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e4061785-d49e-4e3c-88c8-62c0bbf0f933-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.112737 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.112705    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4061785-d49e-4e3c-88c8-62c0bbf0f933-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.112773 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.112734    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e4061785-d49e-4e3c-88c8-62c0bbf0f933-web-config\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.112773 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.112757    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e4061785-d49e-4e3c-88c8-62c0bbf0f933-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.213546 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.213481    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e4061785-d49e-4e3c-88c8-62c0bbf0f933-config\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.213546 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.213547    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e4061785-d49e-4e3c-88c8-62c0bbf0f933-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.213852 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.213581    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e4061785-d49e-4e3c-88c8-62c0bbf0f933-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.213852 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.213604    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e4061785-d49e-4e3c-88c8-62c0bbf0f933-config-out\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.213852 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.213623    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4061785-d49e-4e3c-88c8-62c0bbf0f933-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.213852 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.213661    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e4061785-d49e-4e3c-88c8-62c0bbf0f933-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.213852 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.213724    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e4061785-d49e-4e3c-88c8-62c0bbf0f933-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.213852 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.213749    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e4061785-d49e-4e3c-88c8-62c0bbf0f933-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.213852 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.213773    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e4061785-d49e-4e3c-88c8-62c0bbf0f933-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.213852 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.213802    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4061785-d49e-4e3c-88c8-62c0bbf0f933-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.213852 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.213826    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e4061785-d49e-4e3c-88c8-62c0bbf0f933-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.213852 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.213849    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkptw\" (UniqueName: \"kubernetes.io/projected/e4061785-d49e-4e3c-88c8-62c0bbf0f933-kube-api-access-jkptw\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.214315 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.213880    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e4061785-d49e-4e3c-88c8-62c0bbf0f933-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.214315 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.213912    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4061785-d49e-4e3c-88c8-62c0bbf0f933-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.214315 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.213937    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e4061785-d49e-4e3c-88c8-62c0bbf0f933-web-config\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.214315 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.213967    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e4061785-d49e-4e3c-88c8-62c0bbf0f933-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.214315 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.214006    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4061785-d49e-4e3c-88c8-62c0bbf0f933-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.214315 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.214046    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4061785-d49e-4e3c-88c8-62c0bbf0f933-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.214315 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.214073    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4061785-d49e-4e3c-88c8-62c0bbf0f933-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.214315 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.214098    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e4061785-d49e-4e3c-88c8-62c0bbf0f933-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.214725 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.214325    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e4061785-d49e-4e3c-88c8-62c0bbf0f933-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.214725 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.214541    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4061785-d49e-4e3c-88c8-62c0bbf0f933-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.215236 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.215207    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4061785-d49e-4e3c-88c8-62c0bbf0f933-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.215781 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.215757    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e4061785-d49e-4e3c-88c8-62c0bbf0f933-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.216545 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.216517    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e4061785-d49e-4e3c-88c8-62c0bbf0f933-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.216662 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.216626    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e4061785-d49e-4e3c-88c8-62c0bbf0f933-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.218007 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.216972    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e4061785-d49e-4e3c-88c8-62c0bbf0f933-config\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.218007 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.217044    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e4061785-d49e-4e3c-88c8-62c0bbf0f933-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.218007 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.217072    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e4061785-d49e-4e3c-88c8-62c0bbf0f933-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.218007 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.217645    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4061785-d49e-4e3c-88c8-62c0bbf0f933-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.218007 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.217902    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e4061785-d49e-4e3c-88c8-62c0bbf0f933-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.218412 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.218039    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4061785-d49e-4e3c-88c8-62c0bbf0f933-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.218412 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.218407    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e4061785-d49e-4e3c-88c8-62c0bbf0f933-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.218511 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.218408    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e4061785-d49e-4e3c-88c8-62c0bbf0f933-config-out\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.218511 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.218426    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e4061785-d49e-4e3c-88c8-62c0bbf0f933-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.219043 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.219025    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e4061785-d49e-4e3c-88c8-62c0bbf0f933-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.219271 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.219254    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e4061785-d49e-4e3c-88c8-62c0bbf0f933-web-config\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.220168 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.220145    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4061785-d49e-4e3c-88c8-62c0bbf0f933-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.220264 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.220227    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4061785-d49e-4e3c-88c8-62c0bbf0f933-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.226173 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.226155    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkptw\" (UniqueName: \"kubernetes.io/projected/e4061785-d49e-4e3c-88c8-62c0bbf0f933-kube-api-access-jkptw\") pod \"prometheus-k8s-0\" (UID: \"e4061785-d49e-4e3c-88c8-62c0bbf0f933\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.358602 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.358514    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:26.503245 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.503152    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 20:20:26.505171 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:20:26.505138    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4061785_d49e_4e3c_88c8_62c0bbf0f933.slice/crio-9f3b28f0bba5a30032c267850dd936fb2647b53fae885edce3129e2c30ce00ef WatchSource:0}: Error finding container 9f3b28f0bba5a30032c267850dd936fb2647b53fae885edce3129e2c30ce00ef: Status 404 returned error can't find the container with id 9f3b28f0bba5a30032c267850dd936fb2647b53fae885edce3129e2c30ce00ef
Jul 21 20:20:26.931472 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.931439    2576 generic.go:356] "Generic (PLEG): container finished" podID="e4061785-d49e-4e3c-88c8-62c0bbf0f933" containerID="47ab4a9b1db51e46e578cfc6a651dff1efa2c8d39707bca0bf9d35891d02ea63" exitCode=0
Jul 21 20:20:26.931978 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.931500    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4061785-d49e-4e3c-88c8-62c0bbf0f933","Type":"ContainerDied","Data":"47ab4a9b1db51e46e578cfc6a651dff1efa2c8d39707bca0bf9d35891d02ea63"}
Jul 21 20:20:26.931978 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:26.931577    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4061785-d49e-4e3c-88c8-62c0bbf0f933","Type":"ContainerStarted","Data":"9f3b28f0bba5a30032c267850dd936fb2647b53fae885edce3129e2c30ce00ef"}
Jul 21 20:20:27.651550 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:27.651510    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b510dd0-e811-4350-8e9c-4560587d0de1" path="/var/lib/kubelet/pods/2b510dd0-e811-4350-8e9c-4560587d0de1/volumes"
Jul 21 20:20:27.939291 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:27.939206    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4061785-d49e-4e3c-88c8-62c0bbf0f933","Type":"ContainerStarted","Data":"5c100255b99eefad300c66f956bae09a40305a67bded3492d61244cd68c6c3e8"}
Jul 21 20:20:27.939291 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:27.939273    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4061785-d49e-4e3c-88c8-62c0bbf0f933","Type":"ContainerStarted","Data":"6b52968357b5b10feaf9d52517e248806ba68d5b023cfaa08ff03cf1c7b0419c"}
Jul 21 20:20:27.939707 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:27.939298    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4061785-d49e-4e3c-88c8-62c0bbf0f933","Type":"ContainerStarted","Data":"30175e55cd8b4fd7f684db69d393b2d7ea966868593862caf448d7e36bebd249"}
Jul 21 20:20:27.939707 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:27.939324    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4061785-d49e-4e3c-88c8-62c0bbf0f933","Type":"ContainerStarted","Data":"90409cad5648a7758de35676f4ccda34c7bb95f8c9d22142034392787eb0b012"}
Jul 21 20:20:27.939707 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:27.939349    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4061785-d49e-4e3c-88c8-62c0bbf0f933","Type":"ContainerStarted","Data":"74420e21b2dc5b18776bd8ad66bf00b369324765ff4938435abb96f6d429da6b"}
Jul 21 20:20:27.939707 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:27.939374    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4061785-d49e-4e3c-88c8-62c0bbf0f933","Type":"ContainerStarted","Data":"42fd2a7e87eafebb9ae369db48308dc67b7490a9737b9d254fcc5f4f973c5876"}
Jul 21 20:20:27.977815 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:27.977746    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.959178408 podStartE2EDuration="2.977722368s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.54396ms" isStatefulPod=false podCreationTimestamp="2026-07-21 20:20:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:20:27.976192033 +0000 UTC m=+378.908590193" watchObservedRunningTime="2026-07-21 20:20:27.977722368 +0000 UTC m=+378.910120525"
Jul 21 20:20:28.634485 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:28.634448    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:20:28.710239 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:28.710210    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:20:29.821889 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:29.821859    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:20:29.921971 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:29.921941    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:20:31.359044 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:31.359003    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:20:31.396155 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:31.396121    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:20:31.455767 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:31.455733    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:20:36.393267 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:36.393225    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:20:36.494217 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:36.494187    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:20:42.364310 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:42.364279    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:20:42.468211 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:42.468170    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:20:42.528446 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:20:42.528414    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:21:06.354787 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:21:06.354752    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:21:06.418989 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:21:06.418955    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:21:14.955782 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:21:14.955746    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:21:15.124933 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:21:15.124906    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:21:26.359080 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:21:26.359042    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:21:26.374910 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:21:26.374883    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:21:27.182384 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:21:27.182356    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:21:42.201958 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:21:42.201878    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:21:43.014607 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:21:43.014575    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:21:46.228359 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:21:46.228328    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:21:46.332942 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:21:46.332908    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:21:47.374946 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:21:47.374913    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:21:47.583647 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:21:47.583611    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:21:48.036823 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:21:48.036794    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:21:48.141175 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:21:48.141146    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:21:49.738008 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:21:49.737971    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:21:49.974373 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:21:49.974345    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:21:52.817891 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:21:52.817859    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:21:52.912861 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:21:52.912828    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:21:56.933041 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:21:56.933009    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:12.851210 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:12.851176    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:12.929867 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:12.929836    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:15.064077 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:15.064048    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:15.159361 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:15.159326    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:20.401529 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:20.401493    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:20.505177 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:20.505142    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:22.772673 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:22.772645    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:35.148362 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:35.148331    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:35.256276 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:35.256245    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:37.367658 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:37.367623    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:37.466706 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:37.466655    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:37.992262 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:37.992226    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:38.251988 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.251906    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:38.353557 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.353525    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:38.368743 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.368711    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk"]
Jul 21 20:22:38.370859 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.370843    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk"
Jul 21 20:22:38.373418 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.373389    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 21 20:22:38.373418 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.373400    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-btdnv\""
Jul 21 20:22:38.373597 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.373460    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 21 20:22:38.373597 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.373401    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 21 20:22:38.373597 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.373399    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 21 20:22:38.395227 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.395190    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk"]
Jul 21 20:22:38.419584 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.419541    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a1453d50-9dc6-4df3-a2bd-1f0c0a281742-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk\" (UID: \"a1453d50-9dc6-4df3-a2bd-1f0c0a281742\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk"
Jul 21 20:22:38.419584 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.419592    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a1453d50-9dc6-4df3-a2bd-1f0c0a281742-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk\" (UID: \"a1453d50-9dc6-4df3-a2bd-1f0c0a281742\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk"
Jul 21 20:22:38.419850 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.419618    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1453d50-9dc6-4df3-a2bd-1f0c0a281742-tmp\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk\" (UID: \"a1453d50-9dc6-4df3-a2bd-1f0c0a281742\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk"
Jul 21 20:22:38.419850 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.419719    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a1453d50-9dc6-4df3-a2bd-1f0c0a281742-manifests\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk\" (UID: \"a1453d50-9dc6-4df3-a2bd-1f0c0a281742\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk"
Jul 21 20:22:38.419850 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.419751    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v64d8\" (UniqueName: \"kubernetes.io/projected/a1453d50-9dc6-4df3-a2bd-1f0c0a281742-kube-api-access-v64d8\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk\" (UID: \"a1453d50-9dc6-4df3-a2bd-1f0c0a281742\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk"
Jul 21 20:22:38.520139 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.520099    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v64d8\" (UniqueName: \"kubernetes.io/projected/a1453d50-9dc6-4df3-a2bd-1f0c0a281742-kube-api-access-v64d8\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk\" (UID: \"a1453d50-9dc6-4df3-a2bd-1f0c0a281742\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk"
Jul 21 20:22:38.520329 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.520179    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a1453d50-9dc6-4df3-a2bd-1f0c0a281742-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk\" (UID: \"a1453d50-9dc6-4df3-a2bd-1f0c0a281742\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk"
Jul 21 20:22:38.520329 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.520214    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a1453d50-9dc6-4df3-a2bd-1f0c0a281742-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk\" (UID: \"a1453d50-9dc6-4df3-a2bd-1f0c0a281742\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk"
Jul 21 20:22:38.520329 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.520240    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1453d50-9dc6-4df3-a2bd-1f0c0a281742-tmp\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk\" (UID: \"a1453d50-9dc6-4df3-a2bd-1f0c0a281742\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk"
Jul 21 20:22:38.520329 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.520305    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a1453d50-9dc6-4df3-a2bd-1f0c0a281742-manifests\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk\" (UID: \"a1453d50-9dc6-4df3-a2bd-1f0c0a281742\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk"
Jul 21 20:22:38.520778 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.520755    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a1453d50-9dc6-4df3-a2bd-1f0c0a281742-manifests\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk\" (UID: \"a1453d50-9dc6-4df3-a2bd-1f0c0a281742\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk"
Jul 21 20:22:38.522675 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.522644    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1453d50-9dc6-4df3-a2bd-1f0c0a281742-tmp\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk\" (UID: \"a1453d50-9dc6-4df3-a2bd-1f0c0a281742\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk"
Jul 21 20:22:38.522846 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.522829    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a1453d50-9dc6-4df3-a2bd-1f0c0a281742-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk\" (UID: \"a1453d50-9dc6-4df3-a2bd-1f0c0a281742\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk"
Jul 21 20:22:38.522895 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.522854    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a1453d50-9dc6-4df3-a2bd-1f0c0a281742-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk\" (UID: \"a1453d50-9dc6-4df3-a2bd-1f0c0a281742\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk"
Jul 21 20:22:38.531766 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.531736    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v64d8\" (UniqueName: \"kubernetes.io/projected/a1453d50-9dc6-4df3-a2bd-1f0c0a281742-kube-api-access-v64d8\") pod \"opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk\" (UID: \"a1453d50-9dc6-4df3-a2bd-1f0c0a281742\") " pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk"
Jul 21 20:22:38.537519 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.537496    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:38.681404 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.681367    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk"
Jul 21 20:22:38.707573 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.707544    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:38.884074 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.884049    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk"]
Jul 21 20:22:38.886406 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:22:38.886383    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1453d50_9dc6_4df3_a2bd_1f0c0a281742.slice/crio-e2f6a4dad7792b333f55db143126006ecc74405cb09d4b3e09fae73f622349c4 WatchSource:0}: Error finding container e2f6a4dad7792b333f55db143126006ecc74405cb09d4b3e09fae73f622349c4: Status 404 returned error can't find the container with id e2f6a4dad7792b333f55db143126006ecc74405cb09d4b3e09fae73f622349c4
Jul 21 20:22:38.971723 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:38.971658    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:39.113562 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:39.113527    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:39.211044 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:39.210953    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:39.313814 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:39.313764    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:39.416662 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:39.416632    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:39.448214 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:39.448181    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk" event={"ID":"a1453d50-9dc6-4df3-a2bd-1f0c0a281742","Type":"ContainerStarted","Data":"e2f6a4dad7792b333f55db143126006ecc74405cb09d4b3e09fae73f622349c4"}
Jul 21 20:22:42.465465 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:42.465425    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk" event={"ID":"a1453d50-9dc6-4df3-a2bd-1f0c0a281742","Type":"ContainerStarted","Data":"19b1b2edac6e08d3b118243265f1c9b42359369c2edbfb23818c88f211f2c7ff"}
Jul 21 20:22:43.470899 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:43.470858    2576 generic.go:356] "Generic (PLEG): container finished" podID="a1453d50-9dc6-4df3-a2bd-1f0c0a281742" containerID="19b1b2edac6e08d3b118243265f1c9b42359369c2edbfb23818c88f211f2c7ff" exitCode=0
Jul 21 20:22:43.471273 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:43.470910    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk" event={"ID":"a1453d50-9dc6-4df3-a2bd-1f0c0a281742","Type":"ContainerDied","Data":"19b1b2edac6e08d3b118243265f1c9b42359369c2edbfb23818c88f211f2c7ff"}
Jul 21 20:22:44.476682 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:44.476643    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk" event={"ID":"a1453d50-9dc6-4df3-a2bd-1f0c0a281742","Type":"ContainerStarted","Data":"50279b0a80420ece426c150833fe93e5675fbdfc618b08361e8ff1f8b8452ae0"}
Jul 21 20:22:44.477080 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:44.476744    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk"
Jul 21 20:22:44.499843 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:44.499788    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk" podStartSLOduration=2.000776183 podStartE2EDuration="6.499771202s" totalImagesPullingTime="3.485380224s" totalInitContainerRuntime="1.013614795s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:22:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:22:44.497597752 +0000 UTC m=+515.429995909" watchObservedRunningTime="2026-07-21 20:22:44.499771202 +0000 UTC m=+515.432169359"
Jul 21 20:22:50.353672 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:50.353638    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:55.482383 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:55.482347    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk"
Jul 21 20:22:57.560972 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:57.560941    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:57.706599 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:57.706564    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:58.162511 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.162482    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:58.263759 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.263723    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-567c747899-qh6vd"]
Jul 21 20:22:58.273662 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.273634    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-567c747899-qh6vd"
Jul 21 20:22:58.276841 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.276819    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-lfz6j\""
Jul 21 20:22:58.277001 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.276825    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 21 20:22:58.277001 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.276887    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 21 20:22:58.289027 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.289000    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-567c747899-qh6vd"]
Jul 21 20:22:58.321995 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.321961    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:58.395560 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.395522    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5b5b76c-cf49-4413-9bc3-633c4f1d1087-tmp\") pod \"kube-auth-proxy-567c747899-qh6vd\" (UID: \"b5b5b76c-cf49-4413-9bc3-633c4f1d1087\") " pod="openshift-ingress/kube-auth-proxy-567c747899-qh6vd"
Jul 21 20:22:58.395772 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.395596    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flcnz\" (UniqueName: \"kubernetes.io/projected/b5b5b76c-cf49-4413-9bc3-633c4f1d1087-kube-api-access-flcnz\") pod \"kube-auth-proxy-567c747899-qh6vd\" (UID: \"b5b5b76c-cf49-4413-9bc3-633c4f1d1087\") " pod="openshift-ingress/kube-auth-proxy-567c747899-qh6vd"
Jul 21 20:22:58.395772 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.395657    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5b5b76c-cf49-4413-9bc3-633c4f1d1087-tls-certs\") pod \"kube-auth-proxy-567c747899-qh6vd\" (UID: \"b5b5b76c-cf49-4413-9bc3-633c4f1d1087\") " pod="openshift-ingress/kube-auth-proxy-567c747899-qh6vd"
Jul 21 20:22:58.484997 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.484918    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-j7dwm"]
Jul 21 20:22:58.487111 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.487095    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-j7dwm"
Jul 21 20:22:58.492534 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.492506    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 21 20:22:58.492534 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.492510    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-l8xkw\""
Jul 21 20:22:58.496409 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.496386    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5b5b76c-cf49-4413-9bc3-633c4f1d1087-tls-certs\") pod \"kube-auth-proxy-567c747899-qh6vd\" (UID: \"b5b5b76c-cf49-4413-9bc3-633c4f1d1087\") " pod="openshift-ingress/kube-auth-proxy-567c747899-qh6vd"
Jul 21 20:22:58.496571 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.496425    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5b5b76c-cf49-4413-9bc3-633c4f1d1087-tmp\") pod \"kube-auth-proxy-567c747899-qh6vd\" (UID: \"b5b5b76c-cf49-4413-9bc3-633c4f1d1087\") " pod="openshift-ingress/kube-auth-proxy-567c747899-qh6vd"
Jul 21 20:22:58.496571 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.496471    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flcnz\" (UniqueName: \"kubernetes.io/projected/b5b5b76c-cf49-4413-9bc3-633c4f1d1087-kube-api-access-flcnz\") pod \"kube-auth-proxy-567c747899-qh6vd\" (UID: \"b5b5b76c-cf49-4413-9bc3-633c4f1d1087\") " pod="openshift-ingress/kube-auth-proxy-567c747899-qh6vd"
Jul 21 20:22:58.498704 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.498663    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5b5b76c-cf49-4413-9bc3-633c4f1d1087-tmp\") pod \"kube-auth-proxy-567c747899-qh6vd\" (UID: \"b5b5b76c-cf49-4413-9bc3-633c4f1d1087\") " pod="openshift-ingress/kube-auth-proxy-567c747899-qh6vd"
Jul 21 20:22:58.498991 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.498971    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5b5b76c-cf49-4413-9bc3-633c4f1d1087-tls-certs\") pod \"kube-auth-proxy-567c747899-qh6vd\" (UID: \"b5b5b76c-cf49-4413-9bc3-633c4f1d1087\") " pod="openshift-ingress/kube-auth-proxy-567c747899-qh6vd"
Jul 21 20:22:58.516493 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.516454    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-j7dwm"]
Jul 21 20:22:58.531198 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.531163    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flcnz\" (UniqueName: \"kubernetes.io/projected/b5b5b76c-cf49-4413-9bc3-633c4f1d1087-kube-api-access-flcnz\") pod \"kube-auth-proxy-567c747899-qh6vd\" (UID: \"b5b5b76c-cf49-4413-9bc3-633c4f1d1087\") " pod="openshift-ingress/kube-auth-proxy-567c747899-qh6vd"
Jul 21 20:22:58.554922 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.554888    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:58.582678 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.582636    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-567c747899-qh6vd"
Jul 21 20:22:58.597847 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.597817    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7b7x\" (UniqueName: \"kubernetes.io/projected/47854321-c87f-4d4e-95f7-7f12b2b0f7ca-kube-api-access-l7b7x\") pod \"odh-model-controller-7998c67dc4-j7dwm\" (UID: \"47854321-c87f-4d4e-95f7-7f12b2b0f7ca\") " pod="opendatahub/odh-model-controller-7998c67dc4-j7dwm"
Jul 21 20:22:58.597990 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.597893    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47854321-c87f-4d4e-95f7-7f12b2b0f7ca-cert\") pod \"odh-model-controller-7998c67dc4-j7dwm\" (UID: \"47854321-c87f-4d4e-95f7-7f12b2b0f7ca\") " pod="opendatahub/odh-model-controller-7998c67dc4-j7dwm"
Jul 21 20:22:58.660792 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.660764    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:58.699367 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.699338    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7b7x\" (UniqueName: \"kubernetes.io/projected/47854321-c87f-4d4e-95f7-7f12b2b0f7ca-kube-api-access-l7b7x\") pod \"odh-model-controller-7998c67dc4-j7dwm\" (UID: \"47854321-c87f-4d4e-95f7-7f12b2b0f7ca\") " pod="opendatahub/odh-model-controller-7998c67dc4-j7dwm"
Jul 21 20:22:58.699517 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.699472    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47854321-c87f-4d4e-95f7-7f12b2b0f7ca-cert\") pod \"odh-model-controller-7998c67dc4-j7dwm\" (UID: \"47854321-c87f-4d4e-95f7-7f12b2b0f7ca\") " pod="opendatahub/odh-model-controller-7998c67dc4-j7dwm"
Jul 21 20:22:58.699587 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:22:58.699576    2576 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 21 20:22:58.699647 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:22:58.699637    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47854321-c87f-4d4e-95f7-7f12b2b0f7ca-cert podName:47854321-c87f-4d4e-95f7-7f12b2b0f7ca nodeName:}" failed. No retries permitted until 2026-07-21 20:22:59.199620253 +0000 UTC m=+530.132018387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/47854321-c87f-4d4e-95f7-7f12b2b0f7ca-cert") pod "odh-model-controller-7998c67dc4-j7dwm" (UID: "47854321-c87f-4d4e-95f7-7f12b2b0f7ca") : secret "odh-model-controller-webhook-cert" not found
Jul 21 20:22:58.720629 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.720605    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7b7x\" (UniqueName: \"kubernetes.io/projected/47854321-c87f-4d4e-95f7-7f12b2b0f7ca-kube-api-access-l7b7x\") pod \"odh-model-controller-7998c67dc4-j7dwm\" (UID: \"47854321-c87f-4d4e-95f7-7f12b2b0f7ca\") " pod="opendatahub/odh-model-controller-7998c67dc4-j7dwm"
Jul 21 20:22:58.737653 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.737582    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-567c747899-qh6vd"]
Jul 21 20:22:58.740898 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:22:58.740870    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5b5b76c_cf49_4413_9bc3_633c4f1d1087.slice/crio-ca6f50d807f7e6e0393ce54ad9235ea238d8ae9c5863fe607bc57bf917def39f WatchSource:0}: Error finding container ca6f50d807f7e6e0393ce54ad9235ea238d8ae9c5863fe607bc57bf917def39f: Status 404 returned error can't find the container with id ca6f50d807f7e6e0393ce54ad9235ea238d8ae9c5863fe607bc57bf917def39f
Jul 21 20:22:58.904608 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:58.904572    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:59.202797 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:59.202760    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47854321-c87f-4d4e-95f7-7f12b2b0f7ca-cert\") pod \"odh-model-controller-7998c67dc4-j7dwm\" (UID: \"47854321-c87f-4d4e-95f7-7f12b2b0f7ca\") " pod="opendatahub/odh-model-controller-7998c67dc4-j7dwm"
Jul 21 20:22:59.205346 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:59.205318    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47854321-c87f-4d4e-95f7-7f12b2b0f7ca-cert\") pod \"odh-model-controller-7998c67dc4-j7dwm\" (UID: \"47854321-c87f-4d4e-95f7-7f12b2b0f7ca\") " pod="opendatahub/odh-model-controller-7998c67dc4-j7dwm"
Jul 21 20:22:59.379182 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:59.379139    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:22:59.397460 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:59.397421    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-j7dwm"
Jul 21 20:22:59.533128 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:59.533099    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-567c747899-qh6vd" event={"ID":"b5b5b76c-cf49-4413-9bc3-633c4f1d1087","Type":"ContainerStarted","Data":"ca6f50d807f7e6e0393ce54ad9235ea238d8ae9c5863fe607bc57bf917def39f"}
Jul 21 20:22:59.598769 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:22:59.598730    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-j7dwm"]
Jul 21 20:22:59.602449 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:22:59.602419    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47854321_c87f_4d4e_95f7_7f12b2b0f7ca.slice/crio-6d270a7c74ee85d0f6aa1b5c20eb2bd01595502bddeb7ed0a091f829cdddeb56 WatchSource:0}: Error finding container 6d270a7c74ee85d0f6aa1b5c20eb2bd01595502bddeb7ed0a091f829cdddeb56: Status 404 returned error can't find the container with id 6d270a7c74ee85d0f6aa1b5c20eb2bd01595502bddeb7ed0a091f829cdddeb56
Jul 21 20:23:00.005400 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:00.005367    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ft8wg"]
Jul 21 20:23:00.008650 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:00.008623    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ft8wg"
Jul 21 20:23:00.012229 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:00.012210    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 21 20:23:00.045358 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:00.045319    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ft8wg"]
Jul 21 20:23:00.110227 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:00.110189    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5gq9\" (UniqueName: \"kubernetes.io/projected/86789bc1-c91f-443b-a6d5-a7176a68bb73-kube-api-access-z5gq9\") pod \"model-serving-api-54d89bd5fc-ft8wg\" (UID: \"86789bc1-c91f-443b-a6d5-a7176a68bb73\") " pod="opendatahub/model-serving-api-54d89bd5fc-ft8wg"
Jul 21 20:23:00.110227 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:00.110228    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86789bc1-c91f-443b-a6d5-a7176a68bb73-tls-certs\") pod \"model-serving-api-54d89bd5fc-ft8wg\" (UID: \"86789bc1-c91f-443b-a6d5-a7176a68bb73\") " pod="opendatahub/model-serving-api-54d89bd5fc-ft8wg"
Jul 21 20:23:00.125049 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:00.125021    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:00.211564 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:00.211523    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5gq9\" (UniqueName: \"kubernetes.io/projected/86789bc1-c91f-443b-a6d5-a7176a68bb73-kube-api-access-z5gq9\") pod \"model-serving-api-54d89bd5fc-ft8wg\" (UID: \"86789bc1-c91f-443b-a6d5-a7176a68bb73\") " pod="opendatahub/model-serving-api-54d89bd5fc-ft8wg"
Jul 21 20:23:00.211564 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:00.211570    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86789bc1-c91f-443b-a6d5-a7176a68bb73-tls-certs\") pod \"model-serving-api-54d89bd5fc-ft8wg\" (UID: \"86789bc1-c91f-443b-a6d5-a7176a68bb73\") " pod="opendatahub/model-serving-api-54d89bd5fc-ft8wg"
Jul 21 20:23:00.211849 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:23:00.211746    2576 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 21 20:23:00.211849 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:23:00.211821    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86789bc1-c91f-443b-a6d5-a7176a68bb73-tls-certs podName:86789bc1-c91f-443b-a6d5-a7176a68bb73 nodeName:}" failed. No retries permitted until 2026-07-21 20:23:00.711798217 +0000 UTC m=+531.644196353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/86789bc1-c91f-443b-a6d5-a7176a68bb73-tls-certs") pod "model-serving-api-54d89bd5fc-ft8wg" (UID: "86789bc1-c91f-443b-a6d5-a7176a68bb73") : secret "model-serving-api-tls" not found
Jul 21 20:23:00.224580 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:00.224551    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5gq9\" (UniqueName: \"kubernetes.io/projected/86789bc1-c91f-443b-a6d5-a7176a68bb73-kube-api-access-z5gq9\") pod \"model-serving-api-54d89bd5fc-ft8wg\" (UID: \"86789bc1-c91f-443b-a6d5-a7176a68bb73\") " pod="opendatahub/model-serving-api-54d89bd5fc-ft8wg"
Jul 21 20:23:00.540790 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:00.540749    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-j7dwm" event={"ID":"47854321-c87f-4d4e-95f7-7f12b2b0f7ca","Type":"ContainerStarted","Data":"6d270a7c74ee85d0f6aa1b5c20eb2bd01595502bddeb7ed0a091f829cdddeb56"}
Jul 21 20:23:00.628848 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:00.628809    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:00.717992 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:00.717677    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86789bc1-c91f-443b-a6d5-a7176a68bb73-tls-certs\") pod \"model-serving-api-54d89bd5fc-ft8wg\" (UID: \"86789bc1-c91f-443b-a6d5-a7176a68bb73\") " pod="opendatahub/model-serving-api-54d89bd5fc-ft8wg"
Jul 21 20:23:00.720891 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:00.720858    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86789bc1-c91f-443b-a6d5-a7176a68bb73-tls-certs\") pod \"model-serving-api-54d89bd5fc-ft8wg\" (UID: \"86789bc1-c91f-443b-a6d5-a7176a68bb73\") " pod="opendatahub/model-serving-api-54d89bd5fc-ft8wg"
Jul 21 20:23:00.917923 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:00.917842    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ft8wg"
Jul 21 20:23:00.922110 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:00.922084    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:00.951704 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:00.950529    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"]
Jul 21 20:23:00.954068 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:00.954045    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"
Jul 21 20:23:00.958102 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:00.958041    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 21 20:23:00.958372 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:00.958329    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-rfwfv\""
Jul 21 20:23:00.958467 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:00.958441    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 20:23:00.960989 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:00.960968    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 21 20:23:00.961114 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:00.961097    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 21 20:23:00.981505 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:00.981423    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"]
Jul 21 20:23:01.085161 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:01.085111    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:01.103238 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:01.103119    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ft8wg"]
Jul 21 20:23:01.121898 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:01.121851    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-vxz85\" (UID: \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"
Jul 21 20:23:01.122044 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:01.121905    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-local-certs\") pod \"istiod-openshift-gateway-7574459656-vxz85\" (UID: \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"
Jul 21 20:23:01.122044 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:01.122026    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-istio-token\") pod \"istiod-openshift-gateway-7574459656-vxz85\" (UID: \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"
Jul 21 20:23:01.122160 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:01.122050    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-278lm\" (UniqueName: \"kubernetes.io/projected/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-kube-api-access-278lm\") pod \"istiod-openshift-gateway-7574459656-vxz85\" (UID: \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"
Jul 21 20:23:01.122160 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:01.122084    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-vxz85\" (UID: \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"
Jul 21 20:23:01.122160 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:01.122117    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-vxz85\" (UID: \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"
Jul 21 20:23:01.122309 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:01.122291    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-cacerts\") pod \"istiod-openshift-gateway-7574459656-vxz85\" (UID: \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"
Jul 21 20:23:01.223544 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:01.223443    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-istio-token\") pod \"istiod-openshift-gateway-7574459656-vxz85\" (UID: \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"
Jul 21 20:23:01.223544 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:01.223500    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-278lm\" (UniqueName: \"kubernetes.io/projected/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-kube-api-access-278lm\") pod \"istiod-openshift-gateway-7574459656-vxz85\" (UID: \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"
Jul 21 20:23:01.223544 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:01.223533    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-vxz85\" (UID: \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"
Jul 21 20:23:01.223912 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:01.223566    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-vxz85\" (UID: \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"
Jul 21 20:23:01.223912 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:01.223652    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-cacerts\") pod \"istiod-openshift-gateway-7574459656-vxz85\" (UID: \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"
Jul 21 20:23:01.223912 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:01.223724    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-vxz85\" (UID: \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"
Jul 21 20:23:01.223912 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:01.223761    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-local-certs\") pod \"istiod-openshift-gateway-7574459656-vxz85\" (UID: \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"
Jul 21 20:23:01.224533 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:01.224433    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-vxz85\" (UID: \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"
Jul 21 20:23:01.226970 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:01.226924    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-local-certs\") pod \"istiod-openshift-gateway-7574459656-vxz85\" (UID: \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"
Jul 21 20:23:01.227075 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:01.227002    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-vxz85\" (UID: \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"
Jul 21 20:23:01.227135 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:01.227105    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-vxz85\" (UID: \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"
Jul 21 20:23:01.227346 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:01.227326    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-cacerts\") pod \"istiod-openshift-gateway-7574459656-vxz85\" (UID: \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"
Jul 21 20:23:01.234701 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:01.234660    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-278lm\" (UniqueName: \"kubernetes.io/projected/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-kube-api-access-278lm\") pod \"istiod-openshift-gateway-7574459656-vxz85\" (UID: \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"
Jul 21 20:23:01.235790 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:01.235767    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-istio-token\") pod \"istiod-openshift-gateway-7574459656-vxz85\" (UID: \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"
Jul 21 20:23:01.267857 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:01.267821    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"
Jul 21 20:23:01.703630 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:23:01.703588    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86789bc1_c91f_443b_a6d5_a7176a68bb73.slice/crio-e9626a6e3f3f4696a45b0c6a7250f70154a172850bdf26b3f9ac18ea0fe05442 WatchSource:0}: Error finding container e9626a6e3f3f4696a45b0c6a7250f70154a172850bdf26b3f9ac18ea0fe05442: Status 404 returned error can't find the container with id e9626a6e3f3f4696a45b0c6a7250f70154a172850bdf26b3f9ac18ea0fe05442
Jul 21 20:23:02.394444 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:02.394415    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:02.552242 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:02.552197    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ft8wg" event={"ID":"86789bc1-c91f-443b-a6d5-a7176a68bb73","Type":"ContainerStarted","Data":"e9626a6e3f3f4696a45b0c6a7250f70154a172850bdf26b3f9ac18ea0fe05442"}
Jul 21 20:23:03.076042 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:03.076014    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"]
Jul 21 20:23:03.078502 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:23:03.078469    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ec181f8_87cf_4e1a_ab28_98e2ac3b16cd.slice/crio-9ef36127d87e7272314c1e6462bc86e01c150e6af642e9fbd906741f70d5d9b8 WatchSource:0}: Error finding container 9ef36127d87e7272314c1e6462bc86e01c150e6af642e9fbd906741f70d5d9b8: Status 404 returned error can't find the container with id 9ef36127d87e7272314c1e6462bc86e01c150e6af642e9fbd906741f70d5d9b8
Jul 21 20:23:03.557440 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:03.557402    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85" event={"ID":"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd","Type":"ContainerStarted","Data":"9ef36127d87e7272314c1e6462bc86e01c150e6af642e9fbd906741f70d5d9b8"}
Jul 21 20:23:03.558823 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:03.558799    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-567c747899-qh6vd" event={"ID":"b5b5b76c-cf49-4413-9bc3-633c4f1d1087","Type":"ContainerStarted","Data":"2f3793f49b7151feb3e7c0767847115109d5969fab90ce3a6c11e010b8f4d28f"}
Jul 21 20:23:03.560223 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:03.560191    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-j7dwm" event={"ID":"47854321-c87f-4d4e-95f7-7f12b2b0f7ca","Type":"ContainerStarted","Data":"08d2e3194872af5cce00ac07b5d018d39816d15231d148ede594bfdd45a56d2f"}
Jul 21 20:23:03.560308 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:03.560256    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-j7dwm"
Jul 21 20:23:03.586218 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:03.586166    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-567c747899-qh6vd" podStartSLOduration=1.405104676 podStartE2EDuration="5.586150329s" totalImagesPullingTime="4.181045653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:22:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:23:03.584811488 +0000 UTC m=+534.517209648" watchObservedRunningTime="2026-07-21 20:23:03.586150329 +0000 UTC m=+534.518548486"
Jul 21 20:23:03.607122 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:03.607067    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-j7dwm" podStartSLOduration=2.241462758 podStartE2EDuration="5.607048929s" totalImagesPullingTime="3.365586171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:22:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:23:03.605479117 +0000 UTC m=+534.537877275" watchObservedRunningTime="2026-07-21 20:23:03.607048929 +0000 UTC m=+534.539447085"
Jul 21 20:23:05.599488 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:05.599435    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:23:05.599890 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:05.599539    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:23:06.505917 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:06.505882    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:06.575917 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:06.575857    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ft8wg" event={"ID":"86789bc1-c91f-443b-a6d5-a7176a68bb73","Type":"ContainerStarted","Data":"c1a5629873eedf5396d84bb28ec9be0ae08ec215f9d98c5f2e378e8070afaaae"}
Jul 21 20:23:06.576083 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:06.575975    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-ft8wg"
Jul 21 20:23:06.577569 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:06.577541    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85" event={"ID":"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd","Type":"ContainerStarted","Data":"1d35adf4105b4acd8bc7555a6556ccdf424f7f3b94020ba2b13545b868e1c90d"}
Jul 21 20:23:06.577739 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:06.577719    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"
Jul 21 20:23:06.579487 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:06.579459    2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-vxz85 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 20:23:06.579622 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:06.579517    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85" podUID="7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 20:23:06.654218 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:06.654162    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-ft8wg" podStartSLOduration=4.6755693879999995 podStartE2EDuration="7.654142531s" totalImagesPullingTime="2.978573143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:22:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:23:06.61527369 +0000 UTC m=+537.547671847" watchObservedRunningTime="2026-07-21 20:23:06.654142531 +0000 UTC m=+537.586540687"
Jul 21 20:23:06.654727 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:06.654308    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85" podStartSLOduration=4.135705119 podStartE2EDuration="6.654302829s" totalImagesPullingTime="2.51859771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:23:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:23:06.652100915 +0000 UTC m=+537.584499073" watchObservedRunningTime="2026-07-21 20:23:06.654302829 +0000 UTC m=+537.586700985"
Jul 21 20:23:06.654727 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:06.654628    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:07.583161 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.583131    2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-vxz85 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 20:23:07.583315 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.583181    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85" podUID="7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 20:23:07.634856 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.634822    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"]
Jul 21 20:23:07.638418 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.638398    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:07.641529 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.641511    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-dvv9w\""
Jul 21 20:23:07.666707 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.666652    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"]
Jul 21 20:23:07.728584 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.728552    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:07.786117 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.786078    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fedda947-c0a8-4c66-8fd7-c593c16b66a6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sgr65\" (UID: \"fedda947-c0a8-4c66-8fd7-c593c16b66a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:07.786290 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.786131    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fedda947-c0a8-4c66-8fd7-c593c16b66a6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sgr65\" (UID: \"fedda947-c0a8-4c66-8fd7-c593c16b66a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:07.786290 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.786157    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fedda947-c0a8-4c66-8fd7-c593c16b66a6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sgr65\" (UID: \"fedda947-c0a8-4c66-8fd7-c593c16b66a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:07.786290 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.786200    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlpqs\" (UniqueName: \"kubernetes.io/projected/fedda947-c0a8-4c66-8fd7-c593c16b66a6-kube-api-access-nlpqs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sgr65\" (UID: \"fedda947-c0a8-4c66-8fd7-c593c16b66a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:07.786290 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.786257    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fedda947-c0a8-4c66-8fd7-c593c16b66a6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sgr65\" (UID: \"fedda947-c0a8-4c66-8fd7-c593c16b66a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:07.786418 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.786316    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fedda947-c0a8-4c66-8fd7-c593c16b66a6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sgr65\" (UID: \"fedda947-c0a8-4c66-8fd7-c593c16b66a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:07.786418 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.786352    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fedda947-c0a8-4c66-8fd7-c593c16b66a6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sgr65\" (UID: \"fedda947-c0a8-4c66-8fd7-c593c16b66a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:07.786418 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.786388    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fedda947-c0a8-4c66-8fd7-c593c16b66a6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sgr65\" (UID: \"fedda947-c0a8-4c66-8fd7-c593c16b66a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:07.786506 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.786450    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fedda947-c0a8-4c66-8fd7-c593c16b66a6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sgr65\" (UID: \"fedda947-c0a8-4c66-8fd7-c593c16b66a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:07.876259 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.876178    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:07.887157 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.887132    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlpqs\" (UniqueName: \"kubernetes.io/projected/fedda947-c0a8-4c66-8fd7-c593c16b66a6-kube-api-access-nlpqs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sgr65\" (UID: \"fedda947-c0a8-4c66-8fd7-c593c16b66a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:07.887262 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.887190    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fedda947-c0a8-4c66-8fd7-c593c16b66a6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sgr65\" (UID: \"fedda947-c0a8-4c66-8fd7-c593c16b66a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:07.887262 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.887230    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fedda947-c0a8-4c66-8fd7-c593c16b66a6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sgr65\" (UID: \"fedda947-c0a8-4c66-8fd7-c593c16b66a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:07.887335 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.887266    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fedda947-c0a8-4c66-8fd7-c593c16b66a6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sgr65\" (UID: \"fedda947-c0a8-4c66-8fd7-c593c16b66a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:07.887335 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.887296    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fedda947-c0a8-4c66-8fd7-c593c16b66a6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sgr65\" (UID: \"fedda947-c0a8-4c66-8fd7-c593c16b66a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:07.887452 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.887344    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fedda947-c0a8-4c66-8fd7-c593c16b66a6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sgr65\" (UID: \"fedda947-c0a8-4c66-8fd7-c593c16b66a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:07.887452 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.887379    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fedda947-c0a8-4c66-8fd7-c593c16b66a6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sgr65\" (UID: \"fedda947-c0a8-4c66-8fd7-c593c16b66a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:07.887452 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.887422    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fedda947-c0a8-4c66-8fd7-c593c16b66a6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sgr65\" (UID: \"fedda947-c0a8-4c66-8fd7-c593c16b66a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:07.887452 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.887444    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fedda947-c0a8-4c66-8fd7-c593c16b66a6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sgr65\" (UID: \"fedda947-c0a8-4c66-8fd7-c593c16b66a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:07.887705 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.887633    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fedda947-c0a8-4c66-8fd7-c593c16b66a6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sgr65\" (UID: \"fedda947-c0a8-4c66-8fd7-c593c16b66a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:07.887812 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.887788    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fedda947-c0a8-4c66-8fd7-c593c16b66a6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sgr65\" (UID: \"fedda947-c0a8-4c66-8fd7-c593c16b66a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:07.887897 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.887878    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fedda947-c0a8-4c66-8fd7-c593c16b66a6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sgr65\" (UID: \"fedda947-c0a8-4c66-8fd7-c593c16b66a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:07.888010 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.887994    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fedda947-c0a8-4c66-8fd7-c593c16b66a6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sgr65\" (UID: \"fedda947-c0a8-4c66-8fd7-c593c16b66a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:07.888071 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.888019    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fedda947-c0a8-4c66-8fd7-c593c16b66a6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sgr65\" (UID: \"fedda947-c0a8-4c66-8fd7-c593c16b66a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:07.889526 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.889503    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fedda947-c0a8-4c66-8fd7-c593c16b66a6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sgr65\" (UID: \"fedda947-c0a8-4c66-8fd7-c593c16b66a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:07.889853 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.889837    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fedda947-c0a8-4c66-8fd7-c593c16b66a6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sgr65\" (UID: \"fedda947-c0a8-4c66-8fd7-c593c16b66a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:07.903595 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.903563    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fedda947-c0a8-4c66-8fd7-c593c16b66a6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sgr65\" (UID: \"fedda947-c0a8-4c66-8fd7-c593c16b66a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:07.903939 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.903917    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlpqs\" (UniqueName: \"kubernetes.io/projected/fedda947-c0a8-4c66-8fd7-c593c16b66a6-kube-api-access-nlpqs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sgr65\" (UID: \"fedda947-c0a8-4c66-8fd7-c593c16b66a6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:07.948070 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:07.948030    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:08.011564 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:08.011493    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:08.097710 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:08.097664    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"]
Jul 21 20:23:08.099993 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:23:08.099966    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfedda947_c0a8_4c66_8fd7_c593c16b66a6.slice/crio-0930261868a76a14ab7beb19d49c3b27edd6d6f0c4775816b0dcff8cc3fcc3dd WatchSource:0}: Error finding container 0930261868a76a14ab7beb19d49c3b27edd6d6f0c4775816b0dcff8cc3fcc3dd: Status 404 returned error can't find the container with id 0930261868a76a14ab7beb19d49c3b27edd6d6f0c4775816b0dcff8cc3fcc3dd
Jul 21 20:23:08.587453 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:08.587415    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65" event={"ID":"fedda947-c0a8-4c66-8fd7-c593c16b66a6","Type":"ContainerStarted","Data":"0930261868a76a14ab7beb19d49c3b27edd6d6f0c4775816b0dcff8cc3fcc3dd"}
Jul 21 20:23:10.356034 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.355993    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:10.438178 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.438144    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-79vlc"]
Jul 21 20:23:10.445381 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.445349    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-79vlc"
Jul 21 20:23:10.448320 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.448291    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-m9r6q"]
Jul 21 20:23:10.449078 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.449053    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 21 20:23:10.449209 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.449140    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-qcd6x\""
Jul 21 20:23:10.451934 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.451910    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m9r6q"
Jul 21 20:23:10.456271 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.456204    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 21 20:23:10.456576 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.456553    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-p7gtn\""
Jul 21 20:23:10.467144 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.467114    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-79vlc"]
Jul 21 20:23:10.473550 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.473510    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-m9r6q"]
Jul 21 20:23:10.506568 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.506538    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:10.584165 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.584125    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"
Jul 21 20:23:10.614810 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.614732    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/804d9d71-4793-4dc1-8e6b-efeebab2810f-cert\") pod \"kserve-controller-manager-d6f4b65b8-79vlc\" (UID: \"804d9d71-4793-4dc1-8e6b-efeebab2810f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-79vlc"
Jul 21 20:23:10.614810 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.614767    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmhtl\" (UniqueName: \"kubernetes.io/projected/346b733b-6a38-4212-bde3-f656f1e81818-kube-api-access-zmhtl\") pod \"llmisvc-controller-manager-777c6bd7d5-m9r6q\" (UID: \"346b733b-6a38-4212-bde3-f656f1e81818\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m9r6q"
Jul 21 20:23:10.614810 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.614798    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhj4t\" (UniqueName: \"kubernetes.io/projected/804d9d71-4793-4dc1-8e6b-efeebab2810f-kube-api-access-fhj4t\") pod \"kserve-controller-manager-d6f4b65b8-79vlc\" (UID: \"804d9d71-4793-4dc1-8e6b-efeebab2810f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-79vlc"
Jul 21 20:23:10.615139 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.614963    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/346b733b-6a38-4212-bde3-f656f1e81818-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-m9r6q\" (UID: \"346b733b-6a38-4212-bde3-f656f1e81818\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m9r6q"
Jul 21 20:23:10.626085 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.626058    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:10.716381 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.716345    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/804d9d71-4793-4dc1-8e6b-efeebab2810f-cert\") pod \"kserve-controller-manager-d6f4b65b8-79vlc\" (UID: \"804d9d71-4793-4dc1-8e6b-efeebab2810f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-79vlc"
Jul 21 20:23:10.716381 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.716384    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmhtl\" (UniqueName: \"kubernetes.io/projected/346b733b-6a38-4212-bde3-f656f1e81818-kube-api-access-zmhtl\") pod \"llmisvc-controller-manager-777c6bd7d5-m9r6q\" (UID: \"346b733b-6a38-4212-bde3-f656f1e81818\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m9r6q"
Jul 21 20:23:10.716623 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.716451    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhj4t\" (UniqueName: \"kubernetes.io/projected/804d9d71-4793-4dc1-8e6b-efeebab2810f-kube-api-access-fhj4t\") pod \"kserve-controller-manager-d6f4b65b8-79vlc\" (UID: \"804d9d71-4793-4dc1-8e6b-efeebab2810f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-79vlc"
Jul 21 20:23:10.716623 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.716579    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/346b733b-6a38-4212-bde3-f656f1e81818-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-m9r6q\" (UID: \"346b733b-6a38-4212-bde3-f656f1e81818\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m9r6q"
Jul 21 20:23:10.719021 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.718987    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/804d9d71-4793-4dc1-8e6b-efeebab2810f-cert\") pod \"kserve-controller-manager-d6f4b65b8-79vlc\" (UID: \"804d9d71-4793-4dc1-8e6b-efeebab2810f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-79vlc"
Jul 21 20:23:10.719129 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.719096    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/346b733b-6a38-4212-bde3-f656f1e81818-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-m9r6q\" (UID: \"346b733b-6a38-4212-bde3-f656f1e81818\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m9r6q"
Jul 21 20:23:10.733067 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.733034    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmhtl\" (UniqueName: \"kubernetes.io/projected/346b733b-6a38-4212-bde3-f656f1e81818-kube-api-access-zmhtl\") pod \"llmisvc-controller-manager-777c6bd7d5-m9r6q\" (UID: \"346b733b-6a38-4212-bde3-f656f1e81818\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m9r6q"
Jul 21 20:23:10.734765 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.734741    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhj4t\" (UniqueName: \"kubernetes.io/projected/804d9d71-4793-4dc1-8e6b-efeebab2810f-kube-api-access-fhj4t\") pod \"kserve-controller-manager-d6f4b65b8-79vlc\" (UID: \"804d9d71-4793-4dc1-8e6b-efeebab2810f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-79vlc"
Jul 21 20:23:10.758493 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.758458    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-79vlc"
Jul 21 20:23:10.768323 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.768298    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m9r6q"
Jul 21 20:23:10.801063 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.801015    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:23:10.801197 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.801115    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:23:10.801197 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.801160    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:23:10.953762 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.953046    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-m9r6q"]
Jul 21 20:23:10.955344 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:23:10.955308    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod346b733b_6a38_4212_bde3_f656f1e81818.slice/crio-71e16964443f21dc0660c7ae1ddd681092e5fdb1cb8b924325090cc2187a5a37 WatchSource:0}: Error finding container 71e16964443f21dc0660c7ae1ddd681092e5fdb1cb8b924325090cc2187a5a37: Status 404 returned error can't find the container with id 71e16964443f21dc0660c7ae1ddd681092e5fdb1cb8b924325090cc2187a5a37
Jul 21 20:23:10.984998 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:10.984970    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-79vlc"]
Jul 21 20:23:10.987117 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:23:10.987080    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod804d9d71_4793_4dc1_8e6b_efeebab2810f.slice/crio-a704f246e084871e558059d1109a72ac4c9ba0c08214c561b7675e3ca9b979f3 WatchSource:0}: Error finding container a704f246e084871e558059d1109a72ac4c9ba0c08214c561b7675e3ca9b979f3: Status 404 returned error can't find the container with id a704f246e084871e558059d1109a72ac4c9ba0c08214c561b7675e3ca9b979f3
Jul 21 20:23:11.602138 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:11.602107    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-79vlc" event={"ID":"804d9d71-4793-4dc1-8e6b-efeebab2810f","Type":"ContainerStarted","Data":"a704f246e084871e558059d1109a72ac4c9ba0c08214c561b7675e3ca9b979f3"}
Jul 21 20:23:11.603517 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:11.603493    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65" event={"ID":"fedda947-c0a8-4c66-8fd7-c593c16b66a6","Type":"ContainerStarted","Data":"29c7b099ab7637fdf481e79d2cd618a34471094c233b0fa1730c75d8124ef531"}
Jul 21 20:23:11.604649 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:11.604628    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m9r6q" event={"ID":"346b733b-6a38-4212-bde3-f656f1e81818","Type":"ContainerStarted","Data":"71e16964443f21dc0660c7ae1ddd681092e5fdb1cb8b924325090cc2187a5a37"}
Jul 21 20:23:11.639436 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:11.639381    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65" podStartSLOduration=1.940741855 podStartE2EDuration="4.639358849s" totalImagesPullingTime="2.698616994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:23:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:23:11.638274723 +0000 UTC m=+542.570672880" watchObservedRunningTime="2026-07-21 20:23:11.639358849 +0000 UTC m=+542.571757007"
Jul 21 20:23:11.712236 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:11.712190    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:11.828813 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:11.828746    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:11.948967 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:11.948876    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:11.954935 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:11.954897    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:12.373113 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:12.373077    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"]
Jul 21 20:23:12.373295 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:12.373272    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85" podUID="7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd" containerName="discovery" containerID="cri-o://1d35adf4105b4acd8bc7555a6556ccdf424f7f3b94020ba2b13545b868e1c90d" gracePeriod=30
Jul 21 20:23:12.610920 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:12.610884    2576 generic.go:356] "Generic (PLEG): container finished" podID="7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd" containerID="1d35adf4105b4acd8bc7555a6556ccdf424f7f3b94020ba2b13545b868e1c90d" exitCode=0
Jul 21 20:23:12.611331 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:12.610958    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85" event={"ID":"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd","Type":"ContainerDied","Data":"1d35adf4105b4acd8bc7555a6556ccdf424f7f3b94020ba2b13545b868e1c90d"}
Jul 21 20:23:12.611331 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:12.611189    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:12.612227 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:12.612210    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sgr65"
Jul 21 20:23:12.660485 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:12.660434    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"
Jul 21 20:23:12.735226 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:12.735190    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-local-certs\") pod \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\" (UID: \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\") "
Jul 21 20:23:12.735409 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:12.735249    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-istio-csr-dns-cert\") pod \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\" (UID: \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\") "
Jul 21 20:23:12.735409 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:12.735277    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-istio-csr-ca-configmap\") pod \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\" (UID: \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\") "
Jul 21 20:23:12.735409 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:12.735310    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-istio-kubeconfig\") pod \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\" (UID: \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\") "
Jul 21 20:23:12.735409 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:12.735350    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-278lm\" (UniqueName: \"kubernetes.io/projected/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-kube-api-access-278lm\") pod \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\" (UID: \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\") "
Jul 21 20:23:12.735409 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:12.735373    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-istio-token\") pod \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\" (UID: \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\") "
Jul 21 20:23:12.735679 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:12.735422    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-cacerts\") pod \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\" (UID: \"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd\") "
Jul 21 20:23:12.735928 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:12.735902    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd" (UID: "7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:23:12.738061 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:12.738024    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd" (UID: "7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:23:12.738061 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:12.738039    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-kube-api-access-278lm" (OuterVolumeSpecName: "kube-api-access-278lm") pod "7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd" (UID: "7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd"). InnerVolumeSpecName "kube-api-access-278lm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:23:12.738317 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:12.738273    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-istio-token" (OuterVolumeSpecName: "istio-token") pod "7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd" (UID: "7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:23:12.738421 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:12.738327    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-local-certs" (OuterVolumeSpecName: "local-certs") pod "7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd" (UID: "7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:23:12.738481 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:12.738446    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-cacerts" (OuterVolumeSpecName: "cacerts") pod "7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd" (UID: "7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:23:12.738639 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:12.738608    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd" (UID: "7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:23:12.836346 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:12.836303    2576 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-cacerts\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:23:12.836346 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:12.836339    2576 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-local-certs\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:23:12.836346 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:12.836349    2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-istio-csr-dns-cert\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:23:12.836346 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:12.836359    2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-istio-csr-ca-configmap\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:23:12.836616 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:12.836368    2576 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-istio-kubeconfig\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:23:12.836616 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:12.836376    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-278lm\" (UniqueName: \"kubernetes.io/projected/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-kube-api-access-278lm\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:23:12.836616 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:12.836385    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd-istio-token\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:23:13.617963 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:13.617933    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"
Jul 21 20:23:13.617963 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:13.617949    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vxz85" event={"ID":"7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd","Type":"ContainerDied","Data":"9ef36127d87e7272314c1e6462bc86e01c150e6af642e9fbd906741f70d5d9b8"}
Jul 21 20:23:13.618517 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:13.618039    2576 scope.go:117] "RemoveContainer" containerID="1d35adf4105b4acd8bc7555a6556ccdf424f7f3b94020ba2b13545b868e1c90d"
Jul 21 20:23:13.656410 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:13.656382    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"]
Jul 21 20:23:13.663007 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:13.662979    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vxz85"]
Jul 21 20:23:14.568243 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:14.568203    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-j7dwm"
Jul 21 20:23:14.628357 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:14.628266    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-79vlc" event={"ID":"804d9d71-4793-4dc1-8e6b-efeebab2810f","Type":"ContainerStarted","Data":"04777ddcf594a1c2602c35e8f97afa2609819a49ee0ab875f481f8cb9626f185"}
Jul 21 20:23:14.628836 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:14.628427    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-79vlc"
Jul 21 20:23:14.630081 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:14.630054    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m9r6q" event={"ID":"346b733b-6a38-4212-bde3-f656f1e81818","Type":"ContainerStarted","Data":"a22c25fa68f3ab7a99735eb6ca2e1b7dd741b6cadf1989c7a18e587eec4e16fc"}
Jul 21 20:23:14.630301 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:14.630280    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m9r6q"
Jul 21 20:23:14.668572 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:14.668518    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-79vlc" podStartSLOduration=2.035691114 podStartE2EDuration="4.668500207s" totalImagesPullingTime="2.632809093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:23:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:23:14.666034018 +0000 UTC m=+545.598432176" watchObservedRunningTime="2026-07-21 20:23:14.668500207 +0000 UTC m=+545.600898365"
Jul 21 20:23:14.706655 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:14.706602    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m9r6q" podStartSLOduration=1.454789395 podStartE2EDuration="4.706582607s" totalImagesPullingTime="3.251793212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:23:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:23:14.705741989 +0000 UTC m=+545.638140148" watchObservedRunningTime="2026-07-21 20:23:14.706582607 +0000 UTC m=+545.638980764"
Jul 21 20:23:15.651090 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:15.651059    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd" path="/var/lib/kubelet/pods/7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd/volumes"
Jul 21 20:23:17.586369 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:17.586335    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-ft8wg"
Jul 21 20:23:18.868967 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:18.868929    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:45.637466 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:45.637426    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m9r6q"
Jul 21 20:23:45.640581 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:45.640558    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-79vlc"
Jul 21 20:23:59.496649 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:59.496613    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:59.554579 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:59.554536    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9zc7s"]
Jul 21 20:23:59.555001 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:59.554981    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd" containerName="discovery"
Jul 21 20:23:59.555097 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:59.555003    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd" containerName="discovery"
Jul 21 20:23:59.555097 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:59.555077    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ec181f8-87cf-4e1a-ab28-98e2ac3b16cd" containerName="discovery"
Jul 21 20:23:59.566088 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:59.566055    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9zc7s"
Jul 21 20:23:59.571598 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:59.571563    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 20:23:59.572651 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:59.572441    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 20:23:59.572651 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:59.572441    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-crmwl\""
Jul 21 20:23:59.618496 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:59.618454    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9zc7s"]
Jul 21 20:23:59.636891 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:59.636857    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:59.652230 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:59.652203    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqcwf\" (UniqueName: \"kubernetes.io/projected/f3625759-b17f-4060-ac6b-6e1242517b0c-kube-api-access-dqcwf\") pod \"kuadrant-operator-catalog-9zc7s\" (UID: \"f3625759-b17f-4060-ac6b-6e1242517b0c\") " pod="kuadrant-system/kuadrant-operator-catalog-9zc7s"
Jul 21 20:23:59.740244 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:59.740212    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:23:59.753514 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:59.753432    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqcwf\" (UniqueName: \"kubernetes.io/projected/f3625759-b17f-4060-ac6b-6e1242517b0c-kube-api-access-dqcwf\") pod \"kuadrant-operator-catalog-9zc7s\" (UID: \"f3625759-b17f-4060-ac6b-6e1242517b0c\") " pod="kuadrant-system/kuadrant-operator-catalog-9zc7s"
Jul 21 20:23:59.778800 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:59.778767    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqcwf\" (UniqueName: \"kubernetes.io/projected/f3625759-b17f-4060-ac6b-6e1242517b0c-kube-api-access-dqcwf\") pod \"kuadrant-operator-catalog-9zc7s\" (UID: \"f3625759-b17f-4060-ac6b-6e1242517b0c\") " pod="kuadrant-system/kuadrant-operator-catalog-9zc7s"
Jul 21 20:23:59.876128 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:59.876084    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9zc7s"
Jul 21 20:23:59.938301 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:23:59.938262    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9zc7s"]
Jul 21 20:24:00.024123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:00.024090    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9zc7s"]
Jul 21 20:24:00.027149 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:24:00.027121    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3625759_b17f_4060_ac6b_6e1242517b0c.slice/crio-1acabe8cb8b0a1920aa879907586d6084e417f1ec16e8e9b21ce8b5828f86ea5 WatchSource:0}: Error finding container 1acabe8cb8b0a1920aa879907586d6084e417f1ec16e8e9b21ce8b5828f86ea5: Status 404 returned error can't find the container with id 1acabe8cb8b0a1920aa879907586d6084e417f1ec16e8e9b21ce8b5828f86ea5
Jul 21 20:24:00.048641 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:00.048611    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-54np5"]
Jul 21 20:24:00.051345 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:00.051327    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-54np5"
Jul 21 20:24:00.062867 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:00.062839    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-54np5"]
Jul 21 20:24:00.157160 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:00.157120    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8pr6\" (UniqueName: \"kubernetes.io/projected/c2f42ac6-8028-470f-94de-ec2abfb65d2e-kube-api-access-j8pr6\") pod \"kuadrant-operator-catalog-54np5\" (UID: \"c2f42ac6-8028-470f-94de-ec2abfb65d2e\") " pod="kuadrant-system/kuadrant-operator-catalog-54np5"
Jul 21 20:24:00.257784 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:00.257746    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8pr6\" (UniqueName: \"kubernetes.io/projected/c2f42ac6-8028-470f-94de-ec2abfb65d2e-kube-api-access-j8pr6\") pod \"kuadrant-operator-catalog-54np5\" (UID: \"c2f42ac6-8028-470f-94de-ec2abfb65d2e\") " pod="kuadrant-system/kuadrant-operator-catalog-54np5"
Jul 21 20:24:00.266244 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:00.266216    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8pr6\" (UniqueName: \"kubernetes.io/projected/c2f42ac6-8028-470f-94de-ec2abfb65d2e-kube-api-access-j8pr6\") pod \"kuadrant-operator-catalog-54np5\" (UID: \"c2f42ac6-8028-470f-94de-ec2abfb65d2e\") " pod="kuadrant-system/kuadrant-operator-catalog-54np5"
Jul 21 20:24:00.361213 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:00.361121    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-54np5"
Jul 21 20:24:00.501942 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:00.501912    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-54np5"]
Jul 21 20:24:00.504288 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:24:00.504253    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2f42ac6_8028_470f_94de_ec2abfb65d2e.slice/crio-d0fa2ec217f9b05721880863dc61e8a93928aaaca86728ae9ff8a2edbb2020ee WatchSource:0}: Error finding container d0fa2ec217f9b05721880863dc61e8a93928aaaca86728ae9ff8a2edbb2020ee: Status 404 returned error can't find the container with id d0fa2ec217f9b05721880863dc61e8a93928aaaca86728ae9ff8a2edbb2020ee
Jul 21 20:24:00.839738 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:00.839698    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-54np5" event={"ID":"c2f42ac6-8028-470f-94de-ec2abfb65d2e","Type":"ContainerStarted","Data":"d0fa2ec217f9b05721880863dc61e8a93928aaaca86728ae9ff8a2edbb2020ee"}
Jul 21 20:24:00.840973 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:00.840947    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9zc7s" event={"ID":"f3625759-b17f-4060-ac6b-6e1242517b0c","Type":"ContainerStarted","Data":"1acabe8cb8b0a1920aa879907586d6084e417f1ec16e8e9b21ce8b5828f86ea5"}
Jul 21 20:24:02.852019 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:02.851979    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-54np5" event={"ID":"c2f42ac6-8028-470f-94de-ec2abfb65d2e","Type":"ContainerStarted","Data":"8cfa10ab262e57546426f2cfe4711a75029a102701258fa1e65ae7d00319ccc5"}
Jul 21 20:24:02.853424 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:02.853394    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9zc7s" event={"ID":"f3625759-b17f-4060-ac6b-6e1242517b0c","Type":"ContainerStarted","Data":"b58ccf8f2dd0ee850f1429830c61261e7f3c94bbac9eac47e64a523329dae293"}
Jul 21 20:24:02.853558 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:02.853463    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-9zc7s" podUID="f3625759-b17f-4060-ac6b-6e1242517b0c" containerName="registry-server" containerID="cri-o://b58ccf8f2dd0ee850f1429830c61261e7f3c94bbac9eac47e64a523329dae293" gracePeriod=2
Jul 21 20:24:02.874138 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:02.874096    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-54np5" podStartSLOduration=1.5602932969999999 podStartE2EDuration="2.874081792s" totalImagesPullingTime="1.313788495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:24:02.871441604 +0000 UTC m=+593.803839761" watchObservedRunningTime="2026-07-21 20:24:02.874081792 +0000 UTC m=+593.806479949"
Jul 21 20:24:02.892813 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:02.892759    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9zc7s" podStartSLOduration=2.101652046 podStartE2EDuration="3.892747898s" totalImagesPullingTime="1.791095852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:24:02.889569623 +0000 UTC m=+593.821967779" watchObservedRunningTime="2026-07-21 20:24:02.892747898 +0000 UTC m=+593.825146055"
Jul 21 20:24:03.097172 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:03.097146    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9zc7s"
Jul 21 20:24:03.287496 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:03.287459    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqcwf\" (UniqueName: \"kubernetes.io/projected/f3625759-b17f-4060-ac6b-6e1242517b0c-kube-api-access-dqcwf\") pod \"f3625759-b17f-4060-ac6b-6e1242517b0c\" (UID: \"f3625759-b17f-4060-ac6b-6e1242517b0c\") "
Jul 21 20:24:03.289697 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:03.289664    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3625759-b17f-4060-ac6b-6e1242517b0c-kube-api-access-dqcwf" (OuterVolumeSpecName: "kube-api-access-dqcwf") pod "f3625759-b17f-4060-ac6b-6e1242517b0c" (UID: "f3625759-b17f-4060-ac6b-6e1242517b0c"). InnerVolumeSpecName "kube-api-access-dqcwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:24:03.389092 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:03.389055    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqcwf\" (UniqueName: \"kubernetes.io/projected/f3625759-b17f-4060-ac6b-6e1242517b0c-kube-api-access-dqcwf\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:24:03.859185 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:03.859146    2576 generic.go:356] "Generic (PLEG): container finished" podID="f3625759-b17f-4060-ac6b-6e1242517b0c" containerID="b58ccf8f2dd0ee850f1429830c61261e7f3c94bbac9eac47e64a523329dae293" exitCode=0
Jul 21 20:24:03.859185 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:03.859187    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9zc7s"
Jul 21 20:24:03.859706 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:03.859223    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9zc7s" event={"ID":"f3625759-b17f-4060-ac6b-6e1242517b0c","Type":"ContainerDied","Data":"b58ccf8f2dd0ee850f1429830c61261e7f3c94bbac9eac47e64a523329dae293"}
Jul 21 20:24:03.859706 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:03.859269    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9zc7s" event={"ID":"f3625759-b17f-4060-ac6b-6e1242517b0c","Type":"ContainerDied","Data":"1acabe8cb8b0a1920aa879907586d6084e417f1ec16e8e9b21ce8b5828f86ea5"}
Jul 21 20:24:03.859706 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:03.859289    2576 scope.go:117] "RemoveContainer" containerID="b58ccf8f2dd0ee850f1429830c61261e7f3c94bbac9eac47e64a523329dae293"
Jul 21 20:24:03.868425 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:03.868409    2576 scope.go:117] "RemoveContainer" containerID="b58ccf8f2dd0ee850f1429830c61261e7f3c94bbac9eac47e64a523329dae293"
Jul 21 20:24:03.868705 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:24:03.868676    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b58ccf8f2dd0ee850f1429830c61261e7f3c94bbac9eac47e64a523329dae293\": container with ID starting with b58ccf8f2dd0ee850f1429830c61261e7f3c94bbac9eac47e64a523329dae293 not found: ID does not exist" containerID="b58ccf8f2dd0ee850f1429830c61261e7f3c94bbac9eac47e64a523329dae293"
Jul 21 20:24:03.868759 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:03.868718    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b58ccf8f2dd0ee850f1429830c61261e7f3c94bbac9eac47e64a523329dae293"} err="failed to get container status \"b58ccf8f2dd0ee850f1429830c61261e7f3c94bbac9eac47e64a523329dae293\": rpc error: code = NotFound desc = could not find container \"b58ccf8f2dd0ee850f1429830c61261e7f3c94bbac9eac47e64a523329dae293\": container with ID starting with b58ccf8f2dd0ee850f1429830c61261e7f3c94bbac9eac47e64a523329dae293 not found: ID does not exist"
Jul 21 20:24:03.878990 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:03.878962    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9zc7s"]
Jul 21 20:24:03.883149 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:03.883117    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9zc7s"]
Jul 21 20:24:05.650820 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:05.650780    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3625759-b17f-4060-ac6b-6e1242517b0c" path="/var/lib/kubelet/pods/f3625759-b17f-4060-ac6b-6e1242517b0c/volumes"
Jul 21 20:24:09.497730 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:09.497703    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w885b_62db291a-14b7-4e35-9550-9fb810f82b8d/console-operator/1.log"
Jul 21 20:24:09.498737 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:09.498717    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w885b_62db291a-14b7-4e35-9550-9fb810f82b8d/console-operator/1.log"
Jul 21 20:24:09.504355 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:09.504337    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-54f9x_55f51c26-71cd-4e1b-84f2-32f2de4138d5/ovn-acl-logging/0.log"
Jul 21 20:24:09.505268 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:09.505254    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-54f9x_55f51c26-71cd-4e1b-84f2-32f2de4138d5/ovn-acl-logging/0.log"
Jul 21 20:24:10.362175 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:10.362140    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-54np5"
Jul 21 20:24:10.363349 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:10.362201    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-54np5"
Jul 21 20:24:10.384367 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:10.384343    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-54np5"
Jul 21 20:24:10.915595 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:10.915563    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-54np5"
Jul 21 20:24:13.678589 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:13.678558    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:13.774186 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:13.774151    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:24.550311 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:24.550277    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:24.671112 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:24.671072    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:24.779983 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:24.779954    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:27.206193 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:27.206160    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:30.825404 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:30.825366    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:33.873771 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:33.873734    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:36.068276 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:36.068242    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgn9c"]
Jul 21 20:24:36.068636 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:36.068608    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3625759-b17f-4060-ac6b-6e1242517b0c" containerName="registry-server"
Jul 21 20:24:36.068636 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:36.068621    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3625759-b17f-4060-ac6b-6e1242517b0c" containerName="registry-server"
Jul 21 20:24:36.068761 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:36.068682    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3625759-b17f-4060-ac6b-6e1242517b0c" containerName="registry-server"
Jul 21 20:24:36.072346 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:36.072325    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgn9c"
Jul 21 20:24:36.081094 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:36.081074    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mwzsw\""
Jul 21 20:24:36.104465 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:36.104434    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgn9c"]
Jul 21 20:24:36.187847 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:36.187813    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e1f0333-0223-4281-b7b5-35a185cc7cca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sgn9c\" (UID: \"9e1f0333-0223-4281-b7b5-35a185cc7cca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgn9c"
Jul 21 20:24:36.188025 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:36.187871    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqc75\" (UniqueName: \"kubernetes.io/projected/9e1f0333-0223-4281-b7b5-35a185cc7cca-kube-api-access-qqc75\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sgn9c\" (UID: \"9e1f0333-0223-4281-b7b5-35a185cc7cca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgn9c"
Jul 21 20:24:36.289183 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:36.289145    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e1f0333-0223-4281-b7b5-35a185cc7cca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sgn9c\" (UID: \"9e1f0333-0223-4281-b7b5-35a185cc7cca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgn9c"
Jul 21 20:24:36.289363 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:36.289212    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqc75\" (UniqueName: \"kubernetes.io/projected/9e1f0333-0223-4281-b7b5-35a185cc7cca-kube-api-access-qqc75\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sgn9c\" (UID: \"9e1f0333-0223-4281-b7b5-35a185cc7cca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgn9c"
Jul 21 20:24:36.289560 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:36.289541    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e1f0333-0223-4281-b7b5-35a185cc7cca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sgn9c\" (UID: \"9e1f0333-0223-4281-b7b5-35a185cc7cca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgn9c"
Jul 21 20:24:36.307060 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:36.307031    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqc75\" (UniqueName: \"kubernetes.io/projected/9e1f0333-0223-4281-b7b5-35a185cc7cca-kube-api-access-qqc75\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sgn9c\" (UID: \"9e1f0333-0223-4281-b7b5-35a185cc7cca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgn9c"
Jul 21 20:24:36.382385 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:36.382299    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgn9c"
Jul 21 20:24:36.554010 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:36.553984    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgn9c"]
Jul 21 20:24:36.556305 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:24:36.556273    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e1f0333_0223_4281_b7b5_35a185cc7cca.slice/crio-2c5137fe924273430889e63f892495284396ffb1d9eb587c96591b03c6872607 WatchSource:0}: Error finding container 2c5137fe924273430889e63f892495284396ffb1d9eb587c96591b03c6872607: Status 404 returned error can't find the container with id 2c5137fe924273430889e63f892495284396ffb1d9eb587c96591b03c6872607
Jul 21 20:24:36.663374 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:36.663271    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:37.007509 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:37.007478    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgn9c" event={"ID":"9e1f0333-0223-4281-b7b5-35a185cc7cca","Type":"ContainerStarted","Data":"2c5137fe924273430889e63f892495284396ffb1d9eb587c96591b03c6872607"}
Jul 21 20:24:37.012894 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:37.012867    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:39.566295 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:39.566256    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:39.786015 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:39.785977    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-4v7vb"]
Jul 21 20:24:39.789811 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:39.789785    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4v7vb"
Jul 21 20:24:39.794339 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:39.794312    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-ht5wt\""
Jul 21 20:24:39.794487 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:39.794415    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 21 20:24:39.816910 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:39.816827    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-4v7vb"]
Jul 21 20:24:39.925928 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:39.925888    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxtgs\" (UniqueName: \"kubernetes.io/projected/c1002ac0-c600-4537-b23f-e5cbe0567091-kube-api-access-gxtgs\") pod \"dns-operator-controller-manager-864dd78c4c-4v7vb\" (UID: \"c1002ac0-c600-4537-b23f-e5cbe0567091\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4v7vb"
Jul 21 20:24:39.932117 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:39.932091    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:40.026554 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:40.026522    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxtgs\" (UniqueName: \"kubernetes.io/projected/c1002ac0-c600-4537-b23f-e5cbe0567091-kube-api-access-gxtgs\") pod \"dns-operator-controller-manager-864dd78c4c-4v7vb\" (UID: \"c1002ac0-c600-4537-b23f-e5cbe0567091\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4v7vb"
Jul 21 20:24:40.044816 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:40.044786    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxtgs\" (UniqueName: \"kubernetes.io/projected/c1002ac0-c600-4537-b23f-e5cbe0567091-kube-api-access-gxtgs\") pod \"dns-operator-controller-manager-864dd78c4c-4v7vb\" (UID: \"c1002ac0-c600-4537-b23f-e5cbe0567091\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4v7vb"
Jul 21 20:24:40.102563 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:40.102454    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4v7vb"
Jul 21 20:24:40.285265 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:40.285238    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-4v7vb"]
Jul 21 20:24:40.287027 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:24:40.286998    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1002ac0_c600_4537_b23f_e5cbe0567091.slice/crio-a5e9dcd9061e925972b6f1cb33aed4f61e7872bca8e8ecb8a2d64ee0d0e92592 WatchSource:0}: Error finding container a5e9dcd9061e925972b6f1cb33aed4f61e7872bca8e8ecb8a2d64ee0d0e92592: Status 404 returned error can't find the container with id a5e9dcd9061e925972b6f1cb33aed4f61e7872bca8e8ecb8a2d64ee0d0e92592
Jul 21 20:24:40.451567 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:40.451487    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:41.027829 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:41.027792    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4v7vb" event={"ID":"c1002ac0-c600-4537-b23f-e5cbe0567091","Type":"ContainerStarted","Data":"a5e9dcd9061e925972b6f1cb33aed4f61e7872bca8e8ecb8a2d64ee0d0e92592"}
Jul 21 20:24:42.034283 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:42.034252    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgn9c" event={"ID":"9e1f0333-0223-4281-b7b5-35a185cc7cca","Type":"ContainerStarted","Data":"7b75a09b28331ac44aba653082bcaf6e01e469a4acc71d1121a5b649969f2849"}
Jul 21 20:24:42.034658 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:42.034384    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgn9c"
Jul 21 20:24:42.083041 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:42.082980    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgn9c" podStartSLOduration=0.694344504 podStartE2EDuration="6.082963363s" totalImagesPullingTime="5.388618859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:24:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:24:42.082745618 +0000 UTC m=+633.015143775" watchObservedRunningTime="2026-07-21 20:24:42.082963363 +0000 UTC m=+633.015361520"
Jul 21 20:24:42.578013 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:42.577939    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:42.831077 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:42.830998    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:43.725152 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:43.725108    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wdqps"]
Jul 21 20:24:43.729348 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:43.729326    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wdqps"
Jul 21 20:24:43.736272 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:43.736244    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-wc2qh\""
Jul 21 20:24:43.759301 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:43.759268    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wdqps"]
Jul 21 20:24:43.863412 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:43.863310    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttqk5\" (UniqueName: \"kubernetes.io/projected/35b3a7fb-d981-48ba-b81b-b4adfe9bde5e-kube-api-access-ttqk5\") pod \"authorino-operator-75cc8d5cb7-wdqps\" (UID: \"35b3a7fb-d981-48ba-b81b-b4adfe9bde5e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wdqps"
Jul 21 20:24:43.964116 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:43.964083    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttqk5\" (UniqueName: \"kubernetes.io/projected/35b3a7fb-d981-48ba-b81b-b4adfe9bde5e-kube-api-access-ttqk5\") pod \"authorino-operator-75cc8d5cb7-wdqps\" (UID: \"35b3a7fb-d981-48ba-b81b-b4adfe9bde5e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wdqps"
Jul 21 20:24:43.982532 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:43.982496    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttqk5\" (UniqueName: \"kubernetes.io/projected/35b3a7fb-d981-48ba-b81b-b4adfe9bde5e-kube-api-access-ttqk5\") pod \"authorino-operator-75cc8d5cb7-wdqps\" (UID: \"35b3a7fb-d981-48ba-b81b-b4adfe9bde5e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wdqps"
Jul 21 20:24:44.039721 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:44.039667    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wdqps"
Jul 21 20:24:44.039926 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:44.039744    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:44.045400 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:44.045369    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4v7vb" event={"ID":"c1002ac0-c600-4537-b23f-e5cbe0567091","Type":"ContainerStarted","Data":"2ef723f15a5ae88d72f4f3177d947e27b74ca71f3a96ab3c181c121dc05d7f0c"}
Jul 21 20:24:44.045589 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:44.045482    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4v7vb"
Jul 21 20:24:44.085008 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:44.084940    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4v7vb" podStartSLOduration=1.8529139959999998 podStartE2EDuration="5.084917959s" totalImagesPullingTime="3.232003963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:24:44.082486605 +0000 UTC m=+635.014884764" watchObservedRunningTime="2026-07-21 20:24:44.084917959 +0000 UTC m=+635.017316116"
Jul 21 20:24:44.200438 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:44.200412    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wdqps"]
Jul 21 20:24:44.203083 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:24:44.203057    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35b3a7fb_d981_48ba_b81b_b4adfe9bde5e.slice/crio-c7e74b4ddc50d2379dde560187f9912f9ad934b8b3f3e28a17d36612e0c3f2da WatchSource:0}: Error finding container c7e74b4ddc50d2379dde560187f9912f9ad934b8b3f3e28a17d36612e0c3f2da: Status 404 returned error can't find the container with id c7e74b4ddc50d2379dde560187f9912f9ad934b8b3f3e28a17d36612e0c3f2da
Jul 21 20:24:45.054106 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:45.054032    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wdqps" event={"ID":"35b3a7fb-d981-48ba-b81b-b4adfe9bde5e","Type":"ContainerStarted","Data":"c7e74b4ddc50d2379dde560187f9912f9ad934b8b3f3e28a17d36612e0c3f2da"}
Jul 21 20:24:45.279445 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:45.279405    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pz5fz"]
Jul 21 20:24:45.283080 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:45.283059    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pz5fz"
Jul 21 20:24:45.287673 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:45.287514    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 21 20:24:45.288517 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:45.288494    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-phzwh\""
Jul 21 20:24:45.289558 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:45.289538    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 21 20:24:45.296873 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:45.296850    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:45.298944 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:45.298924    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pz5fz"]
Jul 21 20:24:45.477981 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:45.477897    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a3a602d-3121-4018-aabb-0d58f39e795f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pz5fz\" (UID: \"9a3a602d-3121-4018-aabb-0d58f39e795f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pz5fz"
Jul 21 20:24:45.478132 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:45.477991    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9a3a602d-3121-4018-aabb-0d58f39e795f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pz5fz\" (UID: \"9a3a602d-3121-4018-aabb-0d58f39e795f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pz5fz"
Jul 21 20:24:45.478132 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:45.478080    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4zj6\" (UniqueName: \"kubernetes.io/projected/9a3a602d-3121-4018-aabb-0d58f39e795f-kube-api-access-z4zj6\") pod \"kuadrant-console-plugin-66b5774985-pz5fz\" (UID: \"9a3a602d-3121-4018-aabb-0d58f39e795f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pz5fz"
Jul 21 20:24:45.579223 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:45.579184    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a3a602d-3121-4018-aabb-0d58f39e795f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pz5fz\" (UID: \"9a3a602d-3121-4018-aabb-0d58f39e795f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pz5fz"
Jul 21 20:24:45.579223 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:45.579225    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9a3a602d-3121-4018-aabb-0d58f39e795f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pz5fz\" (UID: \"9a3a602d-3121-4018-aabb-0d58f39e795f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pz5fz"
Jul 21 20:24:45.579481 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:45.579265    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4zj6\" (UniqueName: \"kubernetes.io/projected/9a3a602d-3121-4018-aabb-0d58f39e795f-kube-api-access-z4zj6\") pod \"kuadrant-console-plugin-66b5774985-pz5fz\" (UID: \"9a3a602d-3121-4018-aabb-0d58f39e795f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pz5fz"
Jul 21 20:24:45.580065 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:45.580033    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9a3a602d-3121-4018-aabb-0d58f39e795f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pz5fz\" (UID: \"9a3a602d-3121-4018-aabb-0d58f39e795f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pz5fz"
Jul 21 20:24:45.582611 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:45.582589    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a3a602d-3121-4018-aabb-0d58f39e795f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pz5fz\" (UID: \"9a3a602d-3121-4018-aabb-0d58f39e795f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pz5fz"
Jul 21 20:24:45.614904 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:45.614874    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4zj6\" (UniqueName: \"kubernetes.io/projected/9a3a602d-3121-4018-aabb-0d58f39e795f-kube-api-access-z4zj6\") pod \"kuadrant-console-plugin-66b5774985-pz5fz\" (UID: \"9a3a602d-3121-4018-aabb-0d58f39e795f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pz5fz"
Jul 21 20:24:45.700288 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:45.700255    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:45.868754 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:45.868716    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:45.896194 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:45.896162    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pz5fz"
Jul 21 20:24:46.193285 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:46.193202    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnvfw"]
Jul 21 20:24:46.197005 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:46.196983    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnvfw"
Jul 21 20:24:46.200023 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:46.199998    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-brs22\""
Jul 21 20:24:46.213468 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:46.213441    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnvfw"]
Jul 21 20:24:46.285109 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:46.285064    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk2dd\" (UniqueName: \"kubernetes.io/projected/9b8761ec-6a3d-4e01-966f-0868a6c974ba-kube-api-access-mk2dd\") pod \"limitador-operator-controller-manager-859d7b78bd-hnvfw\" (UID: \"9b8761ec-6a3d-4e01-966f-0868a6c974ba\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnvfw"
Jul 21 20:24:46.385845 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:46.385810    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk2dd\" (UniqueName: \"kubernetes.io/projected/9b8761ec-6a3d-4e01-966f-0868a6c974ba-kube-api-access-mk2dd\") pod \"limitador-operator-controller-manager-859d7b78bd-hnvfw\" (UID: \"9b8761ec-6a3d-4e01-966f-0868a6c974ba\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnvfw"
Jul 21 20:24:46.401783 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:46.401713    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk2dd\" (UniqueName: \"kubernetes.io/projected/9b8761ec-6a3d-4e01-966f-0868a6c974ba-kube-api-access-mk2dd\") pod \"limitador-operator-controller-manager-859d7b78bd-hnvfw\" (UID: \"9b8761ec-6a3d-4e01-966f-0868a6c974ba\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnvfw"
Jul 21 20:24:46.506826 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:46.506800    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pz5fz"]
Jul 21 20:24:46.508431 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:24:46.508407    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a3a602d_3121_4018_aabb_0d58f39e795f.slice/crio-08f96e6180790695c19d371d42847b25a745aa4c898f1552a02588d180298f78 WatchSource:0}: Error finding container 08f96e6180790695c19d371d42847b25a745aa4c898f1552a02588d180298f78: Status 404 returned error can't find the container with id 08f96e6180790695c19d371d42847b25a745aa4c898f1552a02588d180298f78
Jul 21 20:24:46.509541 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:46.509522    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnvfw"
Jul 21 20:24:46.660148 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:46.659975    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnvfw"]
Jul 21 20:24:46.663122 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:24:46.663082    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b8761ec_6a3d_4e01_966f_0868a6c974ba.slice/crio-74b3d3db6b7b28c7415ea544eddfad9c455a870cc9a1fb55272ff9255eca7b83 WatchSource:0}: Error finding container 74b3d3db6b7b28c7415ea544eddfad9c455a870cc9a1fb55272ff9255eca7b83: Status 404 returned error can't find the container with id 74b3d3db6b7b28c7415ea544eddfad9c455a870cc9a1fb55272ff9255eca7b83
Jul 21 20:24:47.065673 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:47.065633    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wdqps" event={"ID":"35b3a7fb-d981-48ba-b81b-b4adfe9bde5e","Type":"ContainerStarted","Data":"ccbb528f91b41d71541c9e0f77a6dbe9c30d8201267b0efe35ff54ddc4f9ad5f"}
Jul 21 20:24:47.065915 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:47.065768    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wdqps"
Jul 21 20:24:47.067021 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:47.066996    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnvfw" event={"ID":"9b8761ec-6a3d-4e01-966f-0868a6c974ba","Type":"ContainerStarted","Data":"74b3d3db6b7b28c7415ea544eddfad9c455a870cc9a1fb55272ff9255eca7b83"}
Jul 21 20:24:47.068072 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:47.068055    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pz5fz" event={"ID":"9a3a602d-3121-4018-aabb-0d58f39e795f","Type":"ContainerStarted","Data":"08f96e6180790695c19d371d42847b25a745aa4c898f1552a02588d180298f78"}
Jul 21 20:24:49.082038 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:49.082000    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnvfw" event={"ID":"9b8761ec-6a3d-4e01-966f-0868a6c974ba","Type":"ContainerStarted","Data":"a84d1c3e3a0790e1d231824657a9946a092626aa0dd0bdc2fee03cf7aaf270fd"}
Jul 21 20:24:49.082421 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:49.082078    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnvfw"
Jul 21 20:24:49.113441 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:49.113387    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wdqps" podStartSLOduration=3.905793702 podStartE2EDuration="6.113364836s" totalImagesPullingTime="2.207571134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:24:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:24:47.143714448 +0000 UTC m=+638.076112596" watchObservedRunningTime="2026-07-21 20:24:49.113364836 +0000 UTC m=+640.045763007"
Jul 21 20:24:49.114298 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:49.114262    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnvfw" podStartSLOduration=1.1298292189999999 podStartE2EDuration="3.114249315s" totalImagesPullingTime="1.984420096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:24:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:24:49.111945747 +0000 UTC m=+640.044343905" watchObservedRunningTime="2026-07-21 20:24:49.114249315 +0000 UTC m=+640.046647474"
Jul 21 20:24:49.255443 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:49.255411    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:49.400923 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:49.400829    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:53.042382 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:53.042350    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgn9c"
Jul 21 20:24:55.057171 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.057140    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4v7vb"
Jul 21 20:24:55.227362 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.227326    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgn9c"]
Jul 21 20:24:55.227712 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.227624    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgn9c" podUID="9e1f0333-0223-4281-b7b5-35a185cc7cca" containerName="manager" containerID="cri-o://7b75a09b28331ac44aba653082bcaf6e01e469a4acc71d1121a5b649969f2849" gracePeriod=2
Jul 21 20:24:55.255352 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.255279    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgn9c"]
Jul 21 20:24:55.294902 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:24:55.294859    2576 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9e1f0333-0223-4281-b7b5-35a185cc7cca\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-sgn9c\": pods \"kuadrant-operator-controller-manager-8684c9ff49-sgn9c\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgn9c"
Jul 21 20:24:55.296136 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.296110    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnvfw"]
Jul 21 20:24:55.296370 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.296339    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnvfw" podUID="9b8761ec-6a3d-4e01-966f-0868a6c974ba" containerName="manager" containerID="cri-o://a84d1c3e3a0790e1d231824657a9946a092626aa0dd0bdc2fee03cf7aaf270fd" gracePeriod=2
Jul 21 20:24:55.298495 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.298471    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnvfw"
Jul 21 20:24:55.300338 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:24:55.300312    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sgn9c\" is forbidden: User \"system:node:ip-10-0-128-201.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-201.ec2.internal' and this object" podUID="9e1f0333-0223-4281-b7b5-35a185cc7cca" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgn9c"
Jul 21 20:24:55.305097 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.305069    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnvfw"]
Jul 21 20:24:55.307593 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:24:55.307507    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hnvfw\" is forbidden: User \"system:node:ip-10-0-128-201.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-201.ec2.internal' and this object" podUID="9b8761ec-6a3d-4e01-966f-0868a6c974ba" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnvfw"
Jul 21 20:24:55.311218 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:24:55.311145    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sgn9c\" is forbidden: User \"system:node:ip-10-0-128-201.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-201.ec2.internal' and this object" podUID="9e1f0333-0223-4281-b7b5-35a185cc7cca" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgn9c"
Jul 21 20:24:55.314327 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:24:55.314270    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hnvfw\" is forbidden: User \"system:node:ip-10-0-128-201.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-201.ec2.internal' and this object" podUID="9b8761ec-6a3d-4e01-966f-0868a6c974ba" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnvfw"
Jul 21 20:24:55.347339 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.347163    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96q82"]
Jul 21 20:24:55.347722 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.347677    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b8761ec-6a3d-4e01-966f-0868a6c974ba" containerName="manager"
Jul 21 20:24:55.347812 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.347725    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b8761ec-6a3d-4e01-966f-0868a6c974ba" containerName="manager"
Jul 21 20:24:55.347812 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.347754    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e1f0333-0223-4281-b7b5-35a185cc7cca" containerName="manager"
Jul 21 20:24:55.347812 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.347764    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e1f0333-0223-4281-b7b5-35a185cc7cca" containerName="manager"
Jul 21 20:24:55.347917 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.347862    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e1f0333-0223-4281-b7b5-35a185cc7cca" containerName="manager"
Jul 21 20:24:55.347917 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.347874    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b8761ec-6a3d-4e01-966f-0868a6c974ba" containerName="manager"
Jul 21 20:24:55.351113 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.351088    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96q82"
Jul 21 20:24:55.365286 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.365260    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzk8h\" (UniqueName: \"kubernetes.io/projected/cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb-kube-api-access-pzk8h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-96q82\" (UID: \"cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96q82"
Jul 21 20:24:55.365432 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.365378    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-96q82\" (UID: \"cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96q82"
Jul 21 20:24:55.389050 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.389015    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qm8r"]
Jul 21 20:24:55.392702 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.392660    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qm8r"
Jul 21 20:24:55.403341 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:24:55.403298    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sgn9c\" is forbidden: User \"system:node:ip-10-0-128-201.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-201.ec2.internal' and this object" podUID="9e1f0333-0223-4281-b7b5-35a185cc7cca" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgn9c"
Jul 21 20:24:55.405790 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:24:55.405750    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hnvfw\" is forbidden: User \"system:node:ip-10-0-128-201.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-201.ec2.internal' and this object" podUID="9b8761ec-6a3d-4e01-966f-0868a6c974ba" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnvfw"
Jul 21 20:24:55.409927 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:24:55.409890    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sgn9c\" is forbidden: User \"system:node:ip-10-0-128-201.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-201.ec2.internal' and this object" podUID="9e1f0333-0223-4281-b7b5-35a185cc7cca" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgn9c"
Jul 21 20:24:55.466885 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.466812    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-96q82\" (UID: \"cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96q82"
Jul 21 20:24:55.466885 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.466862    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzk8h\" (UniqueName: \"kubernetes.io/projected/cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb-kube-api-access-pzk8h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-96q82\" (UID: \"cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96q82"
Jul 21 20:24:55.466885 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.466890    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh7fb\" (UniqueName: \"kubernetes.io/projected/7b753179-05f2-42c1-98f8-8a69b464e793-kube-api-access-vh7fb\") pod \"limitador-operator-controller-manager-859d7b78bd-7qm8r\" (UID: \"7b753179-05f2-42c1-98f8-8a69b464e793\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qm8r"
Jul 21 20:24:55.467290 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.467264    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-96q82\" (UID: \"cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96q82"
Jul 21 20:24:55.467365 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:24:55.467276    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hnvfw\" is forbidden: User \"system:node:ip-10-0-128-201.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-201.ec2.internal' and this object" podUID="9b8761ec-6a3d-4e01-966f-0868a6c974ba" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnvfw"
Jul 21 20:24:55.468639 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.468614    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96q82"]
Jul 21 20:24:55.483712 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.483656    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzk8h\" (UniqueName: \"kubernetes.io/projected/cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb-kube-api-access-pzk8h\") pod \"kuadrant-operator-controller-manager-8684c9ff49-96q82\" (UID: \"cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96q82"
Jul 21 20:24:55.495441 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.495374    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qm8r"]
Jul 21 20:24:55.566452 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.566362    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgn9c"
Jul 21 20:24:55.567663 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.567439    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh7fb\" (UniqueName: \"kubernetes.io/projected/7b753179-05f2-42c1-98f8-8a69b464e793-kube-api-access-vh7fb\") pod \"limitador-operator-controller-manager-859d7b78bd-7qm8r\" (UID: \"7b753179-05f2-42c1-98f8-8a69b464e793\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qm8r"
Jul 21 20:24:55.569814 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.569796    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnvfw"
Jul 21 20:24:55.575007 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:24:55.574968    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sgn9c\" is forbidden: User \"system:node:ip-10-0-128-201.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-201.ec2.internal' and this object" podUID="9e1f0333-0223-4281-b7b5-35a185cc7cca" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgn9c"
Jul 21 20:24:55.577130 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:24:55.577100    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hnvfw\" is forbidden: User \"system:node:ip-10-0-128-201.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-201.ec2.internal' and this object" podUID="9b8761ec-6a3d-4e01-966f-0868a6c974ba" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnvfw"
Jul 21 20:24:55.579378 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:24:55.579346    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sgn9c\" is forbidden: User \"system:node:ip-10-0-128-201.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-201.ec2.internal' and this object" podUID="9e1f0333-0223-4281-b7b5-35a185cc7cca" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgn9c"
Jul 21 20:24:55.581151 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:24:55.581119    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hnvfw\" is forbidden: User \"system:node:ip-10-0-128-201.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-201.ec2.internal' and this object" podUID="9b8761ec-6a3d-4e01-966f-0868a6c974ba" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnvfw"
Jul 21 20:24:55.584493 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.584465    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh7fb\" (UniqueName: \"kubernetes.io/projected/7b753179-05f2-42c1-98f8-8a69b464e793-kube-api-access-vh7fb\") pod \"limitador-operator-controller-manager-859d7b78bd-7qm8r\" (UID: \"7b753179-05f2-42c1-98f8-8a69b464e793\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qm8r"
Jul 21 20:24:55.666712 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.666664    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96q82"
Jul 21 20:24:55.668950 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.668923    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e1f0333-0223-4281-b7b5-35a185cc7cca-extensions-socket-volume\") pod \"9e1f0333-0223-4281-b7b5-35a185cc7cca\" (UID: \"9e1f0333-0223-4281-b7b5-35a185cc7cca\") "
Jul 21 20:24:55.669108 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.668994    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mk2dd\" (UniqueName: \"kubernetes.io/projected/9b8761ec-6a3d-4e01-966f-0868a6c974ba-kube-api-access-mk2dd\") pod \"9b8761ec-6a3d-4e01-966f-0868a6c974ba\" (UID: \"9b8761ec-6a3d-4e01-966f-0868a6c974ba\") "
Jul 21 20:24:55.669108 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.669051    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqc75\" (UniqueName: \"kubernetes.io/projected/9e1f0333-0223-4281-b7b5-35a185cc7cca-kube-api-access-qqc75\") pod \"9e1f0333-0223-4281-b7b5-35a185cc7cca\" (UID: \"9e1f0333-0223-4281-b7b5-35a185cc7cca\") "
Jul 21 20:24:55.669466 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.669423    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e1f0333-0223-4281-b7b5-35a185cc7cca-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9e1f0333-0223-4281-b7b5-35a185cc7cca" (UID: "9e1f0333-0223-4281-b7b5-35a185cc7cca"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:24:55.671442 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.671421    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b8761ec-6a3d-4e01-966f-0868a6c974ba-kube-api-access-mk2dd" (OuterVolumeSpecName: "kube-api-access-mk2dd") pod "9b8761ec-6a3d-4e01-966f-0868a6c974ba" (UID: "9b8761ec-6a3d-4e01-966f-0868a6c974ba"). InnerVolumeSpecName "kube-api-access-mk2dd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:24:55.671560 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.671540    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e1f0333-0223-4281-b7b5-35a185cc7cca-kube-api-access-qqc75" (OuterVolumeSpecName: "kube-api-access-qqc75") pod "9e1f0333-0223-4281-b7b5-35a185cc7cca" (UID: "9e1f0333-0223-4281-b7b5-35a185cc7cca"). InnerVolumeSpecName "kube-api-access-qqc75". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:24:55.696201 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.696139    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:55.706018 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.705978    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qm8r"
Jul 21 20:24:55.770559 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.770527    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e1f0333-0223-4281-b7b5-35a185cc7cca-extensions-socket-volume\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:24:55.770678 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.770561    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mk2dd\" (UniqueName: \"kubernetes.io/projected/9b8761ec-6a3d-4e01-966f-0868a6c974ba-kube-api-access-mk2dd\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:24:55.770678 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.770577    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqc75\" (UniqueName: \"kubernetes.io/projected/9e1f0333-0223-4281-b7b5-35a185cc7cca-kube-api-access-qqc75\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:24:55.856322 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.856273    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96q82"]
Jul 21 20:24:55.859404 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:24:55.859371    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd54c28c_6669_4d5c_bbaa_6e3fac93b2fb.slice/crio-79cf99c86398d155f88ef1c56b95e8623cd9fe7023a256bee1014309c30f2d93 WatchSource:0}: Error finding container 79cf99c86398d155f88ef1c56b95e8623cd9fe7023a256bee1014309c30f2d93: Status 404 returned error can't find the container with id 79cf99c86398d155f88ef1c56b95e8623cd9fe7023a256bee1014309c30f2d93
Jul 21 20:24:55.889593 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.889571    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qm8r"]
Jul 21 20:24:55.896961 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:24:55.896930    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b753179_05f2_42c1_98f8_8a69b464e793.slice/crio-f6343e342b2455337171889fc95c03e03cd59d8651678bac055631ed4cb1fce5 WatchSource:0}: Error finding container f6343e342b2455337171889fc95c03e03cd59d8651678bac055631ed4cb1fce5: Status 404 returned error can't find the container with id f6343e342b2455337171889fc95c03e03cd59d8651678bac055631ed4cb1fce5
Jul 21 20:24:55.913808 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:55.913782    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:24:56.133326 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:56.133229    2576 generic.go:356] "Generic (PLEG): container finished" podID="9e1f0333-0223-4281-b7b5-35a185cc7cca" containerID="7b75a09b28331ac44aba653082bcaf6e01e469a4acc71d1121a5b649969f2849" exitCode=0
Jul 21 20:24:56.133326 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:56.133297    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sgn9c"
Jul 21 20:24:56.133860 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:56.133354    2576 scope.go:117] "RemoveContainer" containerID="7b75a09b28331ac44aba653082bcaf6e01e469a4acc71d1121a5b649969f2849"
Jul 21 20:24:56.135993 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:56.135963    2576 generic.go:356] "Generic (PLEG): container finished" podID="9b8761ec-6a3d-4e01-966f-0868a6c974ba" containerID="a84d1c3e3a0790e1d231824657a9946a092626aa0dd0bdc2fee03cf7aaf270fd" exitCode=0
Jul 21 20:24:56.136199 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:56.136165    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hnvfw"
Jul 21 20:24:56.139535 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:56.139161    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96q82" event={"ID":"cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb","Type":"ContainerStarted","Data":"849c44a8519c47ce0f6b25422b1f452d8a40ba1cec3a8a2ad5e4fdb4f336b0a8"}
Jul 21 20:24:56.139535 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:56.139274    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96q82" event={"ID":"cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb","Type":"ContainerStarted","Data":"79cf99c86398d155f88ef1c56b95e8623cd9fe7023a256bee1014309c30f2d93"}
Jul 21 20:24:56.139535 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:56.139306    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96q82"
Jul 21 20:24:56.141662 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:56.141640    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qm8r" event={"ID":"7b753179-05f2-42c1-98f8-8a69b464e793","Type":"ContainerStarted","Data":"a7dbb347bc5253b607ceeda7cb2aed18a4af3e86ae5f7d430e123771d00c8285"}
Jul 21 20:24:56.141799 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:56.141703    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qm8r" event={"ID":"7b753179-05f2-42c1-98f8-8a69b464e793","Type":"ContainerStarted","Data":"f6343e342b2455337171889fc95c03e03cd59d8651678bac055631ed4cb1fce5"}
Jul 21 20:24:56.141874 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:56.141822    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qm8r"
Jul 21 20:24:56.205049 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:56.204997    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96q82" podStartSLOduration=1.204976156 podStartE2EDuration="1.204976156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:24:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:24:56.202240044 +0000 UTC m=+647.134638203" watchObservedRunningTime="2026-07-21 20:24:56.204976156 +0000 UTC m=+647.137374313"
Jul 21 20:24:57.652705 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:57.652654    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b8761ec-6a3d-4e01-966f-0868a6c974ba" path="/var/lib/kubelet/pods/9b8761ec-6a3d-4e01-966f-0868a6c974ba/volumes"
Jul 21 20:24:57.653109 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:57.653062    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e1f0333-0223-4281-b7b5-35a185cc7cca" path="/var/lib/kubelet/pods/9e1f0333-0223-4281-b7b5-35a185cc7cca/volumes"
Jul 21 20:24:58.078378 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:58.078346    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wdqps"
Jul 21 20:24:58.123157 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:58.123087    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qm8r" podStartSLOduration=3.123062997 podStartE2EDuration="3.123062997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:24:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:24:56.25196258 +0000 UTC m=+647.184360729" watchObservedRunningTime="2026-07-21 20:24:58.123062997 +0000 UTC m=+649.055461154"
Jul 21 20:24:58.693190 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:58.693155    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvbxk"]
Jul 21 20:24:58.721123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:58.721092    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvbxk"
Jul 21 20:24:58.729634 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:58.729601    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvbxk"]
Jul 21 20:24:58.798010 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:58.797973    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e2f37a2-29d0-4645-b9d2-da9a86a333ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cvbxk\" (UID: \"5e2f37a2-29d0-4645-b9d2-da9a86a333ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvbxk"
Jul 21 20:24:58.798205 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:58.798114    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp2w2\" (UniqueName: \"kubernetes.io/projected/5e2f37a2-29d0-4645-b9d2-da9a86a333ed-kube-api-access-pp2w2\") pod \"kuadrant-operator-controller-manager-86878c769f-cvbxk\" (UID: \"5e2f37a2-29d0-4645-b9d2-da9a86a333ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvbxk"
Jul 21 20:24:58.899283 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:58.899246    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e2f37a2-29d0-4645-b9d2-da9a86a333ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cvbxk\" (UID: \"5e2f37a2-29d0-4645-b9d2-da9a86a333ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvbxk"
Jul 21 20:24:58.899469 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:58.899343    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp2w2\" (UniqueName: \"kubernetes.io/projected/5e2f37a2-29d0-4645-b9d2-da9a86a333ed-kube-api-access-pp2w2\") pod \"kuadrant-operator-controller-manager-86878c769f-cvbxk\" (UID: \"5e2f37a2-29d0-4645-b9d2-da9a86a333ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvbxk"
Jul 21 20:24:58.899761 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:58.899735    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e2f37a2-29d0-4645-b9d2-da9a86a333ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cvbxk\" (UID: \"5e2f37a2-29d0-4645-b9d2-da9a86a333ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvbxk"
Jul 21 20:24:58.935631 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:58.935598    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp2w2\" (UniqueName: \"kubernetes.io/projected/5e2f37a2-29d0-4645-b9d2-da9a86a333ed-kube-api-access-pp2w2\") pod \"kuadrant-operator-controller-manager-86878c769f-cvbxk\" (UID: \"5e2f37a2-29d0-4645-b9d2-da9a86a333ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvbxk"
Jul 21 20:24:59.035771 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:24:59.035728    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvbxk"
Jul 21 20:25:02.106115 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:02.106083    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:25:02.220287 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:02.220195    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:25:05.041067 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:05.041011    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:25:05.164455 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:05.164425    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:25:06.888945 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:06.888912    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:25:06.966258 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:06.966223    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:25:07.150809 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:07.150675    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7qm8r"
Jul 21 20:25:07.150809 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:07.150777    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96q82"
Jul 21 20:25:09.428151 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:09.428117    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:25:09.538813 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:09.538768    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:25:10.557743 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:10.557544    2576 scope.go:117] "RemoveContainer" containerID="7b75a09b28331ac44aba653082bcaf6e01e469a4acc71d1121a5b649969f2849"
Jul 21 20:25:10.558021 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:25:10.557975    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b75a09b28331ac44aba653082bcaf6e01e469a4acc71d1121a5b649969f2849\": container with ID starting with 7b75a09b28331ac44aba653082bcaf6e01e469a4acc71d1121a5b649969f2849 not found: ID does not exist" containerID="7b75a09b28331ac44aba653082bcaf6e01e469a4acc71d1121a5b649969f2849"
Jul 21 20:25:10.558021 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:10.558007    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b75a09b28331ac44aba653082bcaf6e01e469a4acc71d1121a5b649969f2849"} err="failed to get container status \"7b75a09b28331ac44aba653082bcaf6e01e469a4acc71d1121a5b649969f2849\": rpc error: code = NotFound desc = could not find container \"7b75a09b28331ac44aba653082bcaf6e01e469a4acc71d1121a5b649969f2849\": container with ID starting with 7b75a09b28331ac44aba653082bcaf6e01e469a4acc71d1121a5b649969f2849 not found: ID does not exist"
Jul 21 20:25:10.558150 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:10.558027    2576 scope.go:117] "RemoveContainer" containerID="a84d1c3e3a0790e1d231824657a9946a092626aa0dd0bdc2fee03cf7aaf270fd"
Jul 21 20:25:10.595338 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:10.595314    2576 scope.go:117] "RemoveContainer" containerID="a84d1c3e3a0790e1d231824657a9946a092626aa0dd0bdc2fee03cf7aaf270fd"
Jul 21 20:25:10.595761 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:25:10.595738    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a84d1c3e3a0790e1d231824657a9946a092626aa0dd0bdc2fee03cf7aaf270fd\": container with ID starting with a84d1c3e3a0790e1d231824657a9946a092626aa0dd0bdc2fee03cf7aaf270fd not found: ID does not exist" containerID="a84d1c3e3a0790e1d231824657a9946a092626aa0dd0bdc2fee03cf7aaf270fd"
Jul 21 20:25:10.595836 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:10.595775    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a84d1c3e3a0790e1d231824657a9946a092626aa0dd0bdc2fee03cf7aaf270fd"} err="failed to get container status \"a84d1c3e3a0790e1d231824657a9946a092626aa0dd0bdc2fee03cf7aaf270fd\": rpc error: code = NotFound desc = could not find container \"a84d1c3e3a0790e1d231824657a9946a092626aa0dd0bdc2fee03cf7aaf270fd\": container with ID starting with a84d1c3e3a0790e1d231824657a9946a092626aa0dd0bdc2fee03cf7aaf270fd not found: ID does not exist"
Jul 21 20:25:10.714462 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:10.714430    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvbxk"]
Jul 21 20:25:10.725986 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:25:10.725954    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e2f37a2_29d0_4645_b9d2_da9a86a333ed.slice/crio-3e16b28a4d1de9d775840ec0cea1aee6157c19f00e6fa1ab4e49d1d03b693a7f WatchSource:0}: Error finding container 3e16b28a4d1de9d775840ec0cea1aee6157c19f00e6fa1ab4e49d1d03b693a7f: Status 404 returned error can't find the container with id 3e16b28a4d1de9d775840ec0cea1aee6157c19f00e6fa1ab4e49d1d03b693a7f
Jul 21 20:25:11.234543 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:11.234502    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvbxk" event={"ID":"5e2f37a2-29d0-4645-b9d2-da9a86a333ed","Type":"ContainerStarted","Data":"f455f7ccbec0ddb66712ff4db54d37cef4174bc9c361c229db68494f015c07e9"}
Jul 21 20:25:11.234757 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:11.234604    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvbxk" event={"ID":"5e2f37a2-29d0-4645-b9d2-da9a86a333ed","Type":"ContainerStarted","Data":"3e16b28a4d1de9d775840ec0cea1aee6157c19f00e6fa1ab4e49d1d03b693a7f"}
Jul 21 20:25:11.234757 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:11.234637    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvbxk"
Jul 21 20:25:11.235873 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:11.235843    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pz5fz" event={"ID":"9a3a602d-3121-4018-aabb-0d58f39e795f","Type":"ContainerStarted","Data":"6697ad6a5eb56ad9aa10dba1e9a37ae2470b5dfd9f1280688d6ae0dcee7e9a58"}
Jul 21 20:25:11.301151 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:11.301092    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvbxk" podStartSLOduration=13.301077433 podStartE2EDuration="13.301077433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:24:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:25:11.268018354 +0000 UTC m=+662.200416512" watchObservedRunningTime="2026-07-21 20:25:11.301077433 +0000 UTC m=+662.233475590"
Jul 21 20:25:11.301839 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:11.301809    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pz5fz" podStartSLOduration=2.143518275 podStartE2EDuration="26.301800965s" totalImagesPullingTime="24.15828269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:25:11.301311971 +0000 UTC m=+662.233710129" watchObservedRunningTime="2026-07-21 20:25:11.301800965 +0000 UTC m=+662.234199122"
Jul 21 20:25:16.392919 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:16.392890    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:25:16.619752 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:16.619720    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:25:16.746775 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:16.746658    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:25:22.244100 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:22.244063    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvbxk"
Jul 21 20:25:22.333514 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:22.333483    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96q82"]
Jul 21 20:25:22.333818 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:22.333792    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96q82" podUID="cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb" containerName="manager" containerID="cri-o://849c44a8519c47ce0f6b25422b1f452d8a40ba1cec3a8a2ad5e4fdb4f336b0a8" gracePeriod=10
Jul 21 20:25:22.583853 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:22.583829    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96q82"
Jul 21 20:25:22.687539 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:22.687502    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:25:22.735951 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:22.735922    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzk8h\" (UniqueName: \"kubernetes.io/projected/cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb-kube-api-access-pzk8h\") pod \"cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb\" (UID: \"cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb\") "
Jul 21 20:25:22.736120 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:22.736040    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb-extensions-socket-volume\") pod \"cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb\" (UID: \"cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb\") "
Jul 21 20:25:22.736579 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:22.736400    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb" (UID: "cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:25:22.743601 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:22.743549    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb-kube-api-access-pzk8h" (OuterVolumeSpecName: "kube-api-access-pzk8h") pod "cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb" (UID: "cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb"). InnerVolumeSpecName "kube-api-access-pzk8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:25:22.829075 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:22.829044    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:25:22.837116 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:22.837091    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb-extensions-socket-volume\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:25:22.837116 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:22.837116    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzk8h\" (UniqueName: \"kubernetes.io/projected/cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb-kube-api-access-pzk8h\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:25:23.296840 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:23.296807    2576 generic.go:356] "Generic (PLEG): container finished" podID="cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb" containerID="849c44a8519c47ce0f6b25422b1f452d8a40ba1cec3a8a2ad5e4fdb4f336b0a8" exitCode=0
Jul 21 20:25:23.297261 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:23.296864    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96q82"
Jul 21 20:25:23.297261 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:23.296895    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96q82" event={"ID":"cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb","Type":"ContainerDied","Data":"849c44a8519c47ce0f6b25422b1f452d8a40ba1cec3a8a2ad5e4fdb4f336b0a8"}
Jul 21 20:25:23.297261 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:23.296978    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96q82" event={"ID":"cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb","Type":"ContainerDied","Data":"79cf99c86398d155f88ef1c56b95e8623cd9fe7023a256bee1014309c30f2d93"}
Jul 21 20:25:23.297261 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:23.297002    2576 scope.go:117] "RemoveContainer" containerID="849c44a8519c47ce0f6b25422b1f452d8a40ba1cec3a8a2ad5e4fdb4f336b0a8"
Jul 21 20:25:23.305585 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:23.305565    2576 scope.go:117] "RemoveContainer" containerID="849c44a8519c47ce0f6b25422b1f452d8a40ba1cec3a8a2ad5e4fdb4f336b0a8"
Jul 21 20:25:23.305913 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:25:23.305893    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"849c44a8519c47ce0f6b25422b1f452d8a40ba1cec3a8a2ad5e4fdb4f336b0a8\": container with ID starting with 849c44a8519c47ce0f6b25422b1f452d8a40ba1cec3a8a2ad5e4fdb4f336b0a8 not found: ID does not exist" containerID="849c44a8519c47ce0f6b25422b1f452d8a40ba1cec3a8a2ad5e4fdb4f336b0a8"
Jul 21 20:25:23.305990 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:23.305922    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"849c44a8519c47ce0f6b25422b1f452d8a40ba1cec3a8a2ad5e4fdb4f336b0a8"} err="failed to get container status \"849c44a8519c47ce0f6b25422b1f452d8a40ba1cec3a8a2ad5e4fdb4f336b0a8\": rpc error: code = NotFound desc = could not find container \"849c44a8519c47ce0f6b25422b1f452d8a40ba1cec3a8a2ad5e4fdb4f336b0a8\": container with ID starting with 849c44a8519c47ce0f6b25422b1f452d8a40ba1cec3a8a2ad5e4fdb4f336b0a8 not found: ID does not exist"
Jul 21 20:25:23.332037 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:23.332002    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96q82"]
Jul 21 20:25:23.339850 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:23.339824    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-96q82"]
Jul 21 20:25:23.651209 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:23.651131    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb" path="/var/lib/kubelet/pods/cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb/volumes"
Jul 21 20:25:25.586444 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:25.586408    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:25:25.692513 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:25.692482    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:25:39.024808 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.024770    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"]
Jul 21 20:25:39.025217 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.025175    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb" containerName="manager"
Jul 21 20:25:39.025217 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.025186    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb" containerName="manager"
Jul 21 20:25:39.025309 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.025256    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd54c28c-6669-4d5c-bbaa-6e3fac93b2fb" containerName="manager"
Jul 21 20:25:39.069030 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.068998    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"]
Jul 21 20:25:39.069185 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.069117    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.073383 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.073365    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-dq6mv\""
Jul 21 20:25:39.082315 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.082293    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1f31d79-4f75-4116-ace5-592dfda94493-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-mblp4\" (UID: \"f1f31d79-4f75-4116-ace5-592dfda94493\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.082420 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.082328    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1f31d79-4f75-4116-ace5-592dfda94493-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mblp4\" (UID: \"f1f31d79-4f75-4116-ace5-592dfda94493\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.082420 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.082348    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lqd8\" (UniqueName: \"kubernetes.io/projected/f1f31d79-4f75-4116-ace5-592dfda94493-kube-api-access-6lqd8\") pod \"maas-default-gateway-openshift-default-56654dcf7-mblp4\" (UID: \"f1f31d79-4f75-4116-ace5-592dfda94493\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.082420 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.082403    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1f31d79-4f75-4116-ace5-592dfda94493-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-mblp4\" (UID: \"f1f31d79-4f75-4116-ace5-592dfda94493\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.082585 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.082476    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1f31d79-4f75-4116-ace5-592dfda94493-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mblp4\" (UID: \"f1f31d79-4f75-4116-ace5-592dfda94493\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.082585 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.082543    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1f31d79-4f75-4116-ace5-592dfda94493-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-mblp4\" (UID: \"f1f31d79-4f75-4116-ace5-592dfda94493\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.082585 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.082577    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1f31d79-4f75-4116-ace5-592dfda94493-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-mblp4\" (UID: \"f1f31d79-4f75-4116-ace5-592dfda94493\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.082725 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.082599    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1f31d79-4f75-4116-ace5-592dfda94493-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-mblp4\" (UID: \"f1f31d79-4f75-4116-ace5-592dfda94493\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.082725 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.082615    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1f31d79-4f75-4116-ace5-592dfda94493-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-mblp4\" (UID: \"f1f31d79-4f75-4116-ace5-592dfda94493\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.134970 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.134939    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:25:39.183378 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.183334    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1f31d79-4f75-4116-ace5-592dfda94493-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mblp4\" (UID: \"f1f31d79-4f75-4116-ace5-592dfda94493\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.183558 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.183418    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1f31d79-4f75-4116-ace5-592dfda94493-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-mblp4\" (UID: \"f1f31d79-4f75-4116-ace5-592dfda94493\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.183558 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.183451    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1f31d79-4f75-4116-ace5-592dfda94493-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-mblp4\" (UID: \"f1f31d79-4f75-4116-ace5-592dfda94493\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.183558 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.183487    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1f31d79-4f75-4116-ace5-592dfda94493-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-mblp4\" (UID: \"f1f31d79-4f75-4116-ace5-592dfda94493\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.183558 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.183514    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1f31d79-4f75-4116-ace5-592dfda94493-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-mblp4\" (UID: \"f1f31d79-4f75-4116-ace5-592dfda94493\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.183558 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.183551    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1f31d79-4f75-4116-ace5-592dfda94493-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-mblp4\" (UID: \"f1f31d79-4f75-4116-ace5-592dfda94493\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.183871 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.183605    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1f31d79-4f75-4116-ace5-592dfda94493-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mblp4\" (UID: \"f1f31d79-4f75-4116-ace5-592dfda94493\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.183871 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.183638    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lqd8\" (UniqueName: \"kubernetes.io/projected/f1f31d79-4f75-4116-ace5-592dfda94493-kube-api-access-6lqd8\") pod \"maas-default-gateway-openshift-default-56654dcf7-mblp4\" (UID: \"f1f31d79-4f75-4116-ace5-592dfda94493\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.183871 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.183675    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1f31d79-4f75-4116-ace5-592dfda94493-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-mblp4\" (UID: \"f1f31d79-4f75-4116-ace5-592dfda94493\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.183871 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.183819    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1f31d79-4f75-4116-ace5-592dfda94493-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mblp4\" (UID: \"f1f31d79-4f75-4116-ace5-592dfda94493\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.184074 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.184035    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1f31d79-4f75-4116-ace5-592dfda94493-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-mblp4\" (UID: \"f1f31d79-4f75-4116-ace5-592dfda94493\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.184129 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.184110    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1f31d79-4f75-4116-ace5-592dfda94493-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-mblp4\" (UID: \"f1f31d79-4f75-4116-ace5-592dfda94493\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.184315 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.184290    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1f31d79-4f75-4116-ace5-592dfda94493-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mblp4\" (UID: \"f1f31d79-4f75-4116-ace5-592dfda94493\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.184649 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.184623    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1f31d79-4f75-4116-ace5-592dfda94493-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-mblp4\" (UID: \"f1f31d79-4f75-4116-ace5-592dfda94493\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.185902 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.185881    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1f31d79-4f75-4116-ace5-592dfda94493-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-mblp4\" (UID: \"f1f31d79-4f75-4116-ace5-592dfda94493\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.186208 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.186187    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1f31d79-4f75-4116-ace5-592dfda94493-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-mblp4\" (UID: \"f1f31d79-4f75-4116-ace5-592dfda94493\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.197899 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.197872    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1f31d79-4f75-4116-ace5-592dfda94493-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-mblp4\" (UID: \"f1f31d79-4f75-4116-ace5-592dfda94493\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.198254 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.198235    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lqd8\" (UniqueName: \"kubernetes.io/projected/f1f31d79-4f75-4116-ace5-592dfda94493-kube-api-access-6lqd8\") pod \"maas-default-gateway-openshift-default-56654dcf7-mblp4\" (UID: \"f1f31d79-4f75-4116-ace5-592dfda94493\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.381555 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.381468    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:39.427916 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.427886    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:25:39.538632 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.538591    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"]
Jul 21 20:25:39.549627 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:25:39.549599    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1f31d79_4f75_4116_ace5_592dfda94493.slice/crio-f6e3475bd1507cef330e42003de9ae4ba56e43102544ae712670b7d76b6abdb8 WatchSource:0}: Error finding container f6e3475bd1507cef330e42003de9ae4ba56e43102544ae712670b7d76b6abdb8: Status 404 returned error can't find the container with id f6e3475bd1507cef330e42003de9ae4ba56e43102544ae712670b7d76b6abdb8
Jul 21 20:25:39.551577 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.551537    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:25:39.551655 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.551616    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:25:39.551655 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:39.551646    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:25:40.384351 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:40.384302    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4" event={"ID":"f1f31d79-4f75-4116-ace5-592dfda94493","Type":"ContainerStarted","Data":"b2faf68ae0512f5a989094df134d7f8ad7b3c639c0a513329cdc6ce169d09a77"}
Jul 21 20:25:40.384865 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:40.384378    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4" event={"ID":"f1f31d79-4f75-4116-ace5-592dfda94493","Type":"ContainerStarted","Data":"f6e3475bd1507cef330e42003de9ae4ba56e43102544ae712670b7d76b6abdb8"}
Jul 21 20:25:40.430729 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:40.430648    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4" podStartSLOduration=2.430628521 podStartE2EDuration="2.430628521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:25:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:25:40.429037235 +0000 UTC m=+691.361435392" watchObservedRunningTime="2026-07-21 20:25:40.430628521 +0000 UTC m=+691.363026677"
Jul 21 20:25:41.381936 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:41.381891    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:41.387310 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:41.387282    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:41.389589 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:41.389568    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:41.390266 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:41.390248    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:25:41.682831 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:41.682719    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:25:41.802341 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:41.802279    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:25:41.911668 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:41.911638    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:25:42.692116 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:42.692086    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:25:42.796168 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:42.796131    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:25:42.885355 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:42.885316    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-j79h2"]
Jul 21 20:25:42.913656 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:42.913624    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-j79h2"]
Jul 21 20:25:42.913860 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:42.913740    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-j79h2"
Jul 21 20:25:42.919129 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:42.919105    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rbd47\""
Jul 21 20:25:42.937856 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:42.937828    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:25:43.018120 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:43.018088    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-996ts\" (UniqueName: \"kubernetes.io/projected/f89ecdea-7f54-4b77-8f21-34eb0dd9144c-kube-api-access-996ts\") pod \"authorino-75d556bd77-j79h2\" (UID: \"f89ecdea-7f54-4b77-8f21-34eb0dd9144c\") " pod="kuadrant-system/authorino-75d556bd77-j79h2"
Jul 21 20:25:43.037395 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:43.037363    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:25:43.118917 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:43.118882    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-996ts\" (UniqueName: \"kubernetes.io/projected/f89ecdea-7f54-4b77-8f21-34eb0dd9144c-kube-api-access-996ts\") pod \"authorino-75d556bd77-j79h2\" (UID: \"f89ecdea-7f54-4b77-8f21-34eb0dd9144c\") " pod="kuadrant-system/authorino-75d556bd77-j79h2"
Jul 21 20:25:43.134455 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:43.134430    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-996ts\" (UniqueName: \"kubernetes.io/projected/f89ecdea-7f54-4b77-8f21-34eb0dd9144c-kube-api-access-996ts\") pod \"authorino-75d556bd77-j79h2\" (UID: \"f89ecdea-7f54-4b77-8f21-34eb0dd9144c\") " pod="kuadrant-system/authorino-75d556bd77-j79h2"
Jul 21 20:25:43.223558 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:43.223524    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-j79h2"
Jul 21 20:25:43.359631 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:43.359604    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-j79h2"]
Jul 21 20:25:43.362299 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:25:43.362272    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf89ecdea_7f54_4b77_8f21_34eb0dd9144c.slice/crio-e71c347f72a4a1505805b377995793f5d572489d4140dc9cd59e1a6f71e25c9f WatchSource:0}: Error finding container e71c347f72a4a1505805b377995793f5d572489d4140dc9cd59e1a6f71e25c9f: Status 404 returned error can't find the container with id e71c347f72a4a1505805b377995793f5d572489d4140dc9cd59e1a6f71e25c9f
Jul 21 20:25:43.364197 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:43.364180    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 20:25:43.399819 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:43.399784    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-j79h2" event={"ID":"f89ecdea-7f54-4b77-8f21-34eb0dd9144c","Type":"ContainerStarted","Data":"e71c347f72a4a1505805b377995793f5d572489d4140dc9cd59e1a6f71e25c9f"}
Jul 21 20:25:47.423902 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:47.423863    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-j79h2" event={"ID":"f89ecdea-7f54-4b77-8f21-34eb0dd9144c","Type":"ContainerStarted","Data":"bd53575370a9230b65e8988e7576a1a54dd2cb55f7d6bfa0f438fd1abc783721"}
Jul 21 20:25:47.441924 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:25:47.441855    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-j79h2" podStartSLOduration=2.293159747 podStartE2EDuration="5.441839868s" totalImagesPullingTime="3.148680121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:25:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:25:47.439931445 +0000 UTC m=+698.372329614" watchObservedRunningTime="2026-07-21 20:25:47.441839868 +0000 UTC m=+698.374238024"
Jul 21 20:26:02.954201 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:02.954125    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:26:03.085251 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:03.085215    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:26:03.547144 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:03.547113    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:26:16.371206 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:16.371174    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:26:16.503487 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:16.503451    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:26:17.211328 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:17.211289    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-cbbb7849d-q62sh"]
Jul 21 20:26:17.216515 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:17.216492    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cbbb7849d-q62sh"
Jul 21 20:26:17.227326 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:17.227304    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 21 20:26:17.249511 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:17.249454    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c1e2b150-3dde-4d87-8612-0afee0b3738c-tls-cert\") pod \"authorino-cbbb7849d-q62sh\" (UID: \"c1e2b150-3dde-4d87-8612-0afee0b3738c\") " pod="kuadrant-system/authorino-cbbb7849d-q62sh"
Jul 21 20:26:17.249733 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:17.249559    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbmb8\" (UniqueName: \"kubernetes.io/projected/c1e2b150-3dde-4d87-8612-0afee0b3738c-kube-api-access-dbmb8\") pod \"authorino-cbbb7849d-q62sh\" (UID: \"c1e2b150-3dde-4d87-8612-0afee0b3738c\") " pod="kuadrant-system/authorino-cbbb7849d-q62sh"
Jul 21 20:26:17.290665 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:17.290624    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cbbb7849d-q62sh"]
Jul 21 20:26:17.350957 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:17.350922    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbmb8\" (UniqueName: \"kubernetes.io/projected/c1e2b150-3dde-4d87-8612-0afee0b3738c-kube-api-access-dbmb8\") pod \"authorino-cbbb7849d-q62sh\" (UID: \"c1e2b150-3dde-4d87-8612-0afee0b3738c\") " pod="kuadrant-system/authorino-cbbb7849d-q62sh"
Jul 21 20:26:17.351136 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:17.351027    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c1e2b150-3dde-4d87-8612-0afee0b3738c-tls-cert\") pod \"authorino-cbbb7849d-q62sh\" (UID: \"c1e2b150-3dde-4d87-8612-0afee0b3738c\") " pod="kuadrant-system/authorino-cbbb7849d-q62sh"
Jul 21 20:26:17.353520 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:17.353495    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c1e2b150-3dde-4d87-8612-0afee0b3738c-tls-cert\") pod \"authorino-cbbb7849d-q62sh\" (UID: \"c1e2b150-3dde-4d87-8612-0afee0b3738c\") " pod="kuadrant-system/authorino-cbbb7849d-q62sh"
Jul 21 20:26:17.366180 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:17.366148    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbmb8\" (UniqueName: \"kubernetes.io/projected/c1e2b150-3dde-4d87-8612-0afee0b3738c-kube-api-access-dbmb8\") pod \"authorino-cbbb7849d-q62sh\" (UID: \"c1e2b150-3dde-4d87-8612-0afee0b3738c\") " pod="kuadrant-system/authorino-cbbb7849d-q62sh"
Jul 21 20:26:17.526162 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:17.526123    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cbbb7849d-q62sh"
Jul 21 20:26:17.668162 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:17.668129    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cbbb7849d-q62sh"]
Jul 21 20:26:17.669778 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:26:17.669746    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1e2b150_3dde_4d87_8612_0afee0b3738c.slice/crio-fca6b98feee1c9424ad28c92010075ef7e81edf0ff84d783bb80ab4e60a75cc3 WatchSource:0}: Error finding container fca6b98feee1c9424ad28c92010075ef7e81edf0ff84d783bb80ab4e60a75cc3: Status 404 returned error can't find the container with id fca6b98feee1c9424ad28c92010075ef7e81edf0ff84d783bb80ab4e60a75cc3
Jul 21 20:26:18.579641 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:18.579600    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cbbb7849d-q62sh" event={"ID":"c1e2b150-3dde-4d87-8612-0afee0b3738c","Type":"ContainerStarted","Data":"413f82f857a0e4bf2c9d4ca98a346c4730c8d5da231211db025bd7eab8deb086"}
Jul 21 20:26:18.580051 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:18.579652    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cbbb7849d-q62sh" event={"ID":"c1e2b150-3dde-4d87-8612-0afee0b3738c","Type":"ContainerStarted","Data":"fca6b98feee1c9424ad28c92010075ef7e81edf0ff84d783bb80ab4e60a75cc3"}
Jul 21 20:26:18.600029 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:18.599972    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-cbbb7849d-q62sh" podStartSLOduration=1.200990572 podStartE2EDuration="1.59995419s" totalImagesPullingTime="398.963618ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:26:18.598487647 +0000 UTC m=+729.530885807" watchObservedRunningTime="2026-07-21 20:26:18.59995419 +0000 UTC m=+729.532352347"
Jul 21 20:26:18.639129 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:18.639093    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-j79h2"]
Jul 21 20:26:18.639370 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:18.639334    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-j79h2" podUID="f89ecdea-7f54-4b77-8f21-34eb0dd9144c" containerName="authorino" containerID="cri-o://bd53575370a9230b65e8988e7576a1a54dd2cb55f7d6bfa0f438fd1abc783721" gracePeriod=30
Jul 21 20:26:18.921450 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:18.921415    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-j79h2"
Jul 21 20:26:18.965882 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:18.965848    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-996ts\" (UniqueName: \"kubernetes.io/projected/f89ecdea-7f54-4b77-8f21-34eb0dd9144c-kube-api-access-996ts\") pod \"f89ecdea-7f54-4b77-8f21-34eb0dd9144c\" (UID: \"f89ecdea-7f54-4b77-8f21-34eb0dd9144c\") "
Jul 21 20:26:18.968076 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:18.968039    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f89ecdea-7f54-4b77-8f21-34eb0dd9144c-kube-api-access-996ts" (OuterVolumeSpecName: "kube-api-access-996ts") pod "f89ecdea-7f54-4b77-8f21-34eb0dd9144c" (UID: "f89ecdea-7f54-4b77-8f21-34eb0dd9144c"). InnerVolumeSpecName "kube-api-access-996ts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:26:19.067229 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:19.067193    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-996ts\" (UniqueName: \"kubernetes.io/projected/f89ecdea-7f54-4b77-8f21-34eb0dd9144c-kube-api-access-996ts\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:26:19.586085 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:19.586049    2576 generic.go:356] "Generic (PLEG): container finished" podID="f89ecdea-7f54-4b77-8f21-34eb0dd9144c" containerID="bd53575370a9230b65e8988e7576a1a54dd2cb55f7d6bfa0f438fd1abc783721" exitCode=0
Jul 21 20:26:19.586535 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:19.586091    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-j79h2"
Jul 21 20:26:19.586535 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:19.586132    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-j79h2" event={"ID":"f89ecdea-7f54-4b77-8f21-34eb0dd9144c","Type":"ContainerDied","Data":"bd53575370a9230b65e8988e7576a1a54dd2cb55f7d6bfa0f438fd1abc783721"}
Jul 21 20:26:19.586535 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:19.586174    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-j79h2" event={"ID":"f89ecdea-7f54-4b77-8f21-34eb0dd9144c","Type":"ContainerDied","Data":"e71c347f72a4a1505805b377995793f5d572489d4140dc9cd59e1a6f71e25c9f"}
Jul 21 20:26:19.586535 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:19.586191    2576 scope.go:117] "RemoveContainer" containerID="bd53575370a9230b65e8988e7576a1a54dd2cb55f7d6bfa0f438fd1abc783721"
Jul 21 20:26:19.595140 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:19.595123    2576 scope.go:117] "RemoveContainer" containerID="bd53575370a9230b65e8988e7576a1a54dd2cb55f7d6bfa0f438fd1abc783721"
Jul 21 20:26:19.595432 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:26:19.595414    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd53575370a9230b65e8988e7576a1a54dd2cb55f7d6bfa0f438fd1abc783721\": container with ID starting with bd53575370a9230b65e8988e7576a1a54dd2cb55f7d6bfa0f438fd1abc783721 not found: ID does not exist" containerID="bd53575370a9230b65e8988e7576a1a54dd2cb55f7d6bfa0f438fd1abc783721"
Jul 21 20:26:19.595484 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:19.595441    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd53575370a9230b65e8988e7576a1a54dd2cb55f7d6bfa0f438fd1abc783721"} err="failed to get container status \"bd53575370a9230b65e8988e7576a1a54dd2cb55f7d6bfa0f438fd1abc783721\": rpc error: code = NotFound desc = could not find container \"bd53575370a9230b65e8988e7576a1a54dd2cb55f7d6bfa0f438fd1abc783721\": container with ID starting with bd53575370a9230b65e8988e7576a1a54dd2cb55f7d6bfa0f438fd1abc783721 not found: ID does not exist"
Jul 21 20:26:19.636403 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:19.636370    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-j79h2"]
Jul 21 20:26:19.651842 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:19.651816    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-j79h2"]
Jul 21 20:26:21.651459 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:21.651423    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f89ecdea-7f54-4b77-8f21-34eb0dd9144c" path="/var/lib/kubelet/pods/f89ecdea-7f54-4b77-8f21-34eb0dd9144c/volumes"
Jul 21 20:26:23.546284 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:23.546239    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:26:23.676437 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:23.676400    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:26:23.820621 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:23.820529    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:26:26.891429 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:26.891381    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:26:27.008291 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:27.008259    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:26:53.605048 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:53.605011    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:26:57.031142 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:57.031102    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:26:57.137748 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:57.137668    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:26:57.587123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:57.587092    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:26:57.692215 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:57.692184    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:26:58.237586 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:58.237553    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:26:58.337007 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:26:58.336971    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:27:06.829474 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:06.829442    2576 generic.go:356] "Generic (PLEG): container finished" podID="f1f31d79-4f75-4116-ace5-592dfda94493" containerID="b2faf68ae0512f5a989094df134d7f8ad7b3c639c0a513329cdc6ce169d09a77" exitCode=0
Jul 21 20:27:06.829954 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:06.829523    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4" event={"ID":"f1f31d79-4f75-4116-ace5-592dfda94493","Type":"ContainerDied","Data":"b2faf68ae0512f5a989094df134d7f8ad7b3c639c0a513329cdc6ce169d09a77"}
Jul 21 20:27:06.829954 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:06.829936    2576 scope.go:117] "RemoveContainer" containerID="b2faf68ae0512f5a989094df134d7f8ad7b3c639c0a513329cdc6ce169d09a77"
Jul 21 20:27:06.830923 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:06.830894    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:27:06.831007 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:06.830959    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:27:06.831007 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:06.830994    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:27:07.840779 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:07.840742    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4" event={"ID":"f1f31d79-4f75-4116-ace5-592dfda94493","Type":"ContainerStarted","Data":"056fedc0b3807e735563489d4722133428df573c000bb2e619fecfb103784c84"}
Jul 21 20:27:08.264485 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:08.264455    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:27:08.376133 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:08.376093    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:27:08.382514 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:08.382487    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:27:08.383778 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:08.383755    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mblp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 21 20:27:08.383881 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:08.383803    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4" podUID="f1f31d79-4f75-4116-ace5-592dfda94493" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 21 20:27:09.381931 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:09.381890    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mblp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 21 20:27:09.382346 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:09.381949    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4" podUID="f1f31d79-4f75-4116-ace5-592dfda94493" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 21 20:27:10.382650 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:10.382616    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mblp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 21 20:27:10.383144 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:10.382721    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4" podUID="f1f31d79-4f75-4116-ace5-592dfda94493" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 21 20:27:11.382218 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:11.382178    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mblp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 21 20:27:11.382410 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:11.382254    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4" podUID="f1f31d79-4f75-4116-ace5-592dfda94493" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 21 20:27:11.390339 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:11.390310    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:27:12.386317 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:12.386287    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:27:12.387351 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:12.387327    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mblp4"
Jul 21 20:27:12.456680 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:12.456648    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:27:23.150328 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:23.150291    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:27:34.082430 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.082346    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr"]
Jul 21 20:27:34.082936 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.082747    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f89ecdea-7f54-4b77-8f21-34eb0dd9144c" containerName="authorino"
Jul 21 20:27:34.082936 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.082761    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f89ecdea-7f54-4b77-8f21-34eb0dd9144c" containerName="authorino"
Jul 21 20:27:34.082936 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.082816    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f89ecdea-7f54-4b77-8f21-34eb0dd9144c" containerName="authorino"
Jul 21 20:27:34.084823 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.084803    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr"
Jul 21 20:27:34.087621 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.087596    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 21 20:27:34.087786 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.087641    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 21 20:27:34.088458 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.088428    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 21 20:27:34.088565 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.088468    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sn7s4\""
Jul 21 20:27:34.102065 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.102037    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr"]
Jul 21 20:27:34.119603 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.119562    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:27:34.181936 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.181899    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xbcqr\" (UID: \"e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr"
Jul 21 20:27:34.182134 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.181966    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xbcqr\" (UID: \"e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr"
Jul 21 20:27:34.182134 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.182043    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xbcqr\" (UID: \"e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr"
Jul 21 20:27:34.182134 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.182086    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr97b\" (UniqueName: \"kubernetes.io/projected/e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1-kube-api-access-zr97b\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xbcqr\" (UID: \"e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr"
Jul 21 20:27:34.182134 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.182124    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xbcqr\" (UID: \"e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr"
Jul 21 20:27:34.182334 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.182197    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xbcqr\" (UID: \"e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr"
Jul 21 20:27:34.283357 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.283316    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xbcqr\" (UID: \"e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr"
Jul 21 20:27:34.283357 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.283357    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xbcqr\" (UID: \"e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr"
Jul 21 20:27:34.283632 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.283373    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr97b\" (UniqueName: \"kubernetes.io/projected/e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1-kube-api-access-zr97b\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xbcqr\" (UID: \"e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr"
Jul 21 20:27:34.283632 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.283397    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xbcqr\" (UID: \"e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr"
Jul 21 20:27:34.283632 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.283442    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xbcqr\" (UID: \"e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr"
Jul 21 20:27:34.283632 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.283495    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xbcqr\" (UID: \"e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr"
Jul 21 20:27:34.283911 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.283844    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xbcqr\" (UID: \"e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr"
Jul 21 20:27:34.283971 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.283922    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xbcqr\" (UID: \"e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr"
Jul 21 20:27:34.284008 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.283982    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xbcqr\" (UID: \"e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr"
Jul 21 20:27:34.285808 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.285790    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xbcqr\" (UID: \"e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr"
Jul 21 20:27:34.285968 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.285953    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xbcqr\" (UID: \"e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr"
Jul 21 20:27:34.295933 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.295904    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr97b\" (UniqueName: \"kubernetes.io/projected/e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1-kube-api-access-zr97b\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xbcqr\" (UID: \"e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr"
Jul 21 20:27:34.395885 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.395802    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr"
Jul 21 20:27:34.536956 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.536930    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr"]
Jul 21 20:27:34.538944 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:27:34.538917    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3d2a55a_0560_4afc_b9ac_cf7e363c4cb1.slice/crio-8d30b870db4dd6853e54f56c7e1a45539f976294a8c83f27e2dddb1d5e148e02 WatchSource:0}: Error finding container 8d30b870db4dd6853e54f56c7e1a45539f976294a8c83f27e2dddb1d5e148e02: Status 404 returned error can't find the container with id 8d30b870db4dd6853e54f56c7e1a45539f976294a8c83f27e2dddb1d5e148e02
Jul 21 20:27:34.982479 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:34.982435    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr" event={"ID":"e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1","Type":"ContainerStarted","Data":"8d30b870db4dd6853e54f56c7e1a45539f976294a8c83f27e2dddb1d5e148e02"}
Jul 21 20:27:35.989345 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:35.989263    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr" event={"ID":"e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1","Type":"ContainerStarted","Data":"ea6c5021ceeae3deccfd6108c98ac9e50b4607bd866e91b5618d9e553111a1bb"}
Jul 21 20:27:36.010295 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:36.010239    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr" podStartSLOduration=1.030403204 podStartE2EDuration="2.010220633s" totalImagesPullingTime="979.817429ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:27:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:27:36.008612982 +0000 UTC m=+806.941011139" watchObservedRunningTime="2026-07-21 20:27:36.010220633 +0000 UTC m=+806.942618789"
Jul 21 20:27:39.418880 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:39.418846    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:27:44.396468 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:44.396424    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr"
Jul 21 20:27:44.397015 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:44.396538    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr"
Jul 21 20:27:44.409205 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:44.409177    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr"
Jul 21 20:27:45.045601 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:45.045571    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xbcqr"
Jul 21 20:27:58.895489 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:58.895451    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8"]
Jul 21 20:27:58.898107 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:58.898085    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8"
Jul 21 20:27:58.902599 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:58.902578    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 21 20:27:58.912992 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:58.912968    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8"]
Jul 21 20:27:58.942975 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:58.942941    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:27:59.012019 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:59.011982    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e882580-1e73-4620-b33e-a9b535cdad5c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7mb8\" (UID: \"6e882580-1e73-4620-b33e-a9b535cdad5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8"
Jul 21 20:27:59.012224 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:59.012111    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e882580-1e73-4620-b33e-a9b535cdad5c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7mb8\" (UID: \"6e882580-1e73-4620-b33e-a9b535cdad5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8"
Jul 21 20:27:59.012224 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:59.012181    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e882580-1e73-4620-b33e-a9b535cdad5c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7mb8\" (UID: \"6e882580-1e73-4620-b33e-a9b535cdad5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8"
Jul 21 20:27:59.012324 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:59.012222    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e882580-1e73-4620-b33e-a9b535cdad5c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7mb8\" (UID: \"6e882580-1e73-4620-b33e-a9b535cdad5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8"
Jul 21 20:27:59.012324 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:59.012253    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e882580-1e73-4620-b33e-a9b535cdad5c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7mb8\" (UID: \"6e882580-1e73-4620-b33e-a9b535cdad5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8"
Jul 21 20:27:59.012324 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:59.012269    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp7sw\" (UniqueName: \"kubernetes.io/projected/6e882580-1e73-4620-b33e-a9b535cdad5c-kube-api-access-fp7sw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7mb8\" (UID: \"6e882580-1e73-4620-b33e-a9b535cdad5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8"
Jul 21 20:27:59.113280 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:59.113250    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e882580-1e73-4620-b33e-a9b535cdad5c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7mb8\" (UID: \"6e882580-1e73-4620-b33e-a9b535cdad5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8"
Jul 21 20:27:59.113502 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:59.113308    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e882580-1e73-4620-b33e-a9b535cdad5c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7mb8\" (UID: \"6e882580-1e73-4620-b33e-a9b535cdad5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8"
Jul 21 20:27:59.113502 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:59.113332    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e882580-1e73-4620-b33e-a9b535cdad5c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7mb8\" (UID: \"6e882580-1e73-4620-b33e-a9b535cdad5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8"
Jul 21 20:27:59.113502 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:59.113353    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e882580-1e73-4620-b33e-a9b535cdad5c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7mb8\" (UID: \"6e882580-1e73-4620-b33e-a9b535cdad5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8"
Jul 21 20:27:59.113502 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:59.113374    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp7sw\" (UniqueName: \"kubernetes.io/projected/6e882580-1e73-4620-b33e-a9b535cdad5c-kube-api-access-fp7sw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7mb8\" (UID: \"6e882580-1e73-4620-b33e-a9b535cdad5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8"
Jul 21 20:27:59.113502 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:59.113412    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e882580-1e73-4620-b33e-a9b535cdad5c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7mb8\" (UID: \"6e882580-1e73-4620-b33e-a9b535cdad5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8"
Jul 21 20:27:59.113756 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:59.113713    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e882580-1e73-4620-b33e-a9b535cdad5c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7mb8\" (UID: \"6e882580-1e73-4620-b33e-a9b535cdad5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8"
Jul 21 20:27:59.113885 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:59.113867    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e882580-1e73-4620-b33e-a9b535cdad5c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7mb8\" (UID: \"6e882580-1e73-4620-b33e-a9b535cdad5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8"
Jul 21 20:27:59.113929 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:59.113904    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e882580-1e73-4620-b33e-a9b535cdad5c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7mb8\" (UID: \"6e882580-1e73-4620-b33e-a9b535cdad5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8"
Jul 21 20:27:59.115768 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:59.115744    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e882580-1e73-4620-b33e-a9b535cdad5c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7mb8\" (UID: \"6e882580-1e73-4620-b33e-a9b535cdad5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8"
Jul 21 20:27:59.115929 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:59.115913    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e882580-1e73-4620-b33e-a9b535cdad5c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7mb8\" (UID: \"6e882580-1e73-4620-b33e-a9b535cdad5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8"
Jul 21 20:27:59.123082 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:59.123054    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp7sw\" (UniqueName: \"kubernetes.io/projected/6e882580-1e73-4620-b33e-a9b535cdad5c-kube-api-access-fp7sw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-n7mb8\" (UID: \"6e882580-1e73-4620-b33e-a9b535cdad5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8"
Jul 21 20:27:59.208337 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:59.208234    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8"
Jul 21 20:27:59.346416 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:27:59.346380    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8"]
Jul 21 20:27:59.348713 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:27:59.348669    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e882580_1e73_4620_b33e_a9b535cdad5c.slice/crio-f66afdd43a613226c008458ccd18bd5f7a7dfd061abe946437d0495ed4ab5502 WatchSource:0}: Error finding container f66afdd43a613226c008458ccd18bd5f7a7dfd061abe946437d0495ed4ab5502: Status 404 returned error can't find the container with id f66afdd43a613226c008458ccd18bd5f7a7dfd061abe946437d0495ed4ab5502
Jul 21 20:28:00.117358 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:28:00.117325    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8" event={"ID":"6e882580-1e73-4620-b33e-a9b535cdad5c","Type":"ContainerStarted","Data":"0533c68074a03ba5c70d954b900b56f3331a5d1f530ba932010e193e8b080f41"}
Jul 21 20:28:00.117765 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:28:00.117375    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8" event={"ID":"6e882580-1e73-4620-b33e-a9b535cdad5c","Type":"ContainerStarted","Data":"f66afdd43a613226c008458ccd18bd5f7a7dfd061abe946437d0495ed4ab5502"}
Jul 21 20:28:00.138955 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:28:00.138895    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8" podStartSLOduration=1.940297534 podStartE2EDuration="2.138872923s" totalImagesPullingTime="198.575389ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:27:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:28:00.137302061 +0000 UTC m=+831.069700232" watchObservedRunningTime="2026-07-21 20:28:00.138872923 +0000 UTC m=+831.071271061"
Jul 21 20:28:09.209046 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:28:09.209012    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8"
Jul 21 20:28:09.209569 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:28:09.209073    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8"
Jul 21 20:28:09.222342 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:28:09.222314    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8"
Jul 21 20:28:10.180130 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:28:10.180099    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-n7mb8"
Jul 21 20:28:26.424472 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:28:26.424433    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:29:09.529179 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:29:09.529091    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w885b_62db291a-14b7-4e35-9550-9fb810f82b8d/console-operator/1.log"
Jul 21 20:29:09.531191 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:29:09.531168    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w885b_62db291a-14b7-4e35-9550-9fb810f82b8d/console-operator/1.log"
Jul 21 20:29:09.536780 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:29:09.536753    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-54f9x_55f51c26-71cd-4e1b-84f2-32f2de4138d5/ovn-acl-logging/0.log"
Jul 21 20:29:09.538378 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:29:09.538360    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-54f9x_55f51c26-71cd-4e1b-84f2-32f2de4138d5/ovn-acl-logging/0.log"
Jul 21 20:29:29.936826 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:29:29.936793    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:29:30.034274 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:29:30.034245    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:29:31.192825 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:29:31.192761    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:29:31.215591 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:29:31.215559    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cbbb7849d-q62sh"]
Jul 21 20:29:31.215795 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:29:31.215761    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-cbbb7849d-q62sh" podUID="c1e2b150-3dde-4d87-8612-0afee0b3738c" containerName="authorino" containerID="cri-o://413f82f857a0e4bf2c9d4ca98a346c4730c8d5da231211db025bd7eab8deb086" gracePeriod=30
Jul 21 20:29:31.488068 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:29:31.488041    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cbbb7849d-q62sh"
Jul 21 20:29:31.546823 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:29:31.546791    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:29:31.586022 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:29:31.585991    2576 generic.go:356] "Generic (PLEG): container finished" podID="c1e2b150-3dde-4d87-8612-0afee0b3738c" containerID="413f82f857a0e4bf2c9d4ca98a346c4730c8d5da231211db025bd7eab8deb086" exitCode=0
Jul 21 20:29:31.586202 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:29:31.586051    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cbbb7849d-q62sh"
Jul 21 20:29:31.586202 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:29:31.586054    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cbbb7849d-q62sh" event={"ID":"c1e2b150-3dde-4d87-8612-0afee0b3738c","Type":"ContainerDied","Data":"413f82f857a0e4bf2c9d4ca98a346c4730c8d5da231211db025bd7eab8deb086"}
Jul 21 20:29:31.586202 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:29:31.586164    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cbbb7849d-q62sh" event={"ID":"c1e2b150-3dde-4d87-8612-0afee0b3738c","Type":"ContainerDied","Data":"fca6b98feee1c9424ad28c92010075ef7e81edf0ff84d783bb80ab4e60a75cc3"}
Jul 21 20:29:31.586202 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:29:31.586182    2576 scope.go:117] "RemoveContainer" containerID="413f82f857a0e4bf2c9d4ca98a346c4730c8d5da231211db025bd7eab8deb086"
Jul 21 20:29:31.593342 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:29:31.593318    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbmb8\" (UniqueName: \"kubernetes.io/projected/c1e2b150-3dde-4d87-8612-0afee0b3738c-kube-api-access-dbmb8\") pod \"c1e2b150-3dde-4d87-8612-0afee0b3738c\" (UID: \"c1e2b150-3dde-4d87-8612-0afee0b3738c\") "
Jul 21 20:29:31.593495 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:29:31.593386    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c1e2b150-3dde-4d87-8612-0afee0b3738c-tls-cert\") pod \"c1e2b150-3dde-4d87-8612-0afee0b3738c\" (UID: \"c1e2b150-3dde-4d87-8612-0afee0b3738c\") "
Jul 21 20:29:31.595116 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:29:31.595088    2576 scope.go:117] "RemoveContainer" containerID="413f82f857a0e4bf2c9d4ca98a346c4730c8d5da231211db025bd7eab8deb086"
Jul 21 20:29:31.595407 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:29:31.595387    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"413f82f857a0e4bf2c9d4ca98a346c4730c8d5da231211db025bd7eab8deb086\": container with ID starting with 413f82f857a0e4bf2c9d4ca98a346c4730c8d5da231211db025bd7eab8deb086 not found: ID does not exist" containerID="413f82f857a0e4bf2c9d4ca98a346c4730c8d5da231211db025bd7eab8deb086"
Jul 21 20:29:31.595502 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:29:31.595418    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"413f82f857a0e4bf2c9d4ca98a346c4730c8d5da231211db025bd7eab8deb086"} err="failed to get container status \"413f82f857a0e4bf2c9d4ca98a346c4730c8d5da231211db025bd7eab8deb086\": rpc error: code = NotFound desc = could not find container \"413f82f857a0e4bf2c9d4ca98a346c4730c8d5da231211db025bd7eab8deb086\": container with ID starting with 413f82f857a0e4bf2c9d4ca98a346c4730c8d5da231211db025bd7eab8deb086 not found: ID does not exist"
Jul 21 20:29:31.595574 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:29:31.595553    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1e2b150-3dde-4d87-8612-0afee0b3738c-kube-api-access-dbmb8" (OuterVolumeSpecName: "kube-api-access-dbmb8") pod "c1e2b150-3dde-4d87-8612-0afee0b3738c" (UID: "c1e2b150-3dde-4d87-8612-0afee0b3738c"). InnerVolumeSpecName "kube-api-access-dbmb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:29:31.604506 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:29:31.604477    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1e2b150-3dde-4d87-8612-0afee0b3738c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c1e2b150-3dde-4d87-8612-0afee0b3738c" (UID: "c1e2b150-3dde-4d87-8612-0afee0b3738c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:29:31.694350 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:29:31.694316    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbmb8\" (UniqueName: \"kubernetes.io/projected/c1e2b150-3dde-4d87-8612-0afee0b3738c-kube-api-access-dbmb8\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:29:31.694350 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:29:31.694341    2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c1e2b150-3dde-4d87-8612-0afee0b3738c-tls-cert\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:29:31.929607 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:29:31.929563    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cbbb7849d-q62sh"]
Jul 21 20:29:31.953010 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:29:31.952973    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-cbbb7849d-q62sh"]
Jul 21 20:29:33.651556 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:29:33.651520    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1e2b150-3dde-4d87-8612-0afee0b3738c" path="/var/lib/kubelet/pods/c1e2b150-3dde-4d87-8612-0afee0b3738c/volumes"
Jul 21 20:30:00.158968 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:30:00.158931    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744430-92bpg"]
Jul 21 20:30:00.159449 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:30:00.159389    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1e2b150-3dde-4d87-8612-0afee0b3738c" containerName="authorino"
Jul 21 20:30:00.159449 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:30:00.159402    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1e2b150-3dde-4d87-8612-0afee0b3738c" containerName="authorino"
Jul 21 20:30:00.159527 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:30:00.159469    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1e2b150-3dde-4d87-8612-0afee0b3738c" containerName="authorino"
Jul 21 20:30:00.162590 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:30:00.162573    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744430-92bpg"
Jul 21 20:30:00.165645 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:30:00.165618    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kvpgn\""
Jul 21 20:30:00.173538 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:30:00.173509    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744430-92bpg"]
Jul 21 20:30:00.174567 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:30:00.174530    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744430-92bpg"
Jul 21 20:30:00.316133 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:30:00.316107    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744430-92bpg"]
Jul 21 20:30:00.317864 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:30:00.317838    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb671a4f5_b9bc_47f7_a7f3_28c9771b5401.slice/crio-38aac7b5180ec95a5a3cdfb496a2d6e09b446a316aee91fc2284bf875336c8ae WatchSource:0}: Error finding container 38aac7b5180ec95a5a3cdfb496a2d6e09b446a316aee91fc2284bf875336c8ae: Status 404 returned error can't find the container with id 38aac7b5180ec95a5a3cdfb496a2d6e09b446a316aee91fc2284bf875336c8ae
Jul 21 20:30:00.738438 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:30:00.738406    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744430-92bpg" event={"ID":"b671a4f5-b9bc-47f7-a7f3-28c9771b5401","Type":"ContainerStarted","Data":"38aac7b5180ec95a5a3cdfb496a2d6e09b446a316aee91fc2284bf875336c8ae"}
Jul 21 20:30:04.762124 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:30:04.762087    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744430-92bpg" event={"ID":"b671a4f5-b9bc-47f7-a7f3-28c9771b5401","Type":"ContainerStarted","Data":"7a4e79f7512627a1148c6d694538ecd32d9dd061d1f5f119d45e199794678f9e"}
Jul 21 20:30:04.779203 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:30:04.779101    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744430-92bpg" podStartSLOduration=0.848143939 podStartE2EDuration="4.779082877s" totalImagesPullingTime="3.930938938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:30:04.778152605 +0000 UTC m=+955.710550764" watchObservedRunningTime="2026-07-21 20:30:04.779082877 +0000 UTC m=+955.711481035"
Jul 21 20:30:05.768662 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:30:05.768624    2576 generic.go:356] "Generic (PLEG): container finished" podID="b671a4f5-b9bc-47f7-a7f3-28c9771b5401" containerID="7a4e79f7512627a1148c6d694538ecd32d9dd061d1f5f119d45e199794678f9e" exitCode=0
Jul 21 20:30:05.769143 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:30:05.768718    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744430-92bpg" event={"ID":"b671a4f5-b9bc-47f7-a7f3-28c9771b5401","Type":"ContainerDied","Data":"7a4e79f7512627a1148c6d694538ecd32d9dd061d1f5f119d45e199794678f9e"}
Jul 21 20:30:06.923522 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:30:06.923496    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744430-92bpg"
Jul 21 20:30:07.779871 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:30:07.779841    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744430-92bpg"
Jul 21 20:30:07.780041 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:30:07.779834    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744430-92bpg" event={"ID":"b671a4f5-b9bc-47f7-a7f3-28c9771b5401","Type":"ContainerDied","Data":"38aac7b5180ec95a5a3cdfb496a2d6e09b446a316aee91fc2284bf875336c8ae"}
Jul 21 20:30:07.780041 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:30:07.779973    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38aac7b5180ec95a5a3cdfb496a2d6e09b446a316aee91fc2284bf875336c8ae"
Jul 21 20:30:30.468637 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:30:30.468599    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:31:36.759045 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:31:36.759012    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:31:37.992548 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:31:37.992513    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:32:01.525048 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:32:01.524908    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:32:18.445839 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:32:18.445804    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:32:18.573740 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:32:18.573671    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:32:18.693013 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:32:18.692979    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:32:22.706739 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:32:22.706680    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:32:22.770873 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:32:22.770844    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:32:24.793601 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:32:24.793568    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:32:24.912498 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:32:24.912469    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:32:25.027260 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:32:25.027227    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:32:25.173749 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:32:25.173653    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:32:26.603127 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:32:26.603099    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:32:26.705588 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:32:26.705558    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:32:31.185475 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:32:31.185444    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:32:31.282867 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:32:31.282835    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:32:40.138573 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:32:40.138535    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:33:43.504539 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:33:43.504445    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:33:44.862846 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:33:44.862817    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:34:09.560797 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:34:09.560766    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w885b_62db291a-14b7-4e35-9550-9fb810f82b8d/console-operator/1.log"
Jul 21 20:34:09.566253 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:34:09.566226    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w885b_62db291a-14b7-4e35-9550-9fb810f82b8d/console-operator/1.log"
Jul 21 20:34:09.567953 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:34:09.567919    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-54f9x_55f51c26-71cd-4e1b-84f2-32f2de4138d5/ovn-acl-logging/0.log"
Jul 21 20:34:09.572983 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:34:09.572958    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-54f9x_55f51c26-71cd-4e1b-84f2-32f2de4138d5/ovn-acl-logging/0.log"
Jul 21 20:34:22.864949 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:34:22.864910    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:36:33.366750 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:36:33.366648    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvbxk"]
Jul 21 20:36:33.367298 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:36:33.366891    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvbxk" podUID="5e2f37a2-29d0-4645-b9d2-da9a86a333ed" containerName="manager" containerID="cri-o://f455f7ccbec0ddb66712ff4db54d37cef4174bc9c361c229db68494f015c07e9" gracePeriod=10
Jul 21 20:36:36.761490 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:36:36.761453    2576 generic.go:356] "Generic (PLEG): container finished" podID="5e2f37a2-29d0-4645-b9d2-da9a86a333ed" containerID="f455f7ccbec0ddb66712ff4db54d37cef4174bc9c361c229db68494f015c07e9" exitCode=0
Jul 21 20:36:36.761973 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:36:36.761507    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvbxk" event={"ID":"5e2f37a2-29d0-4645-b9d2-da9a86a333ed","Type":"ContainerDied","Data":"f455f7ccbec0ddb66712ff4db54d37cef4174bc9c361c229db68494f015c07e9"}
Jul 21 20:36:36.825904 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:36:36.825881    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvbxk"
Jul 21 20:36:36.896537 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:36:36.896452    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pp2w2\" (UniqueName: \"kubernetes.io/projected/5e2f37a2-29d0-4645-b9d2-da9a86a333ed-kube-api-access-pp2w2\") pod \"5e2f37a2-29d0-4645-b9d2-da9a86a333ed\" (UID: \"5e2f37a2-29d0-4645-b9d2-da9a86a333ed\") "
Jul 21 20:36:36.896705 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:36:36.896562    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e2f37a2-29d0-4645-b9d2-da9a86a333ed-extensions-socket-volume\") pod \"5e2f37a2-29d0-4645-b9d2-da9a86a333ed\" (UID: \"5e2f37a2-29d0-4645-b9d2-da9a86a333ed\") "
Jul 21 20:36:36.896940 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:36:36.896918    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e2f37a2-29d0-4645-b9d2-da9a86a333ed-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5e2f37a2-29d0-4645-b9d2-da9a86a333ed" (UID: "5e2f37a2-29d0-4645-b9d2-da9a86a333ed"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:36:36.898468 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:36:36.898450    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e2f37a2-29d0-4645-b9d2-da9a86a333ed-kube-api-access-pp2w2" (OuterVolumeSpecName: "kube-api-access-pp2w2") pod "5e2f37a2-29d0-4645-b9d2-da9a86a333ed" (UID: "5e2f37a2-29d0-4645-b9d2-da9a86a333ed"). InnerVolumeSpecName "kube-api-access-pp2w2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:36:36.998170 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:36:36.998134    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e2f37a2-29d0-4645-b9d2-da9a86a333ed-extensions-socket-volume\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:36:36.998170 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:36:36.998166    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pp2w2\" (UniqueName: \"kubernetes.io/projected/5e2f37a2-29d0-4645-b9d2-da9a86a333ed-kube-api-access-pp2w2\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:36:37.768464 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:36:37.768438    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvbxk"
Jul 21 20:36:37.768887 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:36:37.768431    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvbxk" event={"ID":"5e2f37a2-29d0-4645-b9d2-da9a86a333ed","Type":"ContainerDied","Data":"3e16b28a4d1de9d775840ec0cea1aee6157c19f00e6fa1ab4e49d1d03b693a7f"}
Jul 21 20:36:37.768887 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:36:37.768595    2576 scope.go:117] "RemoveContainer" containerID="f455f7ccbec0ddb66712ff4db54d37cef4174bc9c361c229db68494f015c07e9"
Jul 21 20:36:37.787502 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:36:37.787471    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvbxk"]
Jul 21 20:36:37.791005 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:36:37.790977    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cvbxk"]
Jul 21 20:36:39.651789 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:36:39.651760    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e2f37a2-29d0-4645-b9d2-da9a86a333ed" path="/var/lib/kubelet/pods/5e2f37a2-29d0-4645-b9d2-da9a86a333ed/volumes"
Jul 21 20:37:22.168496 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:37:22.168461    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:37:34.472205 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:37:34.472163    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wlnzc"]
Jul 21 20:37:34.472800 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:37:34.472764    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e2f37a2-29d0-4645-b9d2-da9a86a333ed" containerName="manager"
Jul 21 20:37:34.472800 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:37:34.472786    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e2f37a2-29d0-4645-b9d2-da9a86a333ed" containerName="manager"
Jul 21 20:37:34.472963 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:37:34.472805    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b671a4f5-b9bc-47f7-a7f3-28c9771b5401" containerName="cleanup"
Jul 21 20:37:34.472963 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:37:34.472813    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b671a4f5-b9bc-47f7-a7f3-28c9771b5401" containerName="cleanup"
Jul 21 20:37:34.472963 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:37:34.472913    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e2f37a2-29d0-4645-b9d2-da9a86a333ed" containerName="manager"
Jul 21 20:37:34.472963 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:37:34.472933    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b671a4f5-b9bc-47f7-a7f3-28c9771b5401" containerName="cleanup"
Jul 21 20:37:34.476152 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:37:34.476131    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wlnzc"
Jul 21 20:37:34.479288 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:37:34.479266    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mwzsw\""
Jul 21 20:37:34.495328 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:37:34.495297    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wlnzc"]
Jul 21 20:37:34.636979 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:37:34.636940    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsdw9\" (UniqueName: \"kubernetes.io/projected/6f410cdc-8371-43fd-8e23-97af02ffe2f8-kube-api-access-fsdw9\") pod \"kuadrant-operator-controller-manager-86878c769f-wlnzc\" (UID: \"6f410cdc-8371-43fd-8e23-97af02ffe2f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wlnzc"
Jul 21 20:37:34.637171 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:37:34.636995    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f410cdc-8371-43fd-8e23-97af02ffe2f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wlnzc\" (UID: \"6f410cdc-8371-43fd-8e23-97af02ffe2f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wlnzc"
Jul 21 20:37:34.738058 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:37:34.737948    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsdw9\" (UniqueName: \"kubernetes.io/projected/6f410cdc-8371-43fd-8e23-97af02ffe2f8-kube-api-access-fsdw9\") pod \"kuadrant-operator-controller-manager-86878c769f-wlnzc\" (UID: \"6f410cdc-8371-43fd-8e23-97af02ffe2f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wlnzc"
Jul 21 20:37:34.738250 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:37:34.738110    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f410cdc-8371-43fd-8e23-97af02ffe2f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wlnzc\" (UID: \"6f410cdc-8371-43fd-8e23-97af02ffe2f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wlnzc"
Jul 21 20:37:34.738575 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:37:34.738554    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f410cdc-8371-43fd-8e23-97af02ffe2f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wlnzc\" (UID: \"6f410cdc-8371-43fd-8e23-97af02ffe2f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wlnzc"
Jul 21 20:37:34.748123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:37:34.748095    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsdw9\" (UniqueName: \"kubernetes.io/projected/6f410cdc-8371-43fd-8e23-97af02ffe2f8-kube-api-access-fsdw9\") pod \"kuadrant-operator-controller-manager-86878c769f-wlnzc\" (UID: \"6f410cdc-8371-43fd-8e23-97af02ffe2f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wlnzc"
Jul 21 20:37:34.786465 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:37:34.786436    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wlnzc"
Jul 21 20:37:34.941562 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:37:34.941484    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wlnzc"]
Jul 21 20:37:34.944158 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:37:34.944133    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f410cdc_8371_43fd_8e23_97af02ffe2f8.slice/crio-ca095787ce814bfda7f127c3134547c925cfeed3c615da378378834da0b87dff WatchSource:0}: Error finding container ca095787ce814bfda7f127c3134547c925cfeed3c615da378378834da0b87dff: Status 404 returned error can't find the container with id ca095787ce814bfda7f127c3134547c925cfeed3c615da378378834da0b87dff
Jul 21 20:37:35.052042 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:37:35.052006    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wlnzc" event={"ID":"6f410cdc-8371-43fd-8e23-97af02ffe2f8","Type":"ContainerStarted","Data":"444f4ee24a58537a4fec76da50153ec652e0f95bf3e216ab8d2c93c9aea82807"}
Jul 21 20:37:35.052214 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:37:35.052068    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wlnzc" event={"ID":"6f410cdc-8371-43fd-8e23-97af02ffe2f8","Type":"ContainerStarted","Data":"ca095787ce814bfda7f127c3134547c925cfeed3c615da378378834da0b87dff"}
Jul 21 20:37:35.052258 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:37:35.052216    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wlnzc"
Jul 21 20:37:46.065238 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:37:46.065197    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wlnzc"
Jul 21 20:37:46.087183 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:37:46.087121    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wlnzc" podStartSLOduration=12.087105085 podStartE2EDuration="12.087105085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:37:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:37:35.088302912 +0000 UTC m=+1406.020701079" watchObservedRunningTime="2026-07-21 20:37:46.087105085 +0000 UTC m=+1417.019503243"
Jul 21 20:39:09.590985 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:39:09.590952    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w885b_62db291a-14b7-4e35-9550-9fb810f82b8d/console-operator/1.log"
Jul 21 20:39:09.597664 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:39:09.597639    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-54f9x_55f51c26-71cd-4e1b-84f2-32f2de4138d5/ovn-acl-logging/0.log"
Jul 21 20:39:09.599198 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:39:09.599167    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w885b_62db291a-14b7-4e35-9550-9fb810f82b8d/console-operator/1.log"
Jul 21 20:39:09.606084 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:39:09.606061    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-54f9x_55f51c26-71cd-4e1b-84f2-32f2de4138d5/ovn-acl-logging/0.log"
Jul 21 20:40:26.997445 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:26.997404    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"]
Jul 21 20:40:27.001731 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:27.001708    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"
Jul 21 20:40:27.004324 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:27.004297    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-da01abe3-kserve-self-signed-certs\""
Jul 21 20:40:27.017321 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:27.017286    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"]
Jul 21 20:40:27.108616 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:27.108569    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9de8e728-5bcf-469a-b6e5-113a551893ba-tls-certs\") pod \"e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs\" (UID: \"9de8e728-5bcf-469a-b6e5-113a551893ba\") " pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"
Jul 21 20:40:27.108616 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:27.108619    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n42q5\" (UniqueName: \"kubernetes.io/projected/9de8e728-5bcf-469a-b6e5-113a551893ba-kube-api-access-n42q5\") pod \"e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs\" (UID: \"9de8e728-5bcf-469a-b6e5-113a551893ba\") " pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"
Jul 21 20:40:27.108883 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:27.108767    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9de8e728-5bcf-469a-b6e5-113a551893ba-model-cache\") pod \"e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs\" (UID: \"9de8e728-5bcf-469a-b6e5-113a551893ba\") " pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"
Jul 21 20:40:27.108883 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:27.108828    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9de8e728-5bcf-469a-b6e5-113a551893ba-home\") pod \"e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs\" (UID: \"9de8e728-5bcf-469a-b6e5-113a551893ba\") " pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"
Jul 21 20:40:27.108883 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:27.108851    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9de8e728-5bcf-469a-b6e5-113a551893ba-tmp-dir\") pod \"e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs\" (UID: \"9de8e728-5bcf-469a-b6e5-113a551893ba\") " pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"
Jul 21 20:40:27.108992 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:27.108889    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9de8e728-5bcf-469a-b6e5-113a551893ba-dshm\") pod \"e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs\" (UID: \"9de8e728-5bcf-469a-b6e5-113a551893ba\") " pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"
Jul 21 20:40:27.209626 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:27.209592    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9de8e728-5bcf-469a-b6e5-113a551893ba-tls-certs\") pod \"e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs\" (UID: \"9de8e728-5bcf-469a-b6e5-113a551893ba\") " pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"
Jul 21 20:40:27.209824 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:27.209634    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n42q5\" (UniqueName: \"kubernetes.io/projected/9de8e728-5bcf-469a-b6e5-113a551893ba-kube-api-access-n42q5\") pod \"e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs\" (UID: \"9de8e728-5bcf-469a-b6e5-113a551893ba\") " pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"
Jul 21 20:40:27.209824 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:27.209816    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9de8e728-5bcf-469a-b6e5-113a551893ba-model-cache\") pod \"e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs\" (UID: \"9de8e728-5bcf-469a-b6e5-113a551893ba\") " pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"
Jul 21 20:40:27.209915 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:27.209889    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9de8e728-5bcf-469a-b6e5-113a551893ba-home\") pod \"e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs\" (UID: \"9de8e728-5bcf-469a-b6e5-113a551893ba\") " pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"
Jul 21 20:40:27.209968 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:27.209915    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9de8e728-5bcf-469a-b6e5-113a551893ba-tmp-dir\") pod \"e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs\" (UID: \"9de8e728-5bcf-469a-b6e5-113a551893ba\") " pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"
Jul 21 20:40:27.209968 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:27.209943    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9de8e728-5bcf-469a-b6e5-113a551893ba-dshm\") pod \"e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs\" (UID: \"9de8e728-5bcf-469a-b6e5-113a551893ba\") " pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"
Jul 21 20:40:27.210291 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:27.210248    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9de8e728-5bcf-469a-b6e5-113a551893ba-model-cache\") pod \"e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs\" (UID: \"9de8e728-5bcf-469a-b6e5-113a551893ba\") " pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"
Jul 21 20:40:27.210421 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:27.210286    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9de8e728-5bcf-469a-b6e5-113a551893ba-tmp-dir\") pod \"e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs\" (UID: \"9de8e728-5bcf-469a-b6e5-113a551893ba\") " pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"
Jul 21 20:40:27.210421 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:27.210341    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9de8e728-5bcf-469a-b6e5-113a551893ba-home\") pod \"e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs\" (UID: \"9de8e728-5bcf-469a-b6e5-113a551893ba\") " pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"
Jul 21 20:40:27.212490 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:27.212427    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9de8e728-5bcf-469a-b6e5-113a551893ba-tls-certs\") pod \"e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs\" (UID: \"9de8e728-5bcf-469a-b6e5-113a551893ba\") " pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"
Jul 21 20:40:27.212801 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:27.212758    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9de8e728-5bcf-469a-b6e5-113a551893ba-dshm\") pod \"e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs\" (UID: \"9de8e728-5bcf-469a-b6e5-113a551893ba\") " pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"
Jul 21 20:40:27.218337 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:27.218315    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n42q5\" (UniqueName: \"kubernetes.io/projected/9de8e728-5bcf-469a-b6e5-113a551893ba-kube-api-access-n42q5\") pod \"e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs\" (UID: \"9de8e728-5bcf-469a-b6e5-113a551893ba\") " pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"
Jul 21 20:40:27.310915 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:27.310878    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"
Jul 21 20:40:27.454595 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:27.454560    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"]
Jul 21 20:40:27.456394 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:40:27.456365    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9de8e728_5bcf_469a_b6e5_113a551893ba.slice/crio-31410f06c0d595a3fadd2a3eb9df6a4d712c4ec06b59fc26755d4aa0d03868dd WatchSource:0}: Error finding container 31410f06c0d595a3fadd2a3eb9df6a4d712c4ec06b59fc26755d4aa0d03868dd: Status 404 returned error can't find the container with id 31410f06c0d595a3fadd2a3eb9df6a4d712c4ec06b59fc26755d4aa0d03868dd
Jul 21 20:40:27.945099 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:27.945062    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs" event={"ID":"9de8e728-5bcf-469a-b6e5-113a551893ba","Type":"ContainerStarted","Data":"3159b226804d419a765aa0cf2ae6987a1b7ebaccc0ba7719dca65decb72020fe"}
Jul 21 20:40:27.945312 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:27.945112    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs" event={"ID":"9de8e728-5bcf-469a-b6e5-113a551893ba","Type":"ContainerStarted","Data":"31410f06c0d595a3fadd2a3eb9df6a4d712c4ec06b59fc26755d4aa0d03868dd"}
Jul 21 20:40:27.964057 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:27.964000    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs" podStartSLOduration=1.963980684 podStartE2EDuration="1.963980684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:40:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:40:27.962027145 +0000 UTC m=+1578.894425309" watchObservedRunningTime="2026-07-21 20:40:27.963980684 +0000 UTC m=+1578.896378842"
Jul 21 20:40:28.105526 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:28.105499    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:40:37.311068 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:37.311018    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"
Jul 21 20:40:37.311526 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:37.311080    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"
Jul 21 20:40:37.324056 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:37.324024    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"
Jul 21 20:40:38.003898 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:38.003868    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"
Jul 21 20:40:50.002780 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:40:50.002746    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:41:11.922933 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:11.922842    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"]
Jul 21 20:41:11.962804 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:11.962771    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:41:13.705909 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:13.705877    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:41:26.944852 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:26.944808    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs" podUID="9de8e728-5bcf-469a-b6e5-113a551893ba" containerName="main" containerID="cri-o://3159b226804d419a765aa0cf2ae6987a1b7ebaccc0ba7719dca65decb72020fe" gracePeriod=45
Jul 21 20:41:27.213632 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.213605    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"
Jul 21 20:41:27.256333 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.256297    2576 generic.go:356] "Generic (PLEG): container finished" podID="9de8e728-5bcf-469a-b6e5-113a551893ba" containerID="3159b226804d419a765aa0cf2ae6987a1b7ebaccc0ba7719dca65decb72020fe" exitCode=0
Jul 21 20:41:27.256508 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.256355    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"
Jul 21 20:41:27.256508 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.256390    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs" event={"ID":"9de8e728-5bcf-469a-b6e5-113a551893ba","Type":"ContainerDied","Data":"3159b226804d419a765aa0cf2ae6987a1b7ebaccc0ba7719dca65decb72020fe"}
Jul 21 20:41:27.256508 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.256445    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs" event={"ID":"9de8e728-5bcf-469a-b6e5-113a551893ba","Type":"ContainerDied","Data":"31410f06c0d595a3fadd2a3eb9df6a4d712c4ec06b59fc26755d4aa0d03868dd"}
Jul 21 20:41:27.256508 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.256470    2576 scope.go:117] "RemoveContainer" containerID="3159b226804d419a765aa0cf2ae6987a1b7ebaccc0ba7719dca65decb72020fe"
Jul 21 20:41:27.265402 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.265380    2576 scope.go:117] "RemoveContainer" containerID="3159b226804d419a765aa0cf2ae6987a1b7ebaccc0ba7719dca65decb72020fe"
Jul 21 20:41:27.265766 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:41:27.265741    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3159b226804d419a765aa0cf2ae6987a1b7ebaccc0ba7719dca65decb72020fe\": container with ID starting with 3159b226804d419a765aa0cf2ae6987a1b7ebaccc0ba7719dca65decb72020fe not found: ID does not exist" containerID="3159b226804d419a765aa0cf2ae6987a1b7ebaccc0ba7719dca65decb72020fe"
Jul 21 20:41:27.265880 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.265773    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3159b226804d419a765aa0cf2ae6987a1b7ebaccc0ba7719dca65decb72020fe"} err="failed to get container status \"3159b226804d419a765aa0cf2ae6987a1b7ebaccc0ba7719dca65decb72020fe\": rpc error: code = NotFound desc = could not find container \"3159b226804d419a765aa0cf2ae6987a1b7ebaccc0ba7719dca65decb72020fe\": container with ID starting with 3159b226804d419a765aa0cf2ae6987a1b7ebaccc0ba7719dca65decb72020fe not found: ID does not exist"
Jul 21 20:41:27.296246 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.296209    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n42q5\" (UniqueName: \"kubernetes.io/projected/9de8e728-5bcf-469a-b6e5-113a551893ba-kube-api-access-n42q5\") pod \"9de8e728-5bcf-469a-b6e5-113a551893ba\" (UID: \"9de8e728-5bcf-469a-b6e5-113a551893ba\") "
Jul 21 20:41:27.296440 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.296264    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9de8e728-5bcf-469a-b6e5-113a551893ba-tmp-dir\") pod \"9de8e728-5bcf-469a-b6e5-113a551893ba\" (UID: \"9de8e728-5bcf-469a-b6e5-113a551893ba\") "
Jul 21 20:41:27.296440 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.296294    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9de8e728-5bcf-469a-b6e5-113a551893ba-model-cache\") pod \"9de8e728-5bcf-469a-b6e5-113a551893ba\" (UID: \"9de8e728-5bcf-469a-b6e5-113a551893ba\") "
Jul 21 20:41:27.296440 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.296365    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9de8e728-5bcf-469a-b6e5-113a551893ba-dshm\") pod \"9de8e728-5bcf-469a-b6e5-113a551893ba\" (UID: \"9de8e728-5bcf-469a-b6e5-113a551893ba\") "
Jul 21 20:41:27.296605 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.296445    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9de8e728-5bcf-469a-b6e5-113a551893ba-home\") pod \"9de8e728-5bcf-469a-b6e5-113a551893ba\" (UID: \"9de8e728-5bcf-469a-b6e5-113a551893ba\") "
Jul 21 20:41:27.296605 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.296471    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9de8e728-5bcf-469a-b6e5-113a551893ba-tls-certs\") pod \"9de8e728-5bcf-469a-b6e5-113a551893ba\" (UID: \"9de8e728-5bcf-469a-b6e5-113a551893ba\") "
Jul 21 20:41:27.296739 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.296597    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9de8e728-5bcf-469a-b6e5-113a551893ba-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9de8e728-5bcf-469a-b6e5-113a551893ba" (UID: "9de8e728-5bcf-469a-b6e5-113a551893ba"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:41:27.296739 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.296633    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9de8e728-5bcf-469a-b6e5-113a551893ba-model-cache" (OuterVolumeSpecName: "model-cache") pod "9de8e728-5bcf-469a-b6e5-113a551893ba" (UID: "9de8e728-5bcf-469a-b6e5-113a551893ba"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:41:27.296739 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.296714    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9de8e728-5bcf-469a-b6e5-113a551893ba-home" (OuterVolumeSpecName: "home") pod "9de8e728-5bcf-469a-b6e5-113a551893ba" (UID: "9de8e728-5bcf-469a-b6e5-113a551893ba"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:41:27.296898 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.296835    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9de8e728-5bcf-469a-b6e5-113a551893ba-home\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:41:27.296898 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.296853    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9de8e728-5bcf-469a-b6e5-113a551893ba-tmp-dir\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:41:27.296898 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.296868    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9de8e728-5bcf-469a-b6e5-113a551893ba-model-cache\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:41:27.298564 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.298542    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9de8e728-5bcf-469a-b6e5-113a551893ba-dshm" (OuterVolumeSpecName: "dshm") pod "9de8e728-5bcf-469a-b6e5-113a551893ba" (UID: "9de8e728-5bcf-469a-b6e5-113a551893ba"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:41:27.298673 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.298593    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9de8e728-5bcf-469a-b6e5-113a551893ba-kube-api-access-n42q5" (OuterVolumeSpecName: "kube-api-access-n42q5") pod "9de8e728-5bcf-469a-b6e5-113a551893ba" (UID: "9de8e728-5bcf-469a-b6e5-113a551893ba"). InnerVolumeSpecName "kube-api-access-n42q5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:41:27.298747 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.298662    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9de8e728-5bcf-469a-b6e5-113a551893ba-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9de8e728-5bcf-469a-b6e5-113a551893ba" (UID: "9de8e728-5bcf-469a-b6e5-113a551893ba"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:41:27.398282 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.398244    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9de8e728-5bcf-469a-b6e5-113a551893ba-dshm\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:41:27.398282 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.398275    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9de8e728-5bcf-469a-b6e5-113a551893ba-tls-certs\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:41:27.398282 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.398290    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n42q5\" (UniqueName: \"kubernetes.io/projected/9de8e728-5bcf-469a-b6e5-113a551893ba-kube-api-access-n42q5\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:41:27.590348 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.590303    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"]
Jul 21 20:41:27.599148 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.599116    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-da01abe3-kserve-85d5d956c-5mrxs"]
Jul 21 20:41:27.651207 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:41:27.651171    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9de8e728-5bcf-469a-b6e5-113a551893ba" path="/var/lib/kubelet/pods/9de8e728-5bcf-469a-b6e5-113a551893ba/volumes"
Jul 21 20:42:40.476550 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:42:40.476469    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:42:49.320557 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:42:49.320493    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:44:09.623284 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:44:09.623254    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w885b_62db291a-14b7-4e35-9550-9fb810f82b8d/console-operator/1.log"
Jul 21 20:44:09.634882 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:44:09.634847    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-54f9x_55f51c26-71cd-4e1b-84f2-32f2de4138d5/ovn-acl-logging/0.log"
Jul 21 20:44:09.635879 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:44:09.635856    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w885b_62db291a-14b7-4e35-9550-9fb810f82b8d/console-operator/1.log"
Jul 21 20:44:09.642583 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:44:09.642557    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-54f9x_55f51c26-71cd-4e1b-84f2-32f2de4138d5/ovn-acl-logging/0.log"
Jul 21 20:44:28.827919 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:44:28.827871    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:44:54.377721 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:44:54.377655    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:44:57.310771 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:44:57.310730    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:44:57.532785 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:44:57.532663    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:44:57.873341 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:44:57.873310    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:45:00.185054 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:00.185019    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744445-vgtw9"]
Jul 21 20:45:00.185462 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:00.185449    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9de8e728-5bcf-469a-b6e5-113a551893ba" containerName="main"
Jul 21 20:45:00.185508 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:00.185464    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9de8e728-5bcf-469a-b6e5-113a551893ba" containerName="main"
Jul 21 20:45:00.185549 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:00.185531    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9de8e728-5bcf-469a-b6e5-113a551893ba" containerName="main"
Jul 21 20:45:00.188903 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:00.188885    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744445-vgtw9"
Jul 21 20:45:00.193481 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:00.193456    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kvpgn\""
Jul 21 20:45:00.198998 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:00.198980    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744445-vgtw9"
Jul 21 20:45:00.237560 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:00.237523    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744445-vgtw9"]
Jul 21 20:45:00.562750 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:00.562721    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744445-vgtw9"]
Jul 21 20:45:00.565123 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:45:00.565095    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c502475_4e24_42f5_b048_06f5cf182ed9.slice/crio-afcf6eabefe811b3323454befce122563c0d1682b994fb86d8c1f00b94170758 WatchSource:0}: Error finding container afcf6eabefe811b3323454befce122563c0d1682b994fb86d8c1f00b94170758: Status 404 returned error can't find the container with id afcf6eabefe811b3323454befce122563c0d1682b994fb86d8c1f00b94170758
Jul 21 20:45:01.356160 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:01.356118    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744445-vgtw9" event={"ID":"0c502475-4e24-42f5-b048-06f5cf182ed9","Type":"ContainerStarted","Data":"0bc3905522180d60ac553867fd1a812ce1f5961906cab9c63f4a9e50a72564a3"}
Jul 21 20:45:01.356573 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:01.356177    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744445-vgtw9" event={"ID":"0c502475-4e24-42f5-b048-06f5cf182ed9","Type":"ContainerStarted","Data":"afcf6eabefe811b3323454befce122563c0d1682b994fb86d8c1f00b94170758"}
Jul 21 20:45:01.383652 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:01.383588    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744445-vgtw9" podStartSLOduration=1.383558174 podStartE2EDuration="1.383558174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:45:01.38250524 +0000 UTC m=+1852.314903397" watchObservedRunningTime="2026-07-21 20:45:01.383558174 +0000 UTC m=+1852.315956331"
Jul 21 20:45:02.362994 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:02.362957    2576 generic.go:356] "Generic (PLEG): container finished" podID="0c502475-4e24-42f5-b048-06f5cf182ed9" containerID="0bc3905522180d60ac553867fd1a812ce1f5961906cab9c63f4a9e50a72564a3" exitCode=0
Jul 21 20:45:02.363427 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:02.363049    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744445-vgtw9" event={"ID":"0c502475-4e24-42f5-b048-06f5cf182ed9","Type":"ContainerDied","Data":"0bc3905522180d60ac553867fd1a812ce1f5961906cab9c63f4a9e50a72564a3"}
Jul 21 20:45:03.511459 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:03.511429    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744445-vgtw9"
Jul 21 20:45:04.261480 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:04.261449    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:45:04.374146 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:04.374122    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744445-vgtw9"
Jul 21 20:45:04.374331 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:04.374163    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744445-vgtw9" event={"ID":"0c502475-4e24-42f5-b048-06f5cf182ed9","Type":"ContainerDied","Data":"afcf6eabefe811b3323454befce122563c0d1682b994fb86d8c1f00b94170758"}
Jul 21 20:45:04.374331 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:04.374211    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="afcf6eabefe811b3323454befce122563c0d1682b994fb86d8c1f00b94170758"
Jul 21 20:45:04.435368 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:04.435337    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:45:04.556110 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:04.556017    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:45:04.769527 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:04.769493    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"]
Jul 21 20:45:04.770028 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:04.770009    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c502475-4e24-42f5-b048-06f5cf182ed9" containerName="cleanup"
Jul 21 20:45:04.770112 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:04.770031    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c502475-4e24-42f5-b048-06f5cf182ed9" containerName="cleanup"
Jul 21 20:45:04.770150 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:04.770137    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c502475-4e24-42f5-b048-06f5cf182ed9" containerName="cleanup"
Jul 21 20:45:04.773499 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:04.773480    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:04.776808 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:04.776788    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-7bc6ce31-openshift-default-dockercfg-tkm6c\""
Jul 21 20:45:04.793708 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:04.793660    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"]
Jul 21 20:45:04.814610 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:04.814532    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:45:04.898159 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:04.898118    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-credential-socket\") pod \"e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") " pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:04.898159 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:04.898158    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-istio-envoy\") pod \"e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") " pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:04.898394 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:04.898180    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xqgq\" (UniqueName: \"kubernetes.io/projected/d797ba3e-c2f2-488d-afe5-26600281b43a-kube-api-access-8xqgq\") pod \"e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") " pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:04.898394 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:04.898301    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-workload-socket\") pod \"e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") " pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:04.898394 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:04.898339    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d797ba3e-c2f2-488d-afe5-26600281b43a-istio-token\") pod \"e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") " pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:04.898394 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:04.898366    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d797ba3e-c2f2-488d-afe5-26600281b43a-istio-podinfo\") pod \"e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") " pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:04.898552 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:04.898424    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d797ba3e-c2f2-488d-afe5-26600281b43a-istiod-ca-cert\") pod \"e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") " pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:04.898552 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:04.898476    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-istio-data\") pod \"e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") " pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:04.898552 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:04.898499    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-workload-certs\") pod \"e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") " pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:04.999766 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:04.999729    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d797ba3e-c2f2-488d-afe5-26600281b43a-istiod-ca-cert\") pod \"e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") " pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:04.999951 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:04.999789    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-istio-data\") pod \"e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") " pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:04.999951 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:04.999816    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-workload-certs\") pod \"e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") " pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:04.999951 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:04.999841    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-credential-socket\") pod \"e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") " pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:04.999951 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:04.999855    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-istio-envoy\") pod \"e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") " pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:05.000158 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:05.000004    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xqgq\" (UniqueName: \"kubernetes.io/projected/d797ba3e-c2f2-488d-afe5-26600281b43a-kube-api-access-8xqgq\") pod \"e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") " pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:05.000158 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:05.000077    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-workload-socket\") pod \"e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") " pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:05.000158 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:05.000113    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d797ba3e-c2f2-488d-afe5-26600281b43a-istio-token\") pod \"e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") " pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:05.000320 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:05.000146    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d797ba3e-c2f2-488d-afe5-26600281b43a-istio-podinfo\") pod \"e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") " pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:05.000320 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:05.000236    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-istio-data\") pod \"e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") " pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:05.000320 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:05.000268    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-credential-socket\") pod \"e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") " pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:05.000474 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:05.000411    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-workload-certs\") pod \"e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") " pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:05.000556 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:05.000534    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d797ba3e-c2f2-488d-afe5-26600281b43a-istiod-ca-cert\") pod \"e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") " pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:05.000633 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:05.000608    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-workload-socket\") pod \"e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") " pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:05.002481 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:05.002462    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-istio-envoy\") pod \"e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") " pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:05.002541 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:05.002511    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d797ba3e-c2f2-488d-afe5-26600281b43a-istio-podinfo\") pod \"e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") " pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:05.009993 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:05.009967    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xqgq\" (UniqueName: \"kubernetes.io/projected/d797ba3e-c2f2-488d-afe5-26600281b43a-kube-api-access-8xqgq\") pod \"e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") " pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:05.010464 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:05.010445    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d797ba3e-c2f2-488d-afe5-26600281b43a-istio-token\") pod \"e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") " pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:05.084305 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:05.084211    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:05.236384 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:05.236349    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:45:05.242323 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:05.242294    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"]
Jul 21 20:45:05.244648 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:45:05.244617    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd797ba3e_c2f2_488d_afe5_26600281b43a.slice/crio-e70b3fcd6df880245c69e4d9b150eeeb362a7aaa3cf7a04a88791deb9969f568 WatchSource:0}: Error finding container e70b3fcd6df880245c69e4d9b150eeeb362a7aaa3cf7a04a88791deb9969f568: Status 404 returned error can't find the container with id e70b3fcd6df880245c69e4d9b150eeeb362a7aaa3cf7a04a88791deb9969f568
Jul 21 20:45:05.246923 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:05.246886    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:45:05.247042 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:05.246972    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:45:05.247042 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:05.247018    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:45:05.382598 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:05.382504    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls" event={"ID":"d797ba3e-c2f2-488d-afe5-26600281b43a","Type":"ContainerStarted","Data":"f2634ca1a5f97b305624b85290ca7e4ff7f865a7b05bcaa13cb00724d679b97a"}
Jul 21 20:45:05.382598 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:05.382562    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls" event={"ID":"d797ba3e-c2f2-488d-afe5-26600281b43a","Type":"ContainerStarted","Data":"e70b3fcd6df880245c69e4d9b150eeeb362a7aaa3cf7a04a88791deb9969f568"}
Jul 21 20:45:05.447847 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:05.447775    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls" podStartSLOduration=1.447749421 podStartE2EDuration="1.447749421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:45:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:45:05.439108803 +0000 UTC m=+1856.371506962" watchObservedRunningTime="2026-07-21 20:45:05.447749421 +0000 UTC m=+1856.380147579"
Jul 21 20:45:05.892027 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:05.891978    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:45:06.043072 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:06.043031    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:45:06.084877 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:06.084834    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:06.090145 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:06.090116    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:06.224171 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:06.224096    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:45:06.387827 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:06.387798    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:06.388739 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:06.388717    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:06.963802 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:06.963763    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:45:07.060070 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:07.060036    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:45:18.457938 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:18.457901    2576 generic.go:356] "Generic (PLEG): container finished" podID="d797ba3e-c2f2-488d-afe5-26600281b43a" containerID="f2634ca1a5f97b305624b85290ca7e4ff7f865a7b05bcaa13cb00724d679b97a" exitCode=0
Jul 21 20:45:18.458389 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:18.457972    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls" event={"ID":"d797ba3e-c2f2-488d-afe5-26600281b43a","Type":"ContainerDied","Data":"f2634ca1a5f97b305624b85290ca7e4ff7f865a7b05bcaa13cb00724d679b97a"}
Jul 21 20:45:18.458434 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:18.458389    2576 scope.go:117] "RemoveContainer" containerID="f2634ca1a5f97b305624b85290ca7e4ff7f865a7b05bcaa13cb00724d679b97a"
Jul 21 20:45:18.459398 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:18.459369    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:45:18.459466 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:18.459454    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:45:18.459502 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:18.459486    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:45:19.465346 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:19.465314    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls" event={"ID":"d797ba3e-c2f2-488d-afe5-26600281b43a","Type":"ContainerStarted","Data":"20a356bb03b87937ddc56b6b70b82ef8406aed62df7c84598b86e9bae3295559"}
Jul 21 20:45:20.084766 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:20.084723    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:20.085742 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:20.085716    2576 patch_prober.go:28] interesting pod/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 21 20:45:20.085871 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:20.085779    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls" podUID="d797ba3e-c2f2-488d-afe5-26600281b43a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 21 20:45:21.084823 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:21.084780    2576 patch_prober.go:28] interesting pod/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 21 20:45:21.085211 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:21.084837    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls" podUID="d797ba3e-c2f2-488d-afe5-26600281b43a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 21 20:45:21.388284 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:21.388199    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:22.085275 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:22.085237    2576 patch_prober.go:28] interesting pod/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 21 20:45:22.085676 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:22.085299    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls" podUID="d797ba3e-c2f2-488d-afe5-26600281b43a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 21 20:45:23.085201 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:23.085161    2576 patch_prober.go:28] interesting pod/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 21 20:45:23.085398 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:23.085218    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls" podUID="d797ba3e-c2f2-488d-afe5-26600281b43a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 21 20:45:24.088239 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:24.088206    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:24.089322 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:24.089304    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:32.606015 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:32.605923    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"]
Jul 21 20:45:32.606520 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:32.606147    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls" podUID="d797ba3e-c2f2-488d-afe5-26600281b43a" containerName="istio-proxy" containerID="cri-o://20a356bb03b87937ddc56b6b70b82ef8406aed62df7c84598b86e9bae3295559" gracePeriod=30
Jul 21 20:45:32.633161 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:32.633129    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:45:33.684935 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.684902    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"]
Jul 21 20:45:33.689030 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.689010    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:33.692594 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.692573    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-868c4ca9-gw-openshift-default-dockercfg-5nxq5\""
Jul 21 20:45:33.712141 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.712108    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"]
Jul 21 20:45:33.802274 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.802238    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istio-podinfo\") pod \"e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") " pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:33.802525 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.802298    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-workload-socket\") pod \"e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") " pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:33.802525 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.802339    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-workload-certs\") pod \"e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") " pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:33.802525 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.802375    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istio-data\") pod \"e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") " pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:33.802525 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.802430    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istiod-ca-cert\") pod \"e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") " pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:33.802525 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.802463    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istio-envoy\") pod \"e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") " pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:33.802525 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.802489    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-credential-socket\") pod \"e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") " pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:33.802777 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.802525    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istio-token\") pod \"e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") " pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:33.802777 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.802550    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chv9r\" (UniqueName: \"kubernetes.io/projected/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-kube-api-access-chv9r\") pod \"e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") " pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:33.903560 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.903515    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-workload-socket\") pod \"e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") " pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:33.903773 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.903573    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-workload-certs\") pod \"e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") " pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:33.903773 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.903609    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istio-data\") pod \"e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") " pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:33.903773 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.903640    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istiod-ca-cert\") pod \"e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") " pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:33.903773 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.903673    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istio-envoy\") pod \"e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") " pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:33.903773 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.903732    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-credential-socket\") pod \"e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") " pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:33.903773 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.903763    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istio-token\") pod \"e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") " pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:33.904076 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.903795    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chv9r\" (UniqueName: \"kubernetes.io/projected/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-kube-api-access-chv9r\") pod \"e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") " pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:33.904076 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.903973    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-workload-socket\") pod \"e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") " pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:33.904076 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.903990    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istio-podinfo\") pod \"e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") " pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:33.904221 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.904144    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istio-data\") pod \"e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") " pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:33.904221 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.904169    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-credential-socket\") pod \"e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") " pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:33.904301 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.904253    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-workload-certs\") pod \"e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") " pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:33.904552 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.904534    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istiod-ca-cert\") pod \"e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") " pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:33.906010 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.905982    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istio-envoy\") pod \"e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") " pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:33.906347 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.906328    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istio-podinfo\") pod \"e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") " pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:33.918814 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.918792    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istio-token\") pod \"e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") " pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:33.928150 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:33.928125    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chv9r\" (UniqueName: \"kubernetes.io/projected/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-kube-api-access-chv9r\") pod \"e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") " pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:34.000124 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:34.000045    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:34.128477 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:34.128448    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:45:34.161396 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:34.161366    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"]
Jul 21 20:45:34.164290 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:45:34.164261    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc35d8d18_2d11_4e96_a7bc_5dd6a9461c1b.slice/crio-465896e8b95939ac860981e4cbbd9cd4ddbab03f2179f6ae6da386e5ed185e7f WatchSource:0}: Error finding container 465896e8b95939ac860981e4cbbd9cd4ddbab03f2179f6ae6da386e5ed185e7f: Status 404 returned error can't find the container with id 465896e8b95939ac860981e4cbbd9cd4ddbab03f2179f6ae6da386e5ed185e7f
Jul 21 20:45:34.166443 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:34.166410    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:45:34.166508 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:34.166496    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:45:34.166551 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:34.166525    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:45:34.542110 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:34.542066    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx" event={"ID":"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b","Type":"ContainerStarted","Data":"19d5e10f082d0f546ba6843a1908c378d180a7a846ced0c6350c41d5a0df7589"}
Jul 21 20:45:34.542307 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:34.542125    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx" event={"ID":"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b","Type":"ContainerStarted","Data":"465896e8b95939ac860981e4cbbd9cd4ddbab03f2179f6ae6da386e5ed185e7f"}
Jul 21 20:45:34.613144 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:34.613096    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx" podStartSLOduration=1.613081457 podStartE2EDuration="1.613081457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:45:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:45:34.612858374 +0000 UTC m=+1885.545256532" watchObservedRunningTime="2026-07-21 20:45:34.613081457 +0000 UTC m=+1885.545479615"
Jul 21 20:45:34.743940 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:34.743911    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:45:35.001072 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:35.000979    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:35.006118 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:35.006091    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:35.224770 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:35.224734    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:45:35.424099 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:35.424065    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:45:35.548119 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:35.548086    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:35.549173 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:35.549152    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:35.600082 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:35.600055    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:45:36.030552 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:36.030519    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:45:36.199807 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:36.199779    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:45:37.877988 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:37.877919    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:37.944333 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:37.944292    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d797ba3e-c2f2-488d-afe5-26600281b43a-istio-token\") pod \"d797ba3e-c2f2-488d-afe5-26600281b43a\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") "
Jul 21 20:45:37.944508 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:37.944345    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-credential-socket\") pod \"d797ba3e-c2f2-488d-afe5-26600281b43a\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") "
Jul 21 20:45:37.944508 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:37.944376    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d797ba3e-c2f2-488d-afe5-26600281b43a-istio-podinfo\") pod \"d797ba3e-c2f2-488d-afe5-26600281b43a\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") "
Jul 21 20:45:37.944508 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:37.944411    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-istio-data\") pod \"d797ba3e-c2f2-488d-afe5-26600281b43a\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") "
Jul 21 20:45:37.944508 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:37.944471    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xqgq\" (UniqueName: \"kubernetes.io/projected/d797ba3e-c2f2-488d-afe5-26600281b43a-kube-api-access-8xqgq\") pod \"d797ba3e-c2f2-488d-afe5-26600281b43a\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") "
Jul 21 20:45:37.944508 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:37.944504    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-workload-socket\") pod \"d797ba3e-c2f2-488d-afe5-26600281b43a\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") "
Jul 21 20:45:37.944810 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:37.944548    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-workload-certs\") pod \"d797ba3e-c2f2-488d-afe5-26600281b43a\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") "
Jul 21 20:45:37.944810 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:37.944577    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-istio-envoy\") pod \"d797ba3e-c2f2-488d-afe5-26600281b43a\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") "
Jul 21 20:45:37.944810 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:37.944601    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d797ba3e-c2f2-488d-afe5-26600281b43a-istiod-ca-cert\") pod \"d797ba3e-c2f2-488d-afe5-26600281b43a\" (UID: \"d797ba3e-c2f2-488d-afe5-26600281b43a\") "
Jul 21 20:45:37.944810 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:37.944751    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d797ba3e-c2f2-488d-afe5-26600281b43a" (UID: "d797ba3e-c2f2-488d-afe5-26600281b43a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:45:37.945034 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:37.944856    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d797ba3e-c2f2-488d-afe5-26600281b43a" (UID: "d797ba3e-c2f2-488d-afe5-26600281b43a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:45:37.945034 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:37.944872    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d797ba3e-c2f2-488d-afe5-26600281b43a" (UID: "d797ba3e-c2f2-488d-afe5-26600281b43a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:45:37.945034 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:37.945019    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-workload-socket\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:45:37.945182 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:37.945039    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-workload-certs\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:45:37.945182 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:37.945052    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-credential-socket\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:45:37.945182 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:37.945143    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d797ba3e-c2f2-488d-afe5-26600281b43a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d797ba3e-c2f2-488d-afe5-26600281b43a" (UID: "d797ba3e-c2f2-488d-afe5-26600281b43a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:45:37.945389 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:37.945366    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-istio-data" (OuterVolumeSpecName: "istio-data") pod "d797ba3e-c2f2-488d-afe5-26600281b43a" (UID: "d797ba3e-c2f2-488d-afe5-26600281b43a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:45:37.946957 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:37.946923    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d797ba3e-c2f2-488d-afe5-26600281b43a-kube-api-access-8xqgq" (OuterVolumeSpecName: "kube-api-access-8xqgq") pod "d797ba3e-c2f2-488d-afe5-26600281b43a" (UID: "d797ba3e-c2f2-488d-afe5-26600281b43a"). InnerVolumeSpecName "kube-api-access-8xqgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:45:37.947086 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:37.946994    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d797ba3e-c2f2-488d-afe5-26600281b43a-istio-token" (OuterVolumeSpecName: "istio-token") pod "d797ba3e-c2f2-488d-afe5-26600281b43a" (UID: "d797ba3e-c2f2-488d-afe5-26600281b43a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:45:37.947086 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:37.947031    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d797ba3e-c2f2-488d-afe5-26600281b43a" (UID: "d797ba3e-c2f2-488d-afe5-26600281b43a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:45:37.947206 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:37.947121    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d797ba3e-c2f2-488d-afe5-26600281b43a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d797ba3e-c2f2-488d-afe5-26600281b43a" (UID: "d797ba3e-c2f2-488d-afe5-26600281b43a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 20:45:38.045978 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:38.045940    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d797ba3e-c2f2-488d-afe5-26600281b43a-istio-token\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:45:38.045978 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:38.045969    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d797ba3e-c2f2-488d-afe5-26600281b43a-istio-podinfo\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:45:38.045978 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:38.045979    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-istio-data\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:45:38.045978 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:38.045988    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xqgq\" (UniqueName: \"kubernetes.io/projected/d797ba3e-c2f2-488d-afe5-26600281b43a-kube-api-access-8xqgq\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:45:38.046254 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:38.045998    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d797ba3e-c2f2-488d-afe5-26600281b43a-istio-envoy\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:45:38.046254 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:38.046006    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d797ba3e-c2f2-488d-afe5-26600281b43a-istiod-ca-cert\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:45:38.564575 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:38.564537    2576 generic.go:356] "Generic (PLEG): container finished" podID="d797ba3e-c2f2-488d-afe5-26600281b43a" containerID="20a356bb03b87937ddc56b6b70b82ef8406aed62df7c84598b86e9bae3295559" exitCode=0
Jul 21 20:45:38.564759 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:38.564590    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"
Jul 21 20:45:38.564759 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:38.564625    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls" event={"ID":"d797ba3e-c2f2-488d-afe5-26600281b43a","Type":"ContainerDied","Data":"20a356bb03b87937ddc56b6b70b82ef8406aed62df7c84598b86e9bae3295559"}
Jul 21 20:45:38.564759 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:38.564711    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls" event={"ID":"d797ba3e-c2f2-488d-afe5-26600281b43a","Type":"ContainerDied","Data":"e70b3fcd6df880245c69e4d9b150eeeb362a7aaa3cf7a04a88791deb9969f568"}
Jul 21 20:45:38.564759 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:38.564744    2576 scope.go:117] "RemoveContainer" containerID="20a356bb03b87937ddc56b6b70b82ef8406aed62df7c84598b86e9bae3295559"
Jul 21 20:45:38.574234 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:38.574214    2576 scope.go:117] "RemoveContainer" containerID="f2634ca1a5f97b305624b85290ca7e4ff7f865a7b05bcaa13cb00724d679b97a"
Jul 21 20:45:38.582901 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:38.582879    2576 scope.go:117] "RemoveContainer" containerID="20a356bb03b87937ddc56b6b70b82ef8406aed62df7c84598b86e9bae3295559"
Jul 21 20:45:38.583210 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:45:38.583188    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20a356bb03b87937ddc56b6b70b82ef8406aed62df7c84598b86e9bae3295559\": container with ID starting with 20a356bb03b87937ddc56b6b70b82ef8406aed62df7c84598b86e9bae3295559 not found: ID does not exist" containerID="20a356bb03b87937ddc56b6b70b82ef8406aed62df7c84598b86e9bae3295559"
Jul 21 20:45:38.583297 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:38.583223    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20a356bb03b87937ddc56b6b70b82ef8406aed62df7c84598b86e9bae3295559"} err="failed to get container status \"20a356bb03b87937ddc56b6b70b82ef8406aed62df7c84598b86e9bae3295559\": rpc error: code = NotFound desc = could not find container \"20a356bb03b87937ddc56b6b70b82ef8406aed62df7c84598b86e9bae3295559\": container with ID starting with 20a356bb03b87937ddc56b6b70b82ef8406aed62df7c84598b86e9bae3295559 not found: ID does not exist"
Jul 21 20:45:38.583297 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:38.583248    2576 scope.go:117] "RemoveContainer" containerID="f2634ca1a5f97b305624b85290ca7e4ff7f865a7b05bcaa13cb00724d679b97a"
Jul 21 20:45:38.583492 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:45:38.583475    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2634ca1a5f97b305624b85290ca7e4ff7f865a7b05bcaa13cb00724d679b97a\": container with ID starting with f2634ca1a5f97b305624b85290ca7e4ff7f865a7b05bcaa13cb00724d679b97a not found: ID does not exist" containerID="f2634ca1a5f97b305624b85290ca7e4ff7f865a7b05bcaa13cb00724d679b97a"
Jul 21 20:45:38.583533 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:38.583498    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2634ca1a5f97b305624b85290ca7e4ff7f865a7b05bcaa13cb00724d679b97a"} err="failed to get container status \"f2634ca1a5f97b305624b85290ca7e4ff7f865a7b05bcaa13cb00724d679b97a\": rpc error: code = NotFound desc = could not find container \"f2634ca1a5f97b305624b85290ca7e4ff7f865a7b05bcaa13cb00724d679b97a\": container with ID starting with f2634ca1a5f97b305624b85290ca7e4ff7f865a7b05bcaa13cb00724d679b97a not found: ID does not exist"
Jul 21 20:45:38.594458 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:38.594434    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"]
Jul 21 20:45:38.597861 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:38.597838    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-7bc6ce31-openshift-default-954f66c75-scxls"]
Jul 21 20:45:39.651372 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:39.651338    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d797ba3e-c2f2-488d-afe5-26600281b43a" path="/var/lib/kubelet/pods/d797ba3e-c2f2-488d-afe5-26600281b43a/volumes"
Jul 21 20:45:51.480418 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:51.479093    2576 patch_prober.go:28] interesting pod/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": read tcp 10.133.0.2:34106->10.133.0.48:15021: read: connection reset by peer" start-of-body=
Jul 21 20:45:51.480418 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:51.479184    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx" podUID="c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": read tcp 10.133.0.2:34106->10.133.0.48:15021: read: connection reset by peer"
Jul 21 20:45:51.637869 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:51.637792    2576 generic.go:356] "Generic (PLEG): container finished" podID="c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b" containerID="19d5e10f082d0f546ba6843a1908c378d180a7a846ced0c6350c41d5a0df7589" exitCode=0
Jul 21 20:45:51.638021 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:51.637863    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx" event={"ID":"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b","Type":"ContainerDied","Data":"19d5e10f082d0f546ba6843a1908c378d180a7a846ced0c6350c41d5a0df7589"}
Jul 21 20:45:51.638329 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:51.638313    2576 scope.go:117] "RemoveContainer" containerID="19d5e10f082d0f546ba6843a1908c378d180a7a846ced0c6350c41d5a0df7589"
Jul 21 20:45:51.639400 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:51.639369    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:45:51.639496 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:51.639466    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:45:51.639568 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:51.639526    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:45:52.648159 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:52.648121    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx" event={"ID":"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b","Type":"ContainerStarted","Data":"59844af533489fbc42b4330598d65ac31f39f90003e31e525ee99fbbbc0868e2"}
Jul 21 20:45:53.000514 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:53.000412    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:53.000670 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:53.000634    2576 patch_prober.go:28] interesting pod/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 21 20:45:53.000748 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:53.000685    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx" podUID="c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 21 20:45:54.000795 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:54.000756    2576 patch_prober.go:28] interesting pod/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 21 20:45:54.001205 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:54.000817    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx" podUID="c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 21 20:45:55.000429 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:55.000389    2576 patch_prober.go:28] interesting pod/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 21 20:45:55.000611 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:55.000467    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx" podUID="c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 21 20:45:56.000700 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:56.000640    2576 patch_prober.go:28] interesting pod/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 21 20:45:56.001191 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:56.000739    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx" podUID="c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 21 20:45:57.004434 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:57.004403    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:57.004827 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:57.004682    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:45:57.005326 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:45:57.005305    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:46:01.249034 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:01.248993    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"]
Jul 21 20:46:01.249537 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:01.249223    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx" podUID="c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b" containerName="istio-proxy" containerID="cri-o://59844af533489fbc42b4330598d65ac31f39f90003e31e525ee99fbbbc0868e2" gracePeriod=30
Jul 21 20:46:01.254461 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:01.254431    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:46:01.486321 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:01.486272    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:46:01.691648 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:01.691620    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:46:01.991967 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:01.991883    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"]
Jul 21 20:46:01.992314 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:01.992301    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d797ba3e-c2f2-488d-afe5-26600281b43a" containerName="istio-proxy"
Jul 21 20:46:01.992356 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:01.992315    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d797ba3e-c2f2-488d-afe5-26600281b43a" containerName="istio-proxy"
Jul 21 20:46:01.992402 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:01.992394    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d797ba3e-c2f2-488d-afe5-26600281b43a" containerName="istio-proxy"
Jul 21 20:46:01.992438 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:01.992404    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d797ba3e-c2f2-488d-afe5-26600281b43a" containerName="istio-proxy"
Jul 21 20:46:01.996090 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:01.996070    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.003727 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.003685    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-672ca14c-openshift-default-dockercfg-k5m7d\""
Jul 21 20:46:02.011829 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.011803    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"]
Jul 21 20:46:02.022125 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.022084    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:46:02.184833 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.184805    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istio-token\") pod \"e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") " pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.185031 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.184869    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r92k\" (UniqueName: \"kubernetes.io/projected/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-kube-api-access-8r92k\") pod \"e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") " pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.185031 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.184899    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istio-podinfo\") pod \"e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") " pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.185031 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.184921    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istiod-ca-cert\") pod \"e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") " pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.185031 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.184950    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istio-envoy\") pod \"e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") " pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.185031 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.184975    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-workload-socket\") pod \"e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") " pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.185285 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.185053    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-workload-certs\") pod \"e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") " pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.185285 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.185127    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-credential-socket\") pod \"e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") " pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.185285 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.185183    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istio-data\") pod \"e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") " pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.265070 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.265036    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:46:02.286222 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.286182    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r92k\" (UniqueName: \"kubernetes.io/projected/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-kube-api-access-8r92k\") pod \"e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") " pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.286378 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.286226    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istio-podinfo\") pod \"e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") " pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.286378 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.286245    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istiod-ca-cert\") pod \"e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") " pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.286378 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.286320    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istio-envoy\") pod \"e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") " pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.286378 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.286366    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-workload-socket\") pod \"e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") " pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.286558 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.286446    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-workload-certs\") pod \"e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") " pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.286558 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.286524    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-credential-socket\") pod \"e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") " pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.286658 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.286578    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istio-data\") pod \"e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") " pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.286658 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.286612    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istio-token\") pod \"e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") " pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.286823 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.286807    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-workload-socket\") pod \"e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") " pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.286967 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.286919    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-workload-certs\") pod \"e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") " pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.287103 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.287007    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istiod-ca-cert\") pod \"e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") " pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.287170 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.287106    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-credential-socket\") pod \"e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") " pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.287170 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.287108    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istio-data\") pod \"e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") " pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.288722 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.288677    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istio-envoy\") pod \"e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") " pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.288962 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.288946    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istio-podinfo\") pod \"e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") " pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.296104 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.296080    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istio-token\") pod \"e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") " pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.296250 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.296233    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r92k\" (UniqueName: \"kubernetes.io/projected/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-kube-api-access-8r92k\") pod \"e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") " pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.307128 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.307105    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:02.462425 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.462390    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"]
Jul 21 20:46:02.465241 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:46:02.465215    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeb7faa0_e002_4ffc_8a26_dce50c3e30b9.slice/crio-0ea2065a3bb97a5f20acded5fb833d12bad0fda62ecb6b597beacd3fe8b8c5d7 WatchSource:0}: Error finding container 0ea2065a3bb97a5f20acded5fb833d12bad0fda62ecb6b597beacd3fe8b8c5d7: Status 404 returned error can't find the container with id 0ea2065a3bb97a5f20acded5fb833d12bad0fda62ecb6b597beacd3fe8b8c5d7
Jul 21 20:46:02.467835 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.467803    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:46:02.467945 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.467874    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:46:02.467945 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.467907    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:46:02.701587 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.701550    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt" event={"ID":"deb7faa0-e002-4ffc-8a26-dce50c3e30b9","Type":"ContainerStarted","Data":"b37b5775a4382700fea66bead9a63f227d6cbaa2b367deb98e23c12db9cb7073"}
Jul 21 20:46:02.701807 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.701615    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt" event={"ID":"deb7faa0-e002-4ffc-8a26-dce50c3e30b9","Type":"ContainerStarted","Data":"0ea2065a3bb97a5f20acded5fb833d12bad0fda62ecb6b597beacd3fe8b8c5d7"}
Jul 21 20:46:02.726157 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:02.726091    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt" podStartSLOduration=1.726072072 podStartE2EDuration="1.726072072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:46:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:46:02.722186055 +0000 UTC m=+1913.654584213" watchObservedRunningTime="2026-07-21 20:46:02.726072072 +0000 UTC m=+1913.658470231"
Jul 21 20:46:03.098818 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:03.098785    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:46:03.218783 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:03.218753    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:46:03.308006 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:03.307961    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:03.313102 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:03.313076    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:03.320838 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:03.320813    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:46:03.629073 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:03.629042    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:46:03.707065 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:03.707030    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:03.708166 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:03.708147    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:03.928730 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:03.928629    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:46:04.026889 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:04.026839    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:46:06.520336 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.520265    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:46:06.528181 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.528157    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istio-podinfo\") pod \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") "
Jul 21 20:46:06.528330 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.528200    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istio-data\") pod \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") "
Jul 21 20:46:06.528330 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.528227    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istio-envoy\") pod \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") "
Jul 21 20:46:06.528444 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.528322    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istiod-ca-cert\") pod \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") "
Jul 21 20:46:06.528444 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.528375    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-workload-socket\") pod \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") "
Jul 21 20:46:06.528444 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.528402    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-workload-certs\") pod \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") "
Jul 21 20:46:06.528608 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.528516    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istio-token\") pod \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") "
Jul 21 20:46:06.528608 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.528568    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-credential-socket\") pod \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") "
Jul 21 20:46:06.528732 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.528628    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chv9r\" (UniqueName: \"kubernetes.io/projected/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-kube-api-access-chv9r\") pod \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\" (UID: \"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b\") "
Jul 21 20:46:06.529483 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.528925    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b" (UID: "c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:46:06.529483 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.529115    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b" (UID: "c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:46:06.529483 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.529065    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istio-data" (OuterVolumeSpecName: "istio-data") pod "c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b" (UID: "c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:46:06.529483 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.529237    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b" (UID: "c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:46:06.529483 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.529425    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b" (UID: "c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:46:06.529885 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.529681    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istiod-ca-cert\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:46:06.529885 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.529718    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-workload-socket\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:46:06.529885 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.529732    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-workload-certs\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:46:06.529885 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.529745    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-credential-socket\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:46:06.529885 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.529758    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istio-data\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:46:06.530978 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.530933    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b" (UID: "c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 20:46:06.530978 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.530966    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b" (UID: "c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:46:06.531151 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.531067    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istio-token" (OuterVolumeSpecName: "istio-token") pod "c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b" (UID: "c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:46:06.531374 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.531344    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-kube-api-access-chv9r" (OuterVolumeSpecName: "kube-api-access-chv9r") pod "c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b" (UID: "c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b"). InnerVolumeSpecName "kube-api-access-chv9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:46:06.630792 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.630755    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istio-envoy\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:46:06.630792 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.630787    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istio-token\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:46:06.630792 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.630797    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chv9r\" (UniqueName: \"kubernetes.io/projected/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-kube-api-access-chv9r\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:46:06.631028 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.630806    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b-istio-podinfo\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:46:06.723513 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.723466    2576 generic.go:356] "Generic (PLEG): container finished" podID="c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b" containerID="59844af533489fbc42b4330598d65ac31f39f90003e31e525ee99fbbbc0868e2" exitCode=0
Jul 21 20:46:06.723745 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.723525    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx" event={"ID":"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b","Type":"ContainerDied","Data":"59844af533489fbc42b4330598d65ac31f39f90003e31e525ee99fbbbc0868e2"}
Jul 21 20:46:06.723745 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.723534    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"
Jul 21 20:46:06.723745 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.723585    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx" event={"ID":"c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b","Type":"ContainerDied","Data":"465896e8b95939ac860981e4cbbd9cd4ddbab03f2179f6ae6da386e5ed185e7f"}
Jul 21 20:46:06.723745 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.723614    2576 scope.go:117] "RemoveContainer" containerID="59844af533489fbc42b4330598d65ac31f39f90003e31e525ee99fbbbc0868e2"
Jul 21 20:46:06.733062 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.733041    2576 scope.go:117] "RemoveContainer" containerID="19d5e10f082d0f546ba6843a1908c378d180a7a846ced0c6350c41d5a0df7589"
Jul 21 20:46:06.742047 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.742027    2576 scope.go:117] "RemoveContainer" containerID="59844af533489fbc42b4330598d65ac31f39f90003e31e525ee99fbbbc0868e2"
Jul 21 20:46:06.742316 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:46:06.742293    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59844af533489fbc42b4330598d65ac31f39f90003e31e525ee99fbbbc0868e2\": container with ID starting with 59844af533489fbc42b4330598d65ac31f39f90003e31e525ee99fbbbc0868e2 not found: ID does not exist" containerID="59844af533489fbc42b4330598d65ac31f39f90003e31e525ee99fbbbc0868e2"
Jul 21 20:46:06.742390 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.742323    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59844af533489fbc42b4330598d65ac31f39f90003e31e525ee99fbbbc0868e2"} err="failed to get container status \"59844af533489fbc42b4330598d65ac31f39f90003e31e525ee99fbbbc0868e2\": rpc error: code = NotFound desc = could not find container \"59844af533489fbc42b4330598d65ac31f39f90003e31e525ee99fbbbc0868e2\": container with ID starting with 59844af533489fbc42b4330598d65ac31f39f90003e31e525ee99fbbbc0868e2 not found: ID does not exist"
Jul 21 20:46:06.742390 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.742340    2576 scope.go:117] "RemoveContainer" containerID="19d5e10f082d0f546ba6843a1908c378d180a7a846ced0c6350c41d5a0df7589"
Jul 21 20:46:06.742564 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:46:06.742548    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19d5e10f082d0f546ba6843a1908c378d180a7a846ced0c6350c41d5a0df7589\": container with ID starting with 19d5e10f082d0f546ba6843a1908c378d180a7a846ced0c6350c41d5a0df7589 not found: ID does not exist" containerID="19d5e10f082d0f546ba6843a1908c378d180a7a846ced0c6350c41d5a0df7589"
Jul 21 20:46:06.742609 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.742568    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19d5e10f082d0f546ba6843a1908c378d180a7a846ced0c6350c41d5a0df7589"} err="failed to get container status \"19d5e10f082d0f546ba6843a1908c378d180a7a846ced0c6350c41d5a0df7589\": rpc error: code = NotFound desc = could not find container \"19d5e10f082d0f546ba6843a1908c378d180a7a846ced0c6350c41d5a0df7589\": container with ID starting with 19d5e10f082d0f546ba6843a1908c378d180a7a846ced0c6350c41d5a0df7589 not found: ID does not exist"
Jul 21 20:46:06.748274 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.748248    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"]
Jul 21 20:46:06.753996 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:06.753973    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-868c4ca9-gw-openshift-default-84bf76f49f-x4xdx"]
Jul 21 20:46:07.651915 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:07.651879    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b" path="/var/lib/kubelet/pods/c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b/volumes"
Jul 21 20:46:19.748894 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:19.748847    2576 patch_prober.go:28] interesting pod/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 21 20:46:19.749290 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:19.748920    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt" podUID="deb7faa0-e002-4ffc-8a26-dce50c3e30b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 21 20:46:20.797286 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:20.797253    2576 generic.go:356] "Generic (PLEG): container finished" podID="deb7faa0-e002-4ffc-8a26-dce50c3e30b9" containerID="b37b5775a4382700fea66bead9a63f227d6cbaa2b367deb98e23c12db9cb7073" exitCode=0
Jul 21 20:46:20.797775 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:20.797325    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt" event={"ID":"deb7faa0-e002-4ffc-8a26-dce50c3e30b9","Type":"ContainerDied","Data":"b37b5775a4382700fea66bead9a63f227d6cbaa2b367deb98e23c12db9cb7073"}
Jul 21 20:46:20.797775 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:20.797761    2576 scope.go:117] "RemoveContainer" containerID="b37b5775a4382700fea66bead9a63f227d6cbaa2b367deb98e23c12db9cb7073"
Jul 21 20:46:20.798812 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:20.798785    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:46:20.798885 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:20.798850    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:46:20.798930 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:20.798884    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:46:21.804054 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:21.804021    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt" event={"ID":"deb7faa0-e002-4ffc-8a26-dce50c3e30b9","Type":"ContainerStarted","Data":"2cc2c5bbc0f606940600be4167746f515cf5805fc4c4c3642f424088e7e624a9"}
Jul 21 20:46:22.308072 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:22.308027    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:22.308290 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:22.308269    2576 patch_prober.go:28] interesting pod/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 21 20:46:22.308337 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:22.308319    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt" podUID="deb7faa0-e002-4ffc-8a26-dce50c3e30b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 21 20:46:23.307958 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:23.307918    2576 patch_prober.go:28] interesting pod/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 21 20:46:23.308354 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:23.307984    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt" podUID="deb7faa0-e002-4ffc-8a26-dce50c3e30b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 21 20:46:24.308418 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:24.308377    2576 patch_prober.go:28] interesting pod/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 21 20:46:24.308838 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:24.308447    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt" podUID="deb7faa0-e002-4ffc-8a26-dce50c3e30b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 21 20:46:25.308221 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:25.308175    2576 patch_prober.go:28] interesting pod/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 21 20:46:25.308443 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:25.308241    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt" podUID="deb7faa0-e002-4ffc-8a26-dce50c3e30b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 21 20:46:26.312267 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:26.312234    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:26.312796 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:26.312629    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:46:26.313992 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:46:26.313964    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:47:01.613230 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:47:01.613149    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:47:01.770808 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:47:01.770773    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:47:08.981538 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:47:08.981499    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:47:09.046046 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:47:09.046017    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:48:01.888571 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:01.888539    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:48:04.718370 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:04.718332    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:48:04.773710 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:04.773653    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:48:33.022396 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:33.022304    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"]
Jul 21 20:48:33.023073 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:33.022517    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt" podUID="deb7faa0-e002-4ffc-8a26-dce50c3e30b9" containerName="istio-proxy" containerID="cri-o://2cc2c5bbc0f606940600be4167746f515cf5805fc4c4c3642f424088e7e624a9" gracePeriod=30
Jul 21 20:48:33.066129 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:33.066094    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:48:33.259878 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:33.259851    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:48:33.518858 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:33.518826    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:48:33.995679 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:33.995564    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"]
Jul 21 20:48:33.996079 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:33.996058    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d797ba3e-c2f2-488d-afe5-26600281b43a" containerName="istio-proxy"
Jul 21 20:48:33.996079 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:33.996078    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d797ba3e-c2f2-488d-afe5-26600281b43a" containerName="istio-proxy"
Jul 21 20:48:33.996285 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:33.996096    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b" containerName="istio-proxy"
Jul 21 20:48:33.996285 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:33.996103    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b" containerName="istio-proxy"
Jul 21 20:48:33.996285 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:33.996178    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b" containerName="istio-proxy"
Jul 21 20:48:33.996285 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:33.996191    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b" containerName="istio-proxy"
Jul 21 20:48:33.999319 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:33.999302    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.005300 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.005282    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-3f69897a-openshift-default-dockercfg-r69z7\""
Jul 21 20:48:34.030512 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.030484    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:48:34.052291 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.052256    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"]
Jul 21 20:48:34.074046 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.074015    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istio-token\") pod \"e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") " pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.074213 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.074061    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-credential-socket\") pod \"e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") " pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.074213 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.074115    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-workload-socket\") pod \"e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") " pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.074213 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.074186    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-workload-certs\") pod \"e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") " pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.074323 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.074229    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istio-data\") pod \"e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") " pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.074323 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.074248    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istio-podinfo\") pod \"e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") " pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.074323 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.074264    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istiod-ca-cert\") pod \"e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") " pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.074416 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.074329    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istio-envoy\") pod \"e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") " pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.074416 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.074353    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nzkf\" (UniqueName: \"kubernetes.io/projected/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-kube-api-access-5nzkf\") pod \"e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") " pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.175386 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.175347    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istio-envoy\") pod \"e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") " pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.175386 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.175388    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nzkf\" (UniqueName: \"kubernetes.io/projected/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-kube-api-access-5nzkf\") pod \"e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") " pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.175657 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.175412    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istio-token\") pod \"e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") " pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.175657 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.175446    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-credential-socket\") pod \"e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") " pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.175657 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.175471    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-workload-socket\") pod \"e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") " pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.175657 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.175525    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-workload-certs\") pod \"e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") " pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.175657 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.175555    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istio-data\") pod \"e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") " pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.175657 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.175590    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istio-podinfo\") pod \"e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") " pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.175657 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.175613    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istiod-ca-cert\") pod \"e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") " pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.176066 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.175996    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-credential-socket\") pod \"e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") " pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.176066 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.176024    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-workload-socket\") pod \"e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") " pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.176182 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.176078    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-workload-certs\") pod \"e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") " pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.176182 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.176159    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istio-data\") pod \"e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") " pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.176483 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.176461    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istiod-ca-cert\") pod \"e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") " pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.177925 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.177905    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istio-envoy\") pod \"e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") " pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.178060 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.178043    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istio-podinfo\") pod \"e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") " pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.188024 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.187999    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istio-token\") pod \"e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") " pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.188186 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.188168    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nzkf\" (UniqueName: \"kubernetes.io/projected/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-kube-api-access-5nzkf\") pod \"e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") " pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.309228 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.309194    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:34.400745 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.400660    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:48:34.496931 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.496909    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"]
Jul 21 20:48:34.503166 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.503130    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:48:34.503259 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.503198    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:48:34.503259 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:34.503228    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:48:35.484574 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:35.484537    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w" event={"ID":"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf","Type":"ContainerStarted","Data":"1889891cc93b06080714f7489eee5e93a73a1851b67744852e80923f4cbf4423"}
Jul 21 20:48:35.484988 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:35.484594    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w" event={"ID":"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf","Type":"ContainerStarted","Data":"9825455671cb471a4f9642dcac2d225e12fdd4ab7384088e3da962b0068631a0"}
Jul 21 20:48:35.507614 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:35.507515    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w" podStartSLOduration=2.507493698 podStartE2EDuration="2.507493698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:48:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:48:35.506850915 +0000 UTC m=+2066.439249076" watchObservedRunningTime="2026-07-21 20:48:35.507493698 +0000 UTC m=+2066.439891856"
Jul 21 20:48:35.941846 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:35.941815    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:48:36.080650 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:36.080617    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:48:36.310088 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:36.310048    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:36.315150 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:36.315123    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:36.398351 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:36.398314    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:48:36.489980 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:36.489945    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:36.490873 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:36.490855    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:36.777900 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:36.777865    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:48:36.878575 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:36.878530    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:48:38.285742 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.285655    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:48:38.313485 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.313451    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istio-token\") pod \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") "
Jul 21 20:48:38.313668 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.313499    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8r92k\" (UniqueName: \"kubernetes.io/projected/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-kube-api-access-8r92k\") pod \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") "
Jul 21 20:48:38.313668 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.313538    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-credential-socket\") pod \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") "
Jul 21 20:48:38.313668 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.313574    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-workload-socket\") pod \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") "
Jul 21 20:48:38.313668 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.313637    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istio-podinfo\") pod \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") "
Jul 21 20:48:38.313998 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.313677    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istio-envoy\") pod \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") "
Jul 21 20:48:38.313998 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.313791    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-workload-certs\") pod \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") "
Jul 21 20:48:38.313998 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.313854    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istio-data\") pod \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") "
Jul 21 20:48:38.313998 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.313853    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "deb7faa0-e002-4ffc-8a26-dce50c3e30b9" (UID: "deb7faa0-e002-4ffc-8a26-dce50c3e30b9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:48:38.313998 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.313885    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istiod-ca-cert\") pod \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\" (UID: \"deb7faa0-e002-4ffc-8a26-dce50c3e30b9\") "
Jul 21 20:48:38.313998 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.313922    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "deb7faa0-e002-4ffc-8a26-dce50c3e30b9" (UID: "deb7faa0-e002-4ffc-8a26-dce50c3e30b9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:48:38.314309 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.314217    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-credential-socket\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:48:38.314309 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.314236    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-workload-socket\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:48:38.314475 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.314451    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "deb7faa0-e002-4ffc-8a26-dce50c3e30b9" (UID: "deb7faa0-e002-4ffc-8a26-dce50c3e30b9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:48:38.315048 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.315021    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istio-data" (OuterVolumeSpecName: "istio-data") pod "deb7faa0-e002-4ffc-8a26-dce50c3e30b9" (UID: "deb7faa0-e002-4ffc-8a26-dce50c3e30b9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:48:38.315358 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.315335    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "deb7faa0-e002-4ffc-8a26-dce50c3e30b9" (UID: "deb7faa0-e002-4ffc-8a26-dce50c3e30b9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:48:38.316250 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.316222    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "deb7faa0-e002-4ffc-8a26-dce50c3e30b9" (UID: "deb7faa0-e002-4ffc-8a26-dce50c3e30b9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 20:48:38.316350 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.316335    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istio-token" (OuterVolumeSpecName: "istio-token") pod "deb7faa0-e002-4ffc-8a26-dce50c3e30b9" (UID: "deb7faa0-e002-4ffc-8a26-dce50c3e30b9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:48:38.316412 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.316353    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-kube-api-access-8r92k" (OuterVolumeSpecName: "kube-api-access-8r92k") pod "deb7faa0-e002-4ffc-8a26-dce50c3e30b9" (UID: "deb7faa0-e002-4ffc-8a26-dce50c3e30b9"). InnerVolumeSpecName "kube-api-access-8r92k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:48:38.316497 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.316481    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "deb7faa0-e002-4ffc-8a26-dce50c3e30b9" (UID: "deb7faa0-e002-4ffc-8a26-dce50c3e30b9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:48:38.414780 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.414735    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istio-token\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:48:38.414780 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.414769    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8r92k\" (UniqueName: \"kubernetes.io/projected/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-kube-api-access-8r92k\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:48:38.414780 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.414780    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istio-podinfo\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:48:38.414780 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.414789    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istio-envoy\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:48:38.414780 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.414798    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-workload-certs\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:48:38.415094 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.414806    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istio-data\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:48:38.415094 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.414813    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/deb7faa0-e002-4ffc-8a26-dce50c3e30b9-istiod-ca-cert\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:48:38.501195 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.501165    2576 generic.go:356] "Generic (PLEG): container finished" podID="deb7faa0-e002-4ffc-8a26-dce50c3e30b9" containerID="2cc2c5bbc0f606940600be4167746f515cf5805fc4c4c3642f424088e7e624a9" exitCode=0
Jul 21 20:48:38.501347 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.501210    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"
Jul 21 20:48:38.501347 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.501249    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt" event={"ID":"deb7faa0-e002-4ffc-8a26-dce50c3e30b9","Type":"ContainerDied","Data":"2cc2c5bbc0f606940600be4167746f515cf5805fc4c4c3642f424088e7e624a9"}
Jul 21 20:48:38.501347 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.501320    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt" event={"ID":"deb7faa0-e002-4ffc-8a26-dce50c3e30b9","Type":"ContainerDied","Data":"0ea2065a3bb97a5f20acded5fb833d12bad0fda62ecb6b597beacd3fe8b8c5d7"}
Jul 21 20:48:38.501347 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.501341    2576 scope.go:117] "RemoveContainer" containerID="2cc2c5bbc0f606940600be4167746f515cf5805fc4c4c3642f424088e7e624a9"
Jul 21 20:48:38.511300 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.511280    2576 scope.go:117] "RemoveContainer" containerID="b37b5775a4382700fea66bead9a63f227d6cbaa2b367deb98e23c12db9cb7073"
Jul 21 20:48:38.519739 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.519716    2576 scope.go:117] "RemoveContainer" containerID="2cc2c5bbc0f606940600be4167746f515cf5805fc4c4c3642f424088e7e624a9"
Jul 21 20:48:38.520042 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:48:38.520016    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cc2c5bbc0f606940600be4167746f515cf5805fc4c4c3642f424088e7e624a9\": container with ID starting with 2cc2c5bbc0f606940600be4167746f515cf5805fc4c4c3642f424088e7e624a9 not found: ID does not exist" containerID="2cc2c5bbc0f606940600be4167746f515cf5805fc4c4c3642f424088e7e624a9"
Jul 21 20:48:38.520097 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.520060    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cc2c5bbc0f606940600be4167746f515cf5805fc4c4c3642f424088e7e624a9"} err="failed to get container status \"2cc2c5bbc0f606940600be4167746f515cf5805fc4c4c3642f424088e7e624a9\": rpc error: code = NotFound desc = could not find container \"2cc2c5bbc0f606940600be4167746f515cf5805fc4c4c3642f424088e7e624a9\": container with ID starting with 2cc2c5bbc0f606940600be4167746f515cf5805fc4c4c3642f424088e7e624a9 not found: ID does not exist"
Jul 21 20:48:38.520097 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.520085    2576 scope.go:117] "RemoveContainer" containerID="b37b5775a4382700fea66bead9a63f227d6cbaa2b367deb98e23c12db9cb7073"
Jul 21 20:48:38.520350 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:48:38.520333    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b37b5775a4382700fea66bead9a63f227d6cbaa2b367deb98e23c12db9cb7073\": container with ID starting with b37b5775a4382700fea66bead9a63f227d6cbaa2b367deb98e23c12db9cb7073 not found: ID does not exist" containerID="b37b5775a4382700fea66bead9a63f227d6cbaa2b367deb98e23c12db9cb7073"
Jul 21 20:48:38.520396 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.520357    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b37b5775a4382700fea66bead9a63f227d6cbaa2b367deb98e23c12db9cb7073"} err="failed to get container status \"b37b5775a4382700fea66bead9a63f227d6cbaa2b367deb98e23c12db9cb7073\": rpc error: code = NotFound desc = could not find container \"b37b5775a4382700fea66bead9a63f227d6cbaa2b367deb98e23c12db9cb7073\": container with ID starting with b37b5775a4382700fea66bead9a63f227d6cbaa2b367deb98e23c12db9cb7073 not found: ID does not exist"
Jul 21 20:48:38.524584 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.524561    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"]
Jul 21 20:48:38.530102 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:38.530079    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-672ca14c-openshift-default-696c96dd49-b5cpt"]
Jul 21 20:48:39.651812 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:39.651775    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="deb7faa0-e002-4ffc-8a26-dce50c3e30b9" path="/var/lib/kubelet/pods/deb7faa0-e002-4ffc-8a26-dce50c3e30b9/volumes"
Jul 21 20:48:51.798545 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:51.796871    2576 patch_prober.go:28] interesting pod/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": read tcp 10.133.0.2:54606->10.133.0.50:15021: read: connection reset by peer" start-of-body=
Jul 21 20:48:51.798545 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:51.796953    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w" podUID="e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": read tcp 10.133.0.2:54606->10.133.0.50:15021: read: connection reset by peer"
Jul 21 20:48:52.587642 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:52.587608    2576 generic.go:356] "Generic (PLEG): container finished" podID="e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf" containerID="1889891cc93b06080714f7489eee5e93a73a1851b67744852e80923f4cbf4423" exitCode=0
Jul 21 20:48:52.587836 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:52.587669    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w" event={"ID":"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf","Type":"ContainerDied","Data":"1889891cc93b06080714f7489eee5e93a73a1851b67744852e80923f4cbf4423"}
Jul 21 20:48:52.588128 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:52.588112    2576 scope.go:117] "RemoveContainer" containerID="1889891cc93b06080714f7489eee5e93a73a1851b67744852e80923f4cbf4423"
Jul 21 20:48:52.589194 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:52.589166    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:48:52.589279 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:52.589261    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:48:52.589325 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:52.589308    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:48:53.594322 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:53.594291    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w" event={"ID":"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf","Type":"ContainerStarted","Data":"9fe25d55927d659f85e5998f9bc6c0d1119a5f63dddd16218c0763661908350e"}
Jul 21 20:48:54.310449 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:54.310405    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:54.310655 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:54.310630    2576 patch_prober.go:28] interesting pod/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 21 20:48:54.310729 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:54.310683    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w" podUID="e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 21 20:48:55.310709 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:55.310646    2576 patch_prober.go:28] interesting pod/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 21 20:48:55.311115 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:55.310723    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w" podUID="e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 21 20:48:56.310508 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:56.310466    2576 patch_prober.go:28] interesting pod/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 21 20:48:56.310709 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:56.310523    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w" podUID="e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 21 20:48:57.310383 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:57.310342    2576 patch_prober.go:28] interesting pod/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 21 20:48:57.310812 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:57.310416    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w" podUID="e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 21 20:48:57.787525 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:57.787483    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:48:58.313455 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:58.313420    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:58.313943 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:58.313870    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:48:58.314440 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:48:58.314421    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:49:01.850277 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:01.850237    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"]
Jul 21 20:49:01.850789 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:01.850539    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w" podUID="e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf" containerName="istio-proxy" containerID="cri-o://9fe25d55927d659f85e5998f9bc6c0d1119a5f63dddd16218c0763661908350e" gracePeriod=30
Jul 21 20:49:01.898551 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:01.898514    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:49:02.106985 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:02.106900    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:49:02.562443 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:02.562412    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:49:02.682519 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:02.682487    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:49:04.264643 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:04.264607    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:49:07.118596 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.118533    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:49:07.304453 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.304411    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istio-envoy\") pod \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") "
Jul 21 20:49:07.304664 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.304471    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nzkf\" (UniqueName: \"kubernetes.io/projected/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-kube-api-access-5nzkf\") pod \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") "
Jul 21 20:49:07.304664 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.304503    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-workload-certs\") pod \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") "
Jul 21 20:49:07.304664 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.304567    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istio-podinfo\") pod \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") "
Jul 21 20:49:07.304664 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.304633    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istio-data\") pod \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") "
Jul 21 20:49:07.304664 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.304657    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istio-token\") pod \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") "
Jul 21 20:49:07.304968 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.304740    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istiod-ca-cert\") pod \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") "
Jul 21 20:49:07.304968 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.304775    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-credential-socket\") pod \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") "
Jul 21 20:49:07.304968 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.304826    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-workload-socket\") pod \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\" (UID: \"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf\") "
Jul 21 20:49:07.304968 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.304852    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf" (UID: "e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:49:07.305166 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.305137    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf" (UID: "e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:49:07.305226 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.305172    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-workload-certs\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:49:07.305321 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.305300    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf" (UID: "e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:49:07.305401 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.305378    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf" (UID: "e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:49:07.305524 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.305494    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istio-data" (OuterVolumeSpecName: "istio-data") pod "e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf" (UID: "e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:49:07.306944 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.306913    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-kube-api-access-5nzkf" (OuterVolumeSpecName: "kube-api-access-5nzkf") pod "e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf" (UID: "e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf"). InnerVolumeSpecName "kube-api-access-5nzkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:49:07.306944 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.306937    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf" (UID: "e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:49:07.307091 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.306945    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf" (UID: "e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 20:49:07.307091 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.307019    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istio-token" (OuterVolumeSpecName: "istio-token") pod "e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf" (UID: "e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:49:07.406607 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.406515    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istio-envoy\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:49:07.406607 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.406549    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nzkf\" (UniqueName: \"kubernetes.io/projected/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-kube-api-access-5nzkf\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:49:07.406607 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.406559    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istio-podinfo\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:49:07.406607 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.406568    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istio-data\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:49:07.406607 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.406576    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istio-token\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:49:07.406607 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.406583    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-istiod-ca-cert\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:49:07.406607 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.406590    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-credential-socket\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:49:07.406607 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.406598    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf-workload-socket\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:49:07.668735 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.668679    2576 generic.go:356] "Generic (PLEG): container finished" podID="e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf" containerID="9fe25d55927d659f85e5998f9bc6c0d1119a5f63dddd16218c0763661908350e" exitCode=0
Jul 21 20:49:07.668735 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.668729    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w" event={"ID":"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf","Type":"ContainerDied","Data":"9fe25d55927d659f85e5998f9bc6c0d1119a5f63dddd16218c0763661908350e"}
Jul 21 20:49:07.668939 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.668761    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"
Jul 21 20:49:07.668939 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.668783    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w" event={"ID":"e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf","Type":"ContainerDied","Data":"9825455671cb471a4f9642dcac2d225e12fdd4ab7384088e3da962b0068631a0"}
Jul 21 20:49:07.668939 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.668804    2576 scope.go:117] "RemoveContainer" containerID="9fe25d55927d659f85e5998f9bc6c0d1119a5f63dddd16218c0763661908350e"
Jul 21 20:49:07.677965 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.677946    2576 scope.go:117] "RemoveContainer" containerID="1889891cc93b06080714f7489eee5e93a73a1851b67744852e80923f4cbf4423"
Jul 21 20:49:07.687287 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.687264    2576 scope.go:117] "RemoveContainer" containerID="9fe25d55927d659f85e5998f9bc6c0d1119a5f63dddd16218c0763661908350e"
Jul 21 20:49:07.687634 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:49:07.687601    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fe25d55927d659f85e5998f9bc6c0d1119a5f63dddd16218c0763661908350e\": container with ID starting with 9fe25d55927d659f85e5998f9bc6c0d1119a5f63dddd16218c0763661908350e not found: ID does not exist" containerID="9fe25d55927d659f85e5998f9bc6c0d1119a5f63dddd16218c0763661908350e"
Jul 21 20:49:07.687771 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.687643    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fe25d55927d659f85e5998f9bc6c0d1119a5f63dddd16218c0763661908350e"} err="failed to get container status \"9fe25d55927d659f85e5998f9bc6c0d1119a5f63dddd16218c0763661908350e\": rpc error: code = NotFound desc = could not find container \"9fe25d55927d659f85e5998f9bc6c0d1119a5f63dddd16218c0763661908350e\": container with ID starting with 9fe25d55927d659f85e5998f9bc6c0d1119a5f63dddd16218c0763661908350e not found: ID does not exist"
Jul 21 20:49:07.687771 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.687660    2576 scope.go:117] "RemoveContainer" containerID="1889891cc93b06080714f7489eee5e93a73a1851b67744852e80923f4cbf4423"
Jul 21 20:49:07.687934 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:49:07.687914    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1889891cc93b06080714f7489eee5e93a73a1851b67744852e80923f4cbf4423\": container with ID starting with 1889891cc93b06080714f7489eee5e93a73a1851b67744852e80923f4cbf4423 not found: ID does not exist" containerID="1889891cc93b06080714f7489eee5e93a73a1851b67744852e80923f4cbf4423"
Jul 21 20:49:07.687979 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.687942    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1889891cc93b06080714f7489eee5e93a73a1851b67744852e80923f4cbf4423"} err="failed to get container status \"1889891cc93b06080714f7489eee5e93a73a1851b67744852e80923f4cbf4423\": rpc error: code = NotFound desc = could not find container \"1889891cc93b06080714f7489eee5e93a73a1851b67744852e80923f4cbf4423\": container with ID starting with 1889891cc93b06080714f7489eee5e93a73a1851b67744852e80923f4cbf4423 not found: ID does not exist"
Jul 21 20:49:07.695299 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.695273    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"]
Jul 21 20:49:07.699383 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:07.699350    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-3f69897a-openshift-default-55f5f5dd7-g5g5w"]
Jul 21 20:49:09.652575 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:09.652548    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf" path="/var/lib/kubelet/pods/e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf/volumes"
Jul 21 20:49:09.660003 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:09.659981    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w885b_62db291a-14b7-4e35-9550-9fb810f82b8d/console-operator/1.log"
Jul 21 20:49:09.667184 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:09.667155    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-54f9x_55f51c26-71cd-4e1b-84f2-32f2de4138d5/ovn-acl-logging/0.log"
Jul 21 20:49:09.668613 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:09.668595    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w885b_62db291a-14b7-4e35-9550-9fb810f82b8d/console-operator/1.log"
Jul 21 20:49:09.674946 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:09.674924    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-54f9x_55f51c26-71cd-4e1b-84f2-32f2de4138d5/ovn-acl-logging/0.log"
Jul 21 20:49:10.364865 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:10.364834    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:49:10.425317 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:10.425278    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:49:10.503934 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:10.503850    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:49:10.604127 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:10.604091    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:49:10.704589 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:10.704558    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:49:11.050968 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:11.050939    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:49:37.003987 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:37.003944    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:49:43.522123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:43.522088    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:49:43.629017 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:43.628981    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:49:43.726256 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:43.726226    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:49:59.608596 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:49:59.608564    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:50:05.848592 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:05.848514    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:50:05.922219 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:05.922180    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:50:06.022888 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:06.022846    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:50:16.636220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:16.636182    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:50:17.394447 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:17.394417    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:50:23.470056 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:23.470020    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:50:23.588821 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:23.588783    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:50:23.691409 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:23.691376    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:50:23.788032 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:23.788001    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:50:24.605118 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:24.605088    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:50:24.715111 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:24.715081    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:50:26.380154 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:26.380115    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:50:32.643771 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:32.643734    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:50:32.765989 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:32.765954    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:50:33.316191 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:33.316158    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:50:39.656347 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:39.656306    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:50:40.244126 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.244090    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"]
Jul 21 20:50:40.244482 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.244470    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf" containerName="istio-proxy"
Jul 21 20:50:40.244536 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.244484    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf" containerName="istio-proxy"
Jul 21 20:50:40.244536 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.244492    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deb7faa0-e002-4ffc-8a26-dce50c3e30b9" containerName="istio-proxy"
Jul 21 20:50:40.244536 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.244498    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="deb7faa0-e002-4ffc-8a26-dce50c3e30b9" containerName="istio-proxy"
Jul 21 20:50:40.244536 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.244505    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deb7faa0-e002-4ffc-8a26-dce50c3e30b9" containerName="istio-proxy"
Jul 21 20:50:40.244536 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.244510    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="deb7faa0-e002-4ffc-8a26-dce50c3e30b9" containerName="istio-proxy"
Jul 21 20:50:40.244728 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.244542    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b" containerName="istio-proxy"
Jul 21 20:50:40.244728 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.244548    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c35d8d18-2d11-4e96-a7bc-5dd6a9461c1b" containerName="istio-proxy"
Jul 21 20:50:40.244728 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.244609    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="deb7faa0-e002-4ffc-8a26-dce50c3e30b9" containerName="istio-proxy"
Jul 21 20:50:40.244728 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.244615    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf" containerName="istio-proxy"
Jul 21 20:50:40.244728 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.244624    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf" containerName="istio-proxy"
Jul 21 20:50:40.244728 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.244631    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="deb7faa0-e002-4ffc-8a26-dce50c3e30b9" containerName="istio-proxy"
Jul 21 20:50:40.247844 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.247826    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.250152 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.250133    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-83e6600b-openshift-default-dockercfg-hqrgp\""
Jul 21 20:50:40.271747 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.271718    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"]
Jul 21 20:50:40.326460 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.326420    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-credential-socket\") pod \"e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") " pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.326667 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.326539    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istio-podinfo\") pod \"e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") " pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.326667 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.326584    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istio-envoy\") pod \"e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") " pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.326667 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.326610    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-workload-certs\") pod \"e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") " pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.326886 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.326683    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgbs7\" (UniqueName: \"kubernetes.io/projected/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-kube-api-access-tgbs7\") pod \"e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") " pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.326886 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.326762    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-workload-socket\") pod \"e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") " pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.326886 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.326848    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istio-token\") pod \"e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") " pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.327039 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.326912    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istio-data\") pod \"e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") " pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.327039 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.326957    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istiod-ca-cert\") pod \"e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") " pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.428386 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.427999    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-workload-socket\") pod \"e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") " pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.428386 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.428103    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istio-token\") pod \"e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") " pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.428386 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.428148    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istio-data\") pod \"e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") " pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.428386 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.428193    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istiod-ca-cert\") pod \"e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") " pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.428386 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.428222    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-credential-socket\") pod \"e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") " pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.428386 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.428264    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istio-podinfo\") pod \"e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") " pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.428386 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.428291    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istio-envoy\") pod \"e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") " pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.428386 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.428316    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-workload-certs\") pod \"e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") " pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.428386 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.428354    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgbs7\" (UniqueName: \"kubernetes.io/projected/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-kube-api-access-tgbs7\") pod \"e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") " pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.429125 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.429101    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-workload-socket\") pod \"e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") " pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.429271 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.429248    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-credential-socket\") pod \"e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") " pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.430089 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.429784    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istio-data\") pod \"e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") " pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.430222 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.430177    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-workload-certs\") pod \"e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") " pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.430222 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.430178    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istiod-ca-cert\") pod \"e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") " pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.432130 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.432099    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istio-podinfo\") pod \"e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") " pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.432273 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.432255    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istio-envoy\") pod \"e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") " pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.437145 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.437119    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istio-token\") pod \"e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") " pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.437774 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.437751    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgbs7\" (UniqueName: \"kubernetes.io/projected/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-kube-api-access-tgbs7\") pod \"e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") " pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.558577 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.558539    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:40.711878 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.711851    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"]
Jul 21 20:50:40.713859 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:50:40.713829    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e15d000_a678_46d5_9fbb_ff46ecf71cd5.slice/crio-4477d1896f144a80ac3efff8fc6d6a3a8332cc49d4209323b6f12a4679a8a3e2 WatchSource:0}: Error finding container 4477d1896f144a80ac3efff8fc6d6a3a8332cc49d4209323b6f12a4679a8a3e2: Status 404 returned error can't find the container with id 4477d1896f144a80ac3efff8fc6d6a3a8332cc49d4209323b6f12a4679a8a3e2
Jul 21 20:50:40.716046 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.716011    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:50:40.716138 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.716081    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:50:40.716138 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:40.716108    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:50:41.139752 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:41.139710    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5" event={"ID":"9e15d000-a678-46d5-9fbb-ff46ecf71cd5","Type":"ContainerStarted","Data":"0fd708a0c6888f20038fef34e2e0ca535afd7384626c764a82610bcabbd9a4bf"}
Jul 21 20:50:41.139936 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:41.139768    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5" event={"ID":"9e15d000-a678-46d5-9fbb-ff46ecf71cd5","Type":"ContainerStarted","Data":"4477d1896f144a80ac3efff8fc6d6a3a8332cc49d4209323b6f12a4679a8a3e2"}
Jul 21 20:50:41.161046 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:41.160990    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5" podStartSLOduration=1.160969308 podStartE2EDuration="1.160969308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:50:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:50:41.15984876 +0000 UTC m=+2192.092246917" watchObservedRunningTime="2026-07-21 20:50:41.160969308 +0000 UTC m=+2192.093367465"
Jul 21 20:50:41.558886 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:41.558842    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:41.563926 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:41.563891    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:42.145256 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:42.145227    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:42.146195 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:42.146172    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:43.425104 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:43.425071    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:50:47.577435 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:47.577398    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:50:48.290158 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:48.290115    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:50:48.379608 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:48.379558    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:50:48.700366 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:48.700272    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:50:54.208367 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:54.208265    2576 generic.go:356] "Generic (PLEG): container finished" podID="9e15d000-a678-46d5-9fbb-ff46ecf71cd5" containerID="0fd708a0c6888f20038fef34e2e0ca535afd7384626c764a82610bcabbd9a4bf" exitCode=0
Jul 21 20:50:54.208367 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:54.208342    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5" event={"ID":"9e15d000-a678-46d5-9fbb-ff46ecf71cd5","Type":"ContainerDied","Data":"0fd708a0c6888f20038fef34e2e0ca535afd7384626c764a82610bcabbd9a4bf"}
Jul 21 20:50:54.208917 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:54.208801    2576 scope.go:117] "RemoveContainer" containerID="0fd708a0c6888f20038fef34e2e0ca535afd7384626c764a82610bcabbd9a4bf"
Jul 21 20:50:54.210004 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:54.209971    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:50:54.210106 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:54.210046    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:50:54.210106 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:54.210080    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:50:55.139518 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:55.139485    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:50:55.216166 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:55.216128    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:50:55.216671 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:55.216650    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5" event={"ID":"9e15d000-a678-46d5-9fbb-ff46ecf71cd5","Type":"ContainerStarted","Data":"f77e326124e1aed4366f1069aa0409894694ce726a2ae347bde19a1df33c472c"}
Jul 21 20:50:55.559609 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:55.559565    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:55.560650 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:55.560623    2576 patch_prober.go:28] interesting pod/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 21 20:50:55.560790 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:55.560673    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5" podUID="9e15d000-a678-46d5-9fbb-ff46ecf71cd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 21 20:50:55.823276 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:55.823179    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:50:56.559039 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:56.559002    2576 patch_prober.go:28] interesting pod/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 21 20:50:56.559421 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:56.559061    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5" podUID="9e15d000-a678-46d5-9fbb-ff46ecf71cd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 21 20:50:57.146029 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:57.145982    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:50:57.559451 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:57.559406    2576 patch_prober.go:28] interesting pod/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 21 20:50:57.559902 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:57.559469    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5" podUID="9e15d000-a678-46d5-9fbb-ff46ecf71cd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 21 20:50:58.559637 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:58.559595    2576 patch_prober.go:28] interesting pod/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 21 20:50:58.560050 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:58.559652    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5" podUID="9e15d000-a678-46d5-9fbb-ff46ecf71cd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 21 20:50:59.559401 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:59.559354    2576 patch_prober.go:28] interesting pod/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 21 20:50:59.559586 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:50:59.559435    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5" podUID="9e15d000-a678-46d5-9fbb-ff46ecf71cd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 21 20:51:00.563523 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:00.563493    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:51:00.564404 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:00.564386    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:51:02.010243 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:02.010207    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:51:02.077535 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:02.077505    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:51:02.262329 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:02.262234    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"]
Jul 21 20:51:02.264320 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:02.264259    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5" podUID="9e15d000-a678-46d5-9fbb-ff46ecf71cd5" containerName="istio-proxy" containerID="cri-o://f77e326124e1aed4366f1069aa0409894694ce726a2ae347bde19a1df33c472c" gracePeriod=30
Jul 21 20:51:02.275461 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:02.275433    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:51:02.512203 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:02.512176    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:51:02.703261 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:02.703175    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:51:02.807515 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:02.807486    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:51:02.914701 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:02.914657    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:51:07.525239 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:07.525210    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:51:07.595824 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:07.595748    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istiod-ca-cert\") pod \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") "
Jul 21 20:51:07.595824 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:07.595787    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istio-envoy\") pod \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") "
Jul 21 20:51:07.595824 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:07.595808    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istio-data\") pod \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") "
Jul 21 20:51:07.596110 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:07.595833    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-workload-certs\") pod \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") "
Jul 21 20:51:07.596110 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:07.595851    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-workload-socket\") pod \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") "
Jul 21 20:51:07.596110 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:07.595920    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-credential-socket\") pod \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") "
Jul 21 20:51:07.596110 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:07.595966    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istio-podinfo\") pod \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") "
Jul 21 20:51:07.596110 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:07.595997    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istio-token\") pod \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") "
Jul 21 20:51:07.596110 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:07.596025    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgbs7\" (UniqueName: \"kubernetes.io/projected/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-kube-api-access-tgbs7\") pod \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\" (UID: \"9e15d000-a678-46d5-9fbb-ff46ecf71cd5\") "
Jul 21 20:51:07.596418 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:07.596206    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9e15d000-a678-46d5-9fbb-ff46ecf71cd5" (UID: "9e15d000-a678-46d5-9fbb-ff46ecf71cd5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:51:07.596418 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:07.596341    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9e15d000-a678-46d5-9fbb-ff46ecf71cd5" (UID: "9e15d000-a678-46d5-9fbb-ff46ecf71cd5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:51:07.596418 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:07.596341    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9e15d000-a678-46d5-9fbb-ff46ecf71cd5" (UID: "9e15d000-a678-46d5-9fbb-ff46ecf71cd5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:51:07.596418 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:07.596384    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-workload-certs\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:51:07.596619 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:07.596512    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9e15d000-a678-46d5-9fbb-ff46ecf71cd5" (UID: "9e15d000-a678-46d5-9fbb-ff46ecf71cd5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:51:07.596741 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:07.596710    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istio-data" (OuterVolumeSpecName: "istio-data") pod "9e15d000-a678-46d5-9fbb-ff46ecf71cd5" (UID: "9e15d000-a678-46d5-9fbb-ff46ecf71cd5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:51:07.598225 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:07.598199    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9e15d000-a678-46d5-9fbb-ff46ecf71cd5" (UID: "9e15d000-a678-46d5-9fbb-ff46ecf71cd5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:51:07.598346 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:07.598256    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-kube-api-access-tgbs7" (OuterVolumeSpecName: "kube-api-access-tgbs7") pod "9e15d000-a678-46d5-9fbb-ff46ecf71cd5" (UID: "9e15d000-a678-46d5-9fbb-ff46ecf71cd5"). InnerVolumeSpecName "kube-api-access-tgbs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:51:07.598613 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:07.598584    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9e15d000-a678-46d5-9fbb-ff46ecf71cd5" (UID: "9e15d000-a678-46d5-9fbb-ff46ecf71cd5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 20:51:07.598719 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:07.598656    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istio-token" (OuterVolumeSpecName: "istio-token") pod "9e15d000-a678-46d5-9fbb-ff46ecf71cd5" (UID: "9e15d000-a678-46d5-9fbb-ff46ecf71cd5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:51:07.697164 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:07.697132    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istiod-ca-cert\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:51:07.697164 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:07.697163    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istio-envoy\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:51:07.697164 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:07.697174    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istio-data\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:51:07.697416 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:07.697182    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-workload-socket\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:51:07.697416 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:07.697191    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-credential-socket\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:51:07.697416 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:07.697200    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istio-podinfo\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:51:07.697416 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:07.697207    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-istio-token\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:51:07.697416 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:07.697216    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgbs7\" (UniqueName: \"kubernetes.io/projected/9e15d000-a678-46d5-9fbb-ff46ecf71cd5-kube-api-access-tgbs7\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:51:08.296646 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:08.296608    2576 generic.go:356] "Generic (PLEG): container finished" podID="9e15d000-a678-46d5-9fbb-ff46ecf71cd5" containerID="f77e326124e1aed4366f1069aa0409894694ce726a2ae347bde19a1df33c472c" exitCode=0
Jul 21 20:51:08.296851 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:08.296659    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"
Jul 21 20:51:08.296851 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:08.296714    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5" event={"ID":"9e15d000-a678-46d5-9fbb-ff46ecf71cd5","Type":"ContainerDied","Data":"f77e326124e1aed4366f1069aa0409894694ce726a2ae347bde19a1df33c472c"}
Jul 21 20:51:08.296851 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:08.296784    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5" event={"ID":"9e15d000-a678-46d5-9fbb-ff46ecf71cd5","Type":"ContainerDied","Data":"4477d1896f144a80ac3efff8fc6d6a3a8332cc49d4209323b6f12a4679a8a3e2"}
Jul 21 20:51:08.296851 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:08.296812    2576 scope.go:117] "RemoveContainer" containerID="f77e326124e1aed4366f1069aa0409894694ce726a2ae347bde19a1df33c472c"
Jul 21 20:51:08.305969 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:08.305950    2576 scope.go:117] "RemoveContainer" containerID="0fd708a0c6888f20038fef34e2e0ca535afd7384626c764a82610bcabbd9a4bf"
Jul 21 20:51:08.314626 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:08.314603    2576 scope.go:117] "RemoveContainer" containerID="f77e326124e1aed4366f1069aa0409894694ce726a2ae347bde19a1df33c472c"
Jul 21 20:51:08.314946 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:51:08.314926    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f77e326124e1aed4366f1069aa0409894694ce726a2ae347bde19a1df33c472c\": container with ID starting with f77e326124e1aed4366f1069aa0409894694ce726a2ae347bde19a1df33c472c not found: ID does not exist" containerID="f77e326124e1aed4366f1069aa0409894694ce726a2ae347bde19a1df33c472c"
Jul 21 20:51:08.315032 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:08.314963    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f77e326124e1aed4366f1069aa0409894694ce726a2ae347bde19a1df33c472c"} err="failed to get container status \"f77e326124e1aed4366f1069aa0409894694ce726a2ae347bde19a1df33c472c\": rpc error: code = NotFound desc = could not find container \"f77e326124e1aed4366f1069aa0409894694ce726a2ae347bde19a1df33c472c\": container with ID starting with f77e326124e1aed4366f1069aa0409894694ce726a2ae347bde19a1df33c472c not found: ID does not exist"
Jul 21 20:51:08.315032 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:08.314990    2576 scope.go:117] "RemoveContainer" containerID="0fd708a0c6888f20038fef34e2e0ca535afd7384626c764a82610bcabbd9a4bf"
Jul 21 20:51:08.315238 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:51:08.315217    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fd708a0c6888f20038fef34e2e0ca535afd7384626c764a82610bcabbd9a4bf\": container with ID starting with 0fd708a0c6888f20038fef34e2e0ca535afd7384626c764a82610bcabbd9a4bf not found: ID does not exist" containerID="0fd708a0c6888f20038fef34e2e0ca535afd7384626c764a82610bcabbd9a4bf"
Jul 21 20:51:08.315286 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:08.315253    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fd708a0c6888f20038fef34e2e0ca535afd7384626c764a82610bcabbd9a4bf"} err="failed to get container status \"0fd708a0c6888f20038fef34e2e0ca535afd7384626c764a82610bcabbd9a4bf\": rpc error: code = NotFound desc = could not find container \"0fd708a0c6888f20038fef34e2e0ca535afd7384626c764a82610bcabbd9a4bf\": container with ID starting with 0fd708a0c6888f20038fef34e2e0ca535afd7384626c764a82610bcabbd9a4bf not found: ID does not exist"
Jul 21 20:51:08.315952 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:08.315934    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"]
Jul 21 20:51:08.322177 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:08.322144    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-83e6600b-openshift-default-695f9bd5bc-v4fz5"]
Jul 21 20:51:09.026895 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:09.026865    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:51:09.137314 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:09.137288    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:51:09.252544 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:09.252511    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:51:09.415080 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:09.414998    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:51:09.652512 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:09.652482    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e15d000-a678-46d5-9fbb-ff46ecf71cd5" path="/var/lib/kubelet/pods/9e15d000-a678-46d5-9fbb-ff46ecf71cd5/volumes"
Jul 21 20:51:15.446124 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:15.446090    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:51:15.550103 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:15.550066    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:51:22.247093 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.247051    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:51:22.555739 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.555683    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"]
Jul 21 20:51:22.556182 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.556163    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf" containerName="istio-proxy"
Jul 21 20:51:22.556276 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.556185    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5cac9d8-539e-44d8-8f6a-6c7e64bf7abf" containerName="istio-proxy"
Jul 21 20:51:22.556276 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.556199    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e15d000-a678-46d5-9fbb-ff46ecf71cd5" containerName="istio-proxy"
Jul 21 20:51:22.556276 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.556207    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e15d000-a678-46d5-9fbb-ff46ecf71cd5" containerName="istio-proxy"
Jul 21 20:51:22.556276 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.556218    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e15d000-a678-46d5-9fbb-ff46ecf71cd5" containerName="istio-proxy"
Jul 21 20:51:22.556276 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.556227    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e15d000-a678-46d5-9fbb-ff46ecf71cd5" containerName="istio-proxy"
Jul 21 20:51:22.556524 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.556360    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e15d000-a678-46d5-9fbb-ff46ecf71cd5" containerName="istio-proxy"
Jul 21 20:51:22.556524 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.556373    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e15d000-a678-46d5-9fbb-ff46ecf71cd5" containerName="istio-proxy"
Jul 21 20:51:22.559560 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.559537    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:22.562274 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.562254    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e7adb3ea-openshift-default-dockercfg-kwzrb\""
Jul 21 20:51:22.582606 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.582577    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"]
Jul 21 20:51:22.611849 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.611815    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:51:22.644085 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.644044    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-workload-certs\") pod \"e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") " pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:22.644085 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.644084    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istio-envoy\") pod \"e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") " pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:22.644334 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.644167    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istio-podinfo\") pod \"e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") " pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:22.644334 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.644194    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istio-data\") pod \"e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") " pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:22.644334 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.644272    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istio-token\") pod \"e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") " pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:22.644461 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.644359    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-549s4\" (UniqueName: \"kubernetes.io/projected/e978b4d1-7f3c-4247-ba3a-23cc81c89824-kube-api-access-549s4\") pod \"e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") " pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:22.644461 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.644401    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istiod-ca-cert\") pod \"e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") " pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:22.644542 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.644473    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-workload-socket\") pod \"e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") " pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:22.644542 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.644522    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-credential-socket\") pod \"e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") " pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:22.745631 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.745591    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-549s4\" (UniqueName: \"kubernetes.io/projected/e978b4d1-7f3c-4247-ba3a-23cc81c89824-kube-api-access-549s4\") pod \"e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") " pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:22.745631 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.745635    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istiod-ca-cert\") pod \"e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") " pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:22.745942 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.745664    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-workload-socket\") pod \"e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") " pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:22.745942 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.745753    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-credential-socket\") pod \"e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") " pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:22.745942 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.745844    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-workload-certs\") pod \"e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") " pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:22.745942 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.745868    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istio-envoy\") pod \"e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") " pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:22.745942 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.745912    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istio-podinfo\") pod \"e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") " pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:22.746220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.745945    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istio-data\") pod \"e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") " pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:22.746220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.745991    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istio-token\") pod \"e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") " pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:22.746220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.746087    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-workload-socket\") pod \"e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") " pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:22.746220 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.746164    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-workload-certs\") pod \"e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") " pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:22.746409 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.746323    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-credential-socket\") pod \"e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") " pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:22.746477 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.746441    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istio-data\") pod \"e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") " pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:22.746879 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.746857    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istiod-ca-cert\") pod \"e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") " pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:22.748273 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.748251    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istio-envoy\") pod \"e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") " pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:22.748474 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.748457    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istio-podinfo\") pod \"e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") " pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:22.754552 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.754530    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-549s4\" (UniqueName: \"kubernetes.io/projected/e978b4d1-7f3c-4247-ba3a-23cc81c89824-kube-api-access-549s4\") pod \"e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") " pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:22.757438 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.757414    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istio-token\") pod \"e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") " pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:22.820037 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.819936    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:51:22.869293 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:22.869258    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:23.029224 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:23.029196    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"]
Jul 21 20:51:23.031828 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:51:23.031802    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode978b4d1_7f3c_4247_ba3a_23cc81c89824.slice/crio-054aaedfc3c3a8ed2ef7b4a07549c230f415596d3c6b9932a79ac9dade0a6ebc WatchSource:0}: Error finding container 054aaedfc3c3a8ed2ef7b4a07549c230f415596d3c6b9932a79ac9dade0a6ebc: Status 404 returned error can't find the container with id 054aaedfc3c3a8ed2ef7b4a07549c230f415596d3c6b9932a79ac9dade0a6ebc
Jul 21 20:51:23.033944 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:23.033911    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:51:23.034010 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:23.033975    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:51:23.034010 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:23.034004    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:51:23.373442 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:23.373352    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r" event={"ID":"e978b4d1-7f3c-4247-ba3a-23cc81c89824","Type":"ContainerStarted","Data":"cbc3f5a5b65adbffe3dcb55178b26c19173df34d28b499d987ece44ad2f6017b"}
Jul 21 20:51:23.373442 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:23.373402    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r" event={"ID":"e978b4d1-7f3c-4247-ba3a-23cc81c89824","Type":"ContainerStarted","Data":"054aaedfc3c3a8ed2ef7b4a07549c230f415596d3c6b9932a79ac9dade0a6ebc"}
Jul 21 20:51:23.398426 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:23.398374    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r" podStartSLOduration=1.398359458 podStartE2EDuration="1.398359458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:51:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:51:23.397610393 +0000 UTC m=+2234.330008820" watchObservedRunningTime="2026-07-21 20:51:23.398359458 +0000 UTC m=+2234.330757615"
Jul 21 20:51:23.869851 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:23.869819    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:24.439857 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:24.439823    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:51:24.642489 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:24.642451    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:51:24.817819 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:24.817787    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:51:24.875143 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:24.875109    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:25.062089 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:25.062051    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:51:25.383630 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:25.383600    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:25.384669 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:25.384651    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:25.622964 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:25.622927    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:51:25.750522 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:25.750435    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:51:29.833606 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:29.833564    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:51:36.444457 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:36.444426    2576 generic.go:356] "Generic (PLEG): container finished" podID="e978b4d1-7f3c-4247-ba3a-23cc81c89824" containerID="cbc3f5a5b65adbffe3dcb55178b26c19173df34d28b499d987ece44ad2f6017b" exitCode=0
Jul 21 20:51:36.444968 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:36.444495    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r" event={"ID":"e978b4d1-7f3c-4247-ba3a-23cc81c89824","Type":"ContainerDied","Data":"cbc3f5a5b65adbffe3dcb55178b26c19173df34d28b499d987ece44ad2f6017b"}
Jul 21 20:51:36.444968 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:36.444906    2576 scope.go:117] "RemoveContainer" containerID="cbc3f5a5b65adbffe3dcb55178b26c19173df34d28b499d987ece44ad2f6017b"
Jul 21 20:51:36.445897 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:36.445869    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:51:36.445995 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:36.445951    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:51:36.446056 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:36.446023    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:51:37.453882 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:37.453850    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r" event={"ID":"e978b4d1-7f3c-4247-ba3a-23cc81c89824","Type":"ContainerStarted","Data":"614587eba2d5eab5a060e82be0b23408eb64cc72af74443627050f29562a6046"}
Jul 21 20:51:37.869623 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:37.869585    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:37.870752 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:37.870727    2576 patch_prober.go:28] interesting pod/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 21 20:51:37.870822 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:37.870781    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r" podUID="e978b4d1-7f3c-4247-ba3a-23cc81c89824" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 21 20:51:38.870047 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:38.870008    2576 patch_prober.go:28] interesting pod/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 21 20:51:38.870528 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:38.870071    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r" podUID="e978b4d1-7f3c-4247-ba3a-23cc81c89824" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 21 20:51:39.870016 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:39.869974    2576 patch_prober.go:28] interesting pod/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 21 20:51:39.870198 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:39.870050    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r" podUID="e978b4d1-7f3c-4247-ba3a-23cc81c89824" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 21 20:51:40.383586 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:40.383552    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:40.869936 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:40.869892    2576 patch_prober.go:28] interesting pod/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 21 20:51:40.870151 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:40.869974    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r" podUID="e978b4d1-7f3c-4247-ba3a-23cc81c89824" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 21 20:51:41.874408 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:41.874378    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:41.875516 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:41.875491    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:51:54.009081 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.009043    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"]
Jul 21 20:51:54.012498 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.012480    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"
Jul 21 20:51:54.016134 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.016109    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-e7adb3ea\"/\"e2e-lifecycle-model-e7adb3ea-kserve-self-signed-certs\""
Jul 21 20:51:54.017831 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.017800    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-e7adb3ea\"/\"kube-root-ca.crt\""
Jul 21 20:51:54.017831 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.017821    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-e7adb3ea\"/\"default-dockercfg-dqszw\""
Jul 21 20:51:54.018070 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.017819    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-e7adb3ea\"/\"openshift-service-ca.crt\""
Jul 21 20:51:54.026479 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.026449    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"]
Jul 21 20:51:54.044295 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.044262    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:51:54.055338 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.055302    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-model-cache\") pod \"e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk\" (UID: \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\") " pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"
Jul 21 20:51:54.055503 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.055400    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-home\") pod \"e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk\" (UID: \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\") " pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"
Jul 21 20:51:54.055503 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.055451    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-dshm\") pod \"e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk\" (UID: \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\") " pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"
Jul 21 20:51:54.055503 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.055475    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-tls-certs\") pod \"e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk\" (UID: \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\") " pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"
Jul 21 20:51:54.055676 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.055577    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxgw2\" (UniqueName: \"kubernetes.io/projected/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-kube-api-access-pxgw2\") pod \"e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk\" (UID: \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\") " pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"
Jul 21 20:51:54.055676 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.055639    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-tmp-dir\") pod \"e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk\" (UID: \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\") " pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"
Jul 21 20:51:54.156888 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.156842    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxgw2\" (UniqueName: \"kubernetes.io/projected/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-kube-api-access-pxgw2\") pod \"e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk\" (UID: \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\") " pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"
Jul 21 20:51:54.156888 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.156895    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-tmp-dir\") pod \"e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk\" (UID: \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\") " pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"
Jul 21 20:51:54.157165 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.156947    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-model-cache\") pod \"e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk\" (UID: \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\") " pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"
Jul 21 20:51:54.157165 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.156986    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-home\") pod \"e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk\" (UID: \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\") " pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"
Jul 21 20:51:54.157165 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.157020    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-dshm\") pod \"e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk\" (UID: \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\") " pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"
Jul 21 20:51:54.157165 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.157077    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-tls-certs\") pod \"e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk\" (UID: \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\") " pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"
Jul 21 20:51:54.157439 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.157417    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-tmp-dir\") pod \"e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk\" (UID: \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\") " pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"
Jul 21 20:51:54.157504 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.157433    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-model-cache\") pod \"e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk\" (UID: \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\") " pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"
Jul 21 20:51:54.157504 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.157474    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-home\") pod \"e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk\" (UID: \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\") " pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"
Jul 21 20:51:54.159454 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.159432    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-dshm\") pod \"e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk\" (UID: \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\") " pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"
Jul 21 20:51:54.159663 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.159645    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-tls-certs\") pod \"e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk\" (UID: \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\") " pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"
Jul 21 20:51:54.166070 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.166048    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxgw2\" (UniqueName: \"kubernetes.io/projected/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-kube-api-access-pxgw2\") pod \"e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk\" (UID: \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\") " pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"
Jul 21 20:51:54.322046 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.321948    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"
Jul 21 20:51:54.468541 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.468510    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"]
Jul 21 20:51:54.469195 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:51:54.469172    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3bb73e6_9cc6_4ee0_ad29_c4e32242d38f.slice/crio-b9696783db2856775ad9a2f45ce3c249570378d87b4ecd2fa30ce4ccb65bf875 WatchSource:0}: Error finding container b9696783db2856775ad9a2f45ce3c249570378d87b4ecd2fa30ce4ccb65bf875: Status 404 returned error can't find the container with id b9696783db2856775ad9a2f45ce3c249570378d87b4ecd2fa30ce4ccb65bf875
Jul 21 20:51:54.553359 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.553319    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk" event={"ID":"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f","Type":"ContainerStarted","Data":"e4ef47ae924e2d6872f3c6172c3078159426cd2fc31ec77516e6ab01394d0340"}
Jul 21 20:51:54.553541 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.553371    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk" event={"ID":"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f","Type":"ContainerStarted","Data":"b9696783db2856775ad9a2f45ce3c249570378d87b4ecd2fa30ce4ccb65bf875"}
Jul 21 20:51:54.580144 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:51:54.580041    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk" podStartSLOduration=1.580025805 podStartE2EDuration="1.580025805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:51:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:51:54.577911049 +0000 UTC m=+2265.510309207" watchObservedRunningTime="2026-07-21 20:51:54.580025805 +0000 UTC m=+2265.512423962"
Jul 21 20:52:02.673152 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:52:02.673114    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:52:02.772242 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:52:02.772211    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:52:04.323134 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:52:04.323086    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"
Jul 21 20:52:04.323542 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:52:04.323152    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"
Jul 21 20:52:04.338838 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:52:04.338808    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"
Jul 21 20:52:04.615097 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:52:04.615017    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"
Jul 21 20:53:17.464123 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:53:17.464043    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:54:03.107493 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:54:03.107459    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:54:09.692725 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:54:09.692682    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w885b_62db291a-14b7-4e35-9550-9fb810f82b8d/console-operator/1.log"
Jul 21 20:54:09.699125 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:54:09.699101    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-54f9x_55f51c26-71cd-4e1b-84f2-32f2de4138d5/ovn-acl-logging/0.log"
Jul 21 20:54:09.700583 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:54:09.700562    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w885b_62db291a-14b7-4e35-9550-9fb810f82b8d/console-operator/1.log"
Jul 21 20:54:09.707538 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:54:09.707519    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-54f9x_55f51c26-71cd-4e1b-84f2-32f2de4138d5/ovn-acl-logging/0.log"
Jul 21 20:55:01.357386 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:01.357299    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:55:01.457935 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:01.457907    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:55:21.132233 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:21.132203    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:55:21.202290 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:21.202259    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:55:34.204862 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:34.204823    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:55:39.151633 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:39.151595    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"]
Jul 21 20:55:39.206056 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:39.206013    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:55:54.172467 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.172403    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk" podUID="b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f" containerName="main" containerID="cri-o://e4ef47ae924e2d6872f3c6172c3078159426cd2fc31ec77516e6ab01394d0340" gracePeriod=45
Jul 21 20:55:54.432247 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.432183    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"
Jul 21 20:55:54.523938 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.523896    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-tls-certs\") pod \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\" (UID: \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\") "
Jul 21 20:55:54.523938 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.523945    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxgw2\" (UniqueName: \"kubernetes.io/projected/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-kube-api-access-pxgw2\") pod \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\" (UID: \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\") "
Jul 21 20:55:54.524168 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.524001    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-home\") pod \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\" (UID: \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\") "
Jul 21 20:55:54.524168 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.524041    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-model-cache\") pod \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\" (UID: \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\") "
Jul 21 20:55:54.524168 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.524070    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-dshm\") pod \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\" (UID: \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\") "
Jul 21 20:55:54.524168 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.524107    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-tmp-dir\") pod \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\" (UID: \"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f\") "
Jul 21 20:55:54.524443 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.524327    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-home" (OuterVolumeSpecName: "home") pod "b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f" (UID: "b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:55:54.524443 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.524373    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-model-cache" (OuterVolumeSpecName: "model-cache") pod "b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f" (UID: "b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:55:54.524555 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.524456    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f" (UID: "b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:55:54.524613 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.524555    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-tmp-dir\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:55:54.524613 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.524575    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-home\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:55:54.524613 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.524588    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-model-cache\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:55:54.526277 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.526254    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-dshm" (OuterVolumeSpecName: "dshm") pod "b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f" (UID: "b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:55:54.526572 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.526551    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f" (UID: "b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:55:54.526572 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.526566    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-kube-api-access-pxgw2" (OuterVolumeSpecName: "kube-api-access-pxgw2") pod "b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f" (UID: "b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f"). InnerVolumeSpecName "kube-api-access-pxgw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:55:54.625469 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.625429    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-tls-certs\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:55:54.625469 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.625464    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxgw2\" (UniqueName: \"kubernetes.io/projected/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-kube-api-access-pxgw2\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:55:54.625469 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.625478    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f-dshm\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:55:54.792165 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.792133    2576 generic.go:356] "Generic (PLEG): container finished" podID="b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f" containerID="e4ef47ae924e2d6872f3c6172c3078159426cd2fc31ec77516e6ab01394d0340" exitCode=0
Jul 21 20:55:54.792365 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.792176    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"
Jul 21 20:55:54.792365 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.792222    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk" event={"ID":"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f","Type":"ContainerDied","Data":"e4ef47ae924e2d6872f3c6172c3078159426cd2fc31ec77516e6ab01394d0340"}
Jul 21 20:55:54.792365 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.792263    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk" event={"ID":"b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f","Type":"ContainerDied","Data":"b9696783db2856775ad9a2f45ce3c249570378d87b4ecd2fa30ce4ccb65bf875"}
Jul 21 20:55:54.792365 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.792280    2576 scope.go:117] "RemoveContainer" containerID="e4ef47ae924e2d6872f3c6172c3078159426cd2fc31ec77516e6ab01394d0340"
Jul 21 20:55:54.802030 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.802013    2576 scope.go:117] "RemoveContainer" containerID="e4ef47ae924e2d6872f3c6172c3078159426cd2fc31ec77516e6ab01394d0340"
Jul 21 20:55:54.802302 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:55:54.802280    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4ef47ae924e2d6872f3c6172c3078159426cd2fc31ec77516e6ab01394d0340\": container with ID starting with e4ef47ae924e2d6872f3c6172c3078159426cd2fc31ec77516e6ab01394d0340 not found: ID does not exist" containerID="e4ef47ae924e2d6872f3c6172c3078159426cd2fc31ec77516e6ab01394d0340"
Jul 21 20:55:54.802347 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.802310    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4ef47ae924e2d6872f3c6172c3078159426cd2fc31ec77516e6ab01394d0340"} err="failed to get container status \"e4ef47ae924e2d6872f3c6172c3078159426cd2fc31ec77516e6ab01394d0340\": rpc error: code = NotFound desc = could not find container \"e4ef47ae924e2d6872f3c6172c3078159426cd2fc31ec77516e6ab01394d0340\": container with ID starting with e4ef47ae924e2d6872f3c6172c3078159426cd2fc31ec77516e6ab01394d0340 not found: ID does not exist"
Jul 21 20:55:54.814277 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.814242    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"]
Jul 21 20:55:54.819061 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:54.819034    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-e7adb3ea/e2e-lifecycle-model-e7adb3ea-kserve-584d4bd4cf-7ftlk"]
Jul 21 20:55:55.651389 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:55:55.651355    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f" path="/var/lib/kubelet/pods/b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f/volumes"
Jul 21 20:56:16.559824 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:16.559781    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:56:17.850316 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:17.850285    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:56:23.031157 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:23.031123    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:56:37.312853 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:37.312819    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:56:37.412564 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:37.412529    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:56:37.595441 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:37.595353    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"]
Jul 21 20:56:37.595650 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:37.595622    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r" podUID="e978b4d1-7f3c-4247-ba3a-23cc81c89824" containerName="istio-proxy" containerID="cri-o://614587eba2d5eab5a060e82be0b23408eb64cc72af74443627050f29562a6046" gracePeriod=30
Jul 21 20:56:37.605190 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:37.605159    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:56:37.814071 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:37.814037    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:56:38.908662 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:38.908631    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:56:39.031236 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:39.031202    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:56:39.136360 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:39.136328    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:56:39.828940 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:39.828906    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:56:39.941836 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:39.941798    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:56:41.380791 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:41.380759    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:56:41.877449 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:41.877401    2576 patch_prober.go:28] interesting pod/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 20:56:41.877620 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:41.877473    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r" podUID="e978b4d1-7f3c-4247-ba3a-23cc81c89824" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 20:56:42.863197 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:42.863131    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:56:42.906824 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:42.906792    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istio-token\") pod \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") "
Jul 21 20:56:42.906998 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:42.906843    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-workload-certs\") pod \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") "
Jul 21 20:56:42.906998 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:42.906883    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istio-envoy\") pod \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") "
Jul 21 20:56:42.906998 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:42.906940    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istiod-ca-cert\") pod \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") "
Jul 21 20:56:42.906998 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:42.906980    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-credential-socket\") pod \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") "
Jul 21 20:56:42.907182 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:42.907025    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istio-podinfo\") pod \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") "
Jul 21 20:56:42.907182 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:42.907066    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-549s4\" (UniqueName: \"kubernetes.io/projected/e978b4d1-7f3c-4247-ba3a-23cc81c89824-kube-api-access-549s4\") pod \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") "
Jul 21 20:56:42.907182 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:42.907136    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istio-data\") pod \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") "
Jul 21 20:56:42.907347 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:42.907180    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-workload-socket\") pod \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\" (UID: \"e978b4d1-7f3c-4247-ba3a-23cc81c89824\") "
Jul 21 20:56:42.907347 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:42.907194    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e978b4d1-7f3c-4247-ba3a-23cc81c89824" (UID: "e978b4d1-7f3c-4247-ba3a-23cc81c89824"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:56:42.907347 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:42.907320    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e978b4d1-7f3c-4247-ba3a-23cc81c89824" (UID: "e978b4d1-7f3c-4247-ba3a-23cc81c89824"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:56:42.907493 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:42.907336    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e978b4d1-7f3c-4247-ba3a-23cc81c89824" (UID: "e978b4d1-7f3c-4247-ba3a-23cc81c89824"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:56:42.907559 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:42.907541    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e978b4d1-7f3c-4247-ba3a-23cc81c89824" (UID: "e978b4d1-7f3c-4247-ba3a-23cc81c89824"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:56:42.907710 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:42.907677    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-credential-socket\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:56:42.907796 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:42.907715    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-workload-socket\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:56:42.907796 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:42.907731    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-workload-certs\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:56:42.907796 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:42.907746    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istiod-ca-cert\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:56:42.908196 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:42.908170    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istio-data" (OuterVolumeSpecName: "istio-data") pod "e978b4d1-7f3c-4247-ba3a-23cc81c89824" (UID: "e978b4d1-7f3c-4247-ba3a-23cc81c89824"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:56:42.909604 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:42.909577    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e978b4d1-7f3c-4247-ba3a-23cc81c89824" (UID: "e978b4d1-7f3c-4247-ba3a-23cc81c89824"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:56:42.909604 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:42.909589    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e978b4d1-7f3c-4247-ba3a-23cc81c89824-kube-api-access-549s4" (OuterVolumeSpecName: "kube-api-access-549s4") pod "e978b4d1-7f3c-4247-ba3a-23cc81c89824" (UID: "e978b4d1-7f3c-4247-ba3a-23cc81c89824"). InnerVolumeSpecName "kube-api-access-549s4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:56:42.909784 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:42.909770    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istio-token" (OuterVolumeSpecName: "istio-token") pod "e978b4d1-7f3c-4247-ba3a-23cc81c89824" (UID: "e978b4d1-7f3c-4247-ba3a-23cc81c89824"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:56:42.909847 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:42.909762    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e978b4d1-7f3c-4247-ba3a-23cc81c89824" (UID: "e978b4d1-7f3c-4247-ba3a-23cc81c89824"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 20:56:43.009219 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:43.009176    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istio-podinfo\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:56:43.009219 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:43.009211    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-549s4\" (UniqueName: \"kubernetes.io/projected/e978b4d1-7f3c-4247-ba3a-23cc81c89824-kube-api-access-549s4\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:56:43.009219 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:43.009221    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istio-data\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:56:43.009219 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:43.009229    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istio-token\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:56:43.009500 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:43.009237    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e978b4d1-7f3c-4247-ba3a-23cc81c89824-istio-envoy\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:56:43.052638 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:43.052606    2576 generic.go:356] "Generic (PLEG): container finished" podID="e978b4d1-7f3c-4247-ba3a-23cc81c89824" containerID="614587eba2d5eab5a060e82be0b23408eb64cc72af74443627050f29562a6046" exitCode=0
Jul 21 20:56:43.052841 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:43.052668    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"
Jul 21 20:56:43.052841 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:43.052710    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r" event={"ID":"e978b4d1-7f3c-4247-ba3a-23cc81c89824","Type":"ContainerDied","Data":"614587eba2d5eab5a060e82be0b23408eb64cc72af74443627050f29562a6046"}
Jul 21 20:56:43.052841 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:43.052773    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r" event={"ID":"e978b4d1-7f3c-4247-ba3a-23cc81c89824","Type":"ContainerDied","Data":"054aaedfc3c3a8ed2ef7b4a07549c230f415596d3c6b9932a79ac9dade0a6ebc"}
Jul 21 20:56:43.052841 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:43.052805    2576 scope.go:117] "RemoveContainer" containerID="614587eba2d5eab5a060e82be0b23408eb64cc72af74443627050f29562a6046"
Jul 21 20:56:43.063795 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:43.063775    2576 scope.go:117] "RemoveContainer" containerID="cbc3f5a5b65adbffe3dcb55178b26c19173df34d28b499d987ece44ad2f6017b"
Jul 21 20:56:43.073077 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:43.073058    2576 scope.go:117] "RemoveContainer" containerID="614587eba2d5eab5a060e82be0b23408eb64cc72af74443627050f29562a6046"
Jul 21 20:56:43.073424 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:56:43.073401    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"614587eba2d5eab5a060e82be0b23408eb64cc72af74443627050f29562a6046\": container with ID starting with 614587eba2d5eab5a060e82be0b23408eb64cc72af74443627050f29562a6046 not found: ID does not exist" containerID="614587eba2d5eab5a060e82be0b23408eb64cc72af74443627050f29562a6046"
Jul 21 20:56:43.073523 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:43.073439    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"614587eba2d5eab5a060e82be0b23408eb64cc72af74443627050f29562a6046"} err="failed to get container status \"614587eba2d5eab5a060e82be0b23408eb64cc72af74443627050f29562a6046\": rpc error: code = NotFound desc = could not find container \"614587eba2d5eab5a060e82be0b23408eb64cc72af74443627050f29562a6046\": container with ID starting with 614587eba2d5eab5a060e82be0b23408eb64cc72af74443627050f29562a6046 not found: ID does not exist"
Jul 21 20:56:43.073523 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:43.073466    2576 scope.go:117] "RemoveContainer" containerID="cbc3f5a5b65adbffe3dcb55178b26c19173df34d28b499d987ece44ad2f6017b"
Jul 21 20:56:43.073759 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:56:43.073739    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbc3f5a5b65adbffe3dcb55178b26c19173df34d28b499d987ece44ad2f6017b\": container with ID starting with cbc3f5a5b65adbffe3dcb55178b26c19173df34d28b499d987ece44ad2f6017b not found: ID does not exist" containerID="cbc3f5a5b65adbffe3dcb55178b26c19173df34d28b499d987ece44ad2f6017b"
Jul 21 20:56:43.073804 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:43.073766    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbc3f5a5b65adbffe3dcb55178b26c19173df34d28b499d987ece44ad2f6017b"} err="failed to get container status \"cbc3f5a5b65adbffe3dcb55178b26c19173df34d28b499d987ece44ad2f6017b\": rpc error: code = NotFound desc = could not find container \"cbc3f5a5b65adbffe3dcb55178b26c19173df34d28b499d987ece44ad2f6017b\": container with ID starting with cbc3f5a5b65adbffe3dcb55178b26c19173df34d28b499d987ece44ad2f6017b not found: ID does not exist"
Jul 21 20:56:43.103564 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:43.103523    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"]
Jul 21 20:56:43.115412 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:43.115330    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e7adb3ea-openshift-default-56c879c57f-d5s4r"]
Jul 21 20:56:43.651872 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:43.651839    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e978b4d1-7f3c-4247-ba3a-23cc81c89824" path="/var/lib/kubelet/pods/e978b4d1-7f3c-4247-ba3a-23cc81c89824/volumes"
Jul 21 20:56:48.767942 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:48.767906    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:56:48.886290 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:48.886254    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:56:49.515870 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:49.515838    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:56:55.290383 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:55.290336    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:56:55.398454 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:55.398422    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:56:55.500305 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:56:55.500272    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:57:05.995545 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:05.995506    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:57:06.330927 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:06.330894    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:57:27.267994 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:27.267963    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:57:34.462764 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:34.462661    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:57:34.634227 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:34.634193    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:57:34.848208 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:34.848173    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:57:35.238109 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.238025    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"]
Jul 21 20:57:35.238487 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.238472    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e978b4d1-7f3c-4247-ba3a-23cc81c89824" containerName="istio-proxy"
Jul 21 20:57:35.238538 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.238491    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e978b4d1-7f3c-4247-ba3a-23cc81c89824" containerName="istio-proxy"
Jul 21 20:57:35.238538 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.238508    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f" containerName="main"
Jul 21 20:57:35.238538 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.238513    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f" containerName="main"
Jul 21 20:57:35.238538 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.238533    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e978b4d1-7f3c-4247-ba3a-23cc81c89824" containerName="istio-proxy"
Jul 21 20:57:35.238538 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.238539    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e978b4d1-7f3c-4247-ba3a-23cc81c89824" containerName="istio-proxy"
Jul 21 20:57:35.238706 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.238608    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3bb73e6-9cc6-4ee0-ad29-c4e32242d38f" containerName="main"
Jul 21 20:57:35.238706 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.238619    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e978b4d1-7f3c-4247-ba3a-23cc81c89824" containerName="istio-proxy"
Jul 21 20:57:35.238706 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.238624    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e978b4d1-7f3c-4247-ba3a-23cc81c89824" containerName="istio-proxy"
Jul 21 20:57:35.241709 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.241678    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.247326 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.247303    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-2ba36e-openshift-default-dockercfg-c6kms\""
Jul 21 20:57:35.271314 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.271282    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"]
Jul 21 20:57:35.310127 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.310094    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istiod-ca-cert\") pod \"e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") " pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.310302 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.310150    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istio-token\") pod \"e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") " pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.310302 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.310192    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istio-podinfo\") pod \"e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") " pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.310302 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.310211    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-workload-socket\") pod \"e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") " pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.310410 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.310303    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbbd5\" (UniqueName: \"kubernetes.io/projected/f43f9cc0-8148-4c3d-b39f-695a01dda87d-kube-api-access-kbbd5\") pod \"e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") " pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.310410 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.310337    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-workload-certs\") pod \"e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") " pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.310410 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.310360    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-credential-socket\") pod \"e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") " pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.310410 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.310399    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istio-envoy\") pod \"e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") " pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.310536 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.310428    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istio-data\") pod \"e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") " pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.329629 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.329599    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:57:35.411991 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.411957    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-credential-socket\") pod \"e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") " pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.411991 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.412000    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istio-envoy\") pod \"e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") " pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.412340 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.412018    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istio-data\") pod \"e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") " pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.412340 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.412068    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istiod-ca-cert\") pod \"e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") " pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.412340 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.412111    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istio-token\") pod \"e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") " pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.412340 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.412146    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istio-podinfo\") pod \"e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") " pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.412340 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.412177    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-workload-socket\") pod \"e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") " pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.412340 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.412241    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbbd5\" (UniqueName: \"kubernetes.io/projected/f43f9cc0-8148-4c3d-b39f-695a01dda87d-kube-api-access-kbbd5\") pod \"e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") " pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.412340 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.412269    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-workload-certs\") pod \"e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") " pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.412742 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.412455    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-credential-socket\") pod \"e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") " pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.412742 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.412598    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-workload-certs\") pod \"e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") " pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.412892 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.412870    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-workload-socket\") pod \"e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") " pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.413045 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.413024    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istio-data\") pod \"e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") " pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.413162 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.413042    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istiod-ca-cert\") pod \"e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") " pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.414851 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.414829    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istio-podinfo\") pod \"e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") " pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.414945 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.414897    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istio-envoy\") pod \"e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") " pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.431289 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.431259    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istio-token\") pod \"e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") " pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.431496 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.431470    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbbd5\" (UniqueName: \"kubernetes.io/projected/f43f9cc0-8148-4c3d-b39f-695a01dda87d-kube-api-access-kbbd5\") pod \"e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") " pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.442272 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.442246    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:57:35.551751 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.551717    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:35.715403 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.715379    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"]
Jul 21 20:57:35.716942 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:57:35.716916    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf43f9cc0_8148_4c3d_b39f_695a01dda87d.slice/crio-5226109165bcd86fb8962d48fb51322c6ccc865e8fc8f83de4bce153091616fe WatchSource:0}: Error finding container 5226109165bcd86fb8962d48fb51322c6ccc865e8fc8f83de4bce153091616fe: Status 404 returned error can't find the container with id 5226109165bcd86fb8962d48fb51322c6ccc865e8fc8f83de4bce153091616fe
Jul 21 20:57:35.718984 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.718956    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:57:35.719061 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.719017    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:57:35.719061 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:35.719046    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:57:36.324183 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:36.324139    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2" event={"ID":"f43f9cc0-8148-4c3d-b39f-695a01dda87d","Type":"ContainerStarted","Data":"7cc1c8a873dde953920ed6a91559e3275fca23bbc5fc78c597e92ff9a87dba10"}
Jul 21 20:57:36.324384 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:36.324209    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2" event={"ID":"f43f9cc0-8148-4c3d-b39f-695a01dda87d","Type":"ContainerStarted","Data":"5226109165bcd86fb8962d48fb51322c6ccc865e8fc8f83de4bce153091616fe"}
Jul 21 20:57:36.371791 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:36.371740    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2" podStartSLOduration=1.37172099 podStartE2EDuration="1.37172099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:57:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:57:36.36521287 +0000 UTC m=+2607.297611026" watchObservedRunningTime="2026-07-21 20:57:36.37172099 +0000 UTC m=+2607.304119146"
Jul 21 20:57:36.552376 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:36.552335    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:36.557387 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:36.557362    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:37.312150 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:37.312114    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:57:37.330678 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:37.330637    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:37.331618 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:37.331596    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:37.473461 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:37.473426    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:57:37.577934 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:37.577846    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:57:37.775790 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:37.775752    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:57:38.283914 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:38.283883    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:57:38.383601 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:38.383557    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:57:42.789925 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:42.789875    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:57:43.137840 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.137716    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:57:43.405195 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.405091    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"]
Jul 21 20:57:43.409144 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.409119    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.411631 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.411607    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-351a5d-openshift-default-dockercfg-7shgr\""
Jul 21 20:57:43.431452 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.431416    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"]
Jul 21 20:57:43.441533 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.441503    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:57:43.494501 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.494467    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istio-podinfo\") pod \"e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") " pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.494501 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.494507    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istio-data\") pod \"e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") " pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.494762 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.494527    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istio-envoy\") pod \"e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") " pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.494762 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.494588    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istio-token\") pod \"e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") " pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.494762 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.494621    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn7nf\" (UniqueName: \"kubernetes.io/projected/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-kube-api-access-hn7nf\") pod \"e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") " pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.494762 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.494642    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-credential-socket\") pod \"e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") " pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.494762 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.494683    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-workload-certs\") pod \"e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") " pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.494762 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.494748    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-workload-socket\") pod \"e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") " pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.494981 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.494787    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istiod-ca-cert\") pod \"e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") " pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.541517 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.541485    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:57:43.596149 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.596114    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istio-token\") pod \"e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") " pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.596357 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.596156    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn7nf\" (UniqueName: \"kubernetes.io/projected/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-kube-api-access-hn7nf\") pod \"e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") " pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.596357 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.596223    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-credential-socket\") pod \"e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") " pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.596357 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.596256    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-workload-certs\") pod \"e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") " pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.596357 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.596283    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-workload-socket\") pod \"e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") " pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.596551 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.596465    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istiod-ca-cert\") pod \"e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") " pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.596664 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.596643    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istio-podinfo\") pod \"e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") " pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.596743 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.596683    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istio-data\") pod \"e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") " pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.596743 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.596732    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istio-envoy\") pod \"e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") " pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.596743 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.596733    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-workload-certs\") pod \"e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") " pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.596893 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.596771    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-credential-socket\") pod \"e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") " pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.596893 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.596833    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-workload-socket\") pod \"e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") " pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.597161 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.597138    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istio-data\") pod \"e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") " pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.597273 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.597202    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istiod-ca-cert\") pod \"e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") " pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.598904 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.598887    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istio-envoy\") pod \"e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") " pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.599208 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.599190    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istio-podinfo\") pod \"e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") " pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.605210 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.605180    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istio-token\") pod \"e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") " pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.605411 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.605391    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn7nf\" (UniqueName: \"kubernetes.io/projected/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-kube-api-access-hn7nf\") pod \"e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") " pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.719483 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.719397    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:43.874432 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.874400    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"]
Jul 21 20:57:43.875901 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:57:43.875871    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84b8f5c3_b015_41a3_a187_2f62b2be3b8c.slice/crio-3f08c9fbba78580ed031d20af34bc3dcd0378adb9cd09468e08707b41eea47b5 WatchSource:0}: Error finding container 3f08c9fbba78580ed031d20af34bc3dcd0378adb9cd09468e08707b41eea47b5: Status 404 returned error can't find the container with id 3f08c9fbba78580ed031d20af34bc3dcd0378adb9cd09468e08707b41eea47b5
Jul 21 20:57:43.878200 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.878164    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:57:43.878293 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.878239    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:57:43.878352 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:43.878337    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:57:44.368542 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:44.368497    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm" event={"ID":"84b8f5c3-b015-41a3-a187-2f62b2be3b8c","Type":"ContainerStarted","Data":"cc0510dc71b9fa9c439be566c73bce839bf714418bda1747fedc4807ec129958"}
Jul 21 20:57:44.368745 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:44.368559    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm" event={"ID":"84b8f5c3-b015-41a3-a187-2f62b2be3b8c","Type":"ContainerStarted","Data":"3f08c9fbba78580ed031d20af34bc3dcd0378adb9cd09468e08707b41eea47b5"}
Jul 21 20:57:44.390847 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:44.390794    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm" podStartSLOduration=1.390777752 podStartE2EDuration="1.390777752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:57:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:57:44.389667561 +0000 UTC m=+2615.322065719" watchObservedRunningTime="2026-07-21 20:57:44.390777752 +0000 UTC m=+2615.323175909"
Jul 21 20:57:44.720641 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:44.720544    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:44.726865 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:44.726836    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:45.301551 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:45.301514    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:57:45.374940 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:45.374904    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:45.375752 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:45.375733    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:57:45.408036 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:45.408008    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:57:45.498504 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:45.498471    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:57:45.991600 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:45.991561    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:57:46.093705 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:46.093671    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:57:46.215643 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:46.215607    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:57:50.409318 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:50.409284    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:57:50.513641 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:50.513606    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:57:50.796622 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:50.796591    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:57:56.439169 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:56.439079    2576 generic.go:356] "Generic (PLEG): container finished" podID="f43f9cc0-8148-4c3d-b39f-695a01dda87d" containerID="7cc1c8a873dde953920ed6a91559e3275fca23bbc5fc78c597e92ff9a87dba10" exitCode=0
Jul 21 20:57:56.439169 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:56.439124    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2" event={"ID":"f43f9cc0-8148-4c3d-b39f-695a01dda87d","Type":"ContainerDied","Data":"7cc1c8a873dde953920ed6a91559e3275fca23bbc5fc78c597e92ff9a87dba10"}
Jul 21 20:57:56.439603 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:56.439546    2576 scope.go:117] "RemoveContainer" containerID="7cc1c8a873dde953920ed6a91559e3275fca23bbc5fc78c597e92ff9a87dba10"
Jul 21 20:57:56.440586 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:56.440556    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:57:56.440710 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:56.440625    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:57:56.440710 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:56.440675    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:57:57.449994 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:57.449947    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2" event={"ID":"f43f9cc0-8148-4c3d-b39f-695a01dda87d","Type":"ContainerStarted","Data":"b877a602b69c7b8e3c43c75fd9a935e3ae0eabf6c31546ed2880989f876074a3"}
Jul 21 20:57:57.551928 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:57.551885    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:57:57.552300 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:57.552117    2576 patch_prober.go:28] interesting pod/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 21 20:57:57.552300 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:57.552175    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2" podUID="f43f9cc0-8148-4c3d-b39f-695a01dda87d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 21 20:57:58.552675 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:58.552640    2576 patch_prober.go:28] interesting pod/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 21 20:57:58.553393 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:58.553349    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2" podUID="f43f9cc0-8148-4c3d-b39f-695a01dda87d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 21 20:57:59.553151 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:59.553104    2576 patch_prober.go:28] interesting pod/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 21 20:57:59.553901 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:59.553861    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2" podUID="f43f9cc0-8148-4c3d-b39f-695a01dda87d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 21 20:57:59.979823 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:57:59.979745    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:58:00.192147 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.192108    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:58:00.368716 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.368285    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"]
Jul 21 20:58:00.385617 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.385579    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"
Jul 21 20:58:00.390017 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.389985    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2ba36e\"/\"openshift-service-ca.crt\""
Jul 21 20:58:00.390803 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.390782    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2ba36e\"/\"default-dockercfg-6cv9n\""
Jul 21 20:58:00.390935 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.390868    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"]
Jul 21 20:58:00.392991 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.392777    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2ba36e\"/\"kube-root-ca.crt\""
Jul 21 20:58:00.406194 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.406169    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2ba36e\"/\"test-model-2ba36e-kserve-self-signed-certs\""
Jul 21 20:58:00.482271 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.482232    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqfml\" (UniqueName: \"kubernetes.io/projected/ab37a394-c2c1-41bc-8430-f1238d9deea0-kube-api-access-jqfml\") pod \"test-model-2ba36e-kserve-675989859f-gjtfx\" (UID: \"ab37a394-c2c1-41bc-8430-f1238d9deea0\") " pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"
Jul 21 20:58:00.482450 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.482295    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab37a394-c2c1-41bc-8430-f1238d9deea0-model-cache\") pod \"test-model-2ba36e-kserve-675989859f-gjtfx\" (UID: \"ab37a394-c2c1-41bc-8430-f1238d9deea0\") " pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"
Jul 21 20:58:00.482450 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.482363    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab37a394-c2c1-41bc-8430-f1238d9deea0-tmp-dir\") pod \"test-model-2ba36e-kserve-675989859f-gjtfx\" (UID: \"ab37a394-c2c1-41bc-8430-f1238d9deea0\") " pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"
Jul 21 20:58:00.482450 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.482433    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab37a394-c2c1-41bc-8430-f1238d9deea0-dshm\") pod \"test-model-2ba36e-kserve-675989859f-gjtfx\" (UID: \"ab37a394-c2c1-41bc-8430-f1238d9deea0\") " pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"
Jul 21 20:58:00.482559 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.482498    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab37a394-c2c1-41bc-8430-f1238d9deea0-tls-certs\") pod \"test-model-2ba36e-kserve-675989859f-gjtfx\" (UID: \"ab37a394-c2c1-41bc-8430-f1238d9deea0\") " pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"
Jul 21 20:58:00.482594 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.482563    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab37a394-c2c1-41bc-8430-f1238d9deea0-home\") pod \"test-model-2ba36e-kserve-675989859f-gjtfx\" (UID: \"ab37a394-c2c1-41bc-8430-f1238d9deea0\") " pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"
Jul 21 20:58:00.552724 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.552666    2576 patch_prober.go:28] interesting pod/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 21 20:58:00.553013 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.552978    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2" podUID="f43f9cc0-8148-4c3d-b39f-695a01dda87d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 21 20:58:00.583684 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.583645    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab37a394-c2c1-41bc-8430-f1238d9deea0-dshm\") pod \"test-model-2ba36e-kserve-675989859f-gjtfx\" (UID: \"ab37a394-c2c1-41bc-8430-f1238d9deea0\") " pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"
Jul 21 20:58:00.584318 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.584296    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab37a394-c2c1-41bc-8430-f1238d9deea0-tls-certs\") pod \"test-model-2ba36e-kserve-675989859f-gjtfx\" (UID: \"ab37a394-c2c1-41bc-8430-f1238d9deea0\") " pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"
Jul 21 20:58:00.584471 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.584460    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab37a394-c2c1-41bc-8430-f1238d9deea0-home\") pod \"test-model-2ba36e-kserve-675989859f-gjtfx\" (UID: \"ab37a394-c2c1-41bc-8430-f1238d9deea0\") " pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"
Jul 21 20:58:00.584570 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.584561    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqfml\" (UniqueName: \"kubernetes.io/projected/ab37a394-c2c1-41bc-8430-f1238d9deea0-kube-api-access-jqfml\") pod \"test-model-2ba36e-kserve-675989859f-gjtfx\" (UID: \"ab37a394-c2c1-41bc-8430-f1238d9deea0\") " pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"
Jul 21 20:58:00.584668 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.584660    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab37a394-c2c1-41bc-8430-f1238d9deea0-model-cache\") pod \"test-model-2ba36e-kserve-675989859f-gjtfx\" (UID: \"ab37a394-c2c1-41bc-8430-f1238d9deea0\") " pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"
Jul 21 20:58:00.584801 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.584782    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab37a394-c2c1-41bc-8430-f1238d9deea0-tmp-dir\") pod \"test-model-2ba36e-kserve-675989859f-gjtfx\" (UID: \"ab37a394-c2c1-41bc-8430-f1238d9deea0\") " pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"
Jul 21 20:58:00.584893 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.584866    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab37a394-c2c1-41bc-8430-f1238d9deea0-home\") pod \"test-model-2ba36e-kserve-675989859f-gjtfx\" (UID: \"ab37a394-c2c1-41bc-8430-f1238d9deea0\") " pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"
Jul 21 20:58:00.585012 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.584991    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab37a394-c2c1-41bc-8430-f1238d9deea0-model-cache\") pod \"test-model-2ba36e-kserve-675989859f-gjtfx\" (UID: \"ab37a394-c2c1-41bc-8430-f1238d9deea0\") " pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"
Jul 21 20:58:00.585119 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.585101    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab37a394-c2c1-41bc-8430-f1238d9deea0-tmp-dir\") pod \"test-model-2ba36e-kserve-675989859f-gjtfx\" (UID: \"ab37a394-c2c1-41bc-8430-f1238d9deea0\") " pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"
Jul 21 20:58:00.586343 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.586323    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab37a394-c2c1-41bc-8430-f1238d9deea0-dshm\") pod \"test-model-2ba36e-kserve-675989859f-gjtfx\" (UID: \"ab37a394-c2c1-41bc-8430-f1238d9deea0\") " pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"
Jul 21 20:58:00.586923 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.586906    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab37a394-c2c1-41bc-8430-f1238d9deea0-tls-certs\") pod \"test-model-2ba36e-kserve-675989859f-gjtfx\" (UID: \"ab37a394-c2c1-41bc-8430-f1238d9deea0\") " pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"
Jul 21 20:58:00.606226 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.606201    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqfml\" (UniqueName: \"kubernetes.io/projected/ab37a394-c2c1-41bc-8430-f1238d9deea0-kube-api-access-jqfml\") pod \"test-model-2ba36e-kserve-675989859f-gjtfx\" (UID: \"ab37a394-c2c1-41bc-8430-f1238d9deea0\") " pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"
Jul 21 20:58:00.699854 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.699561    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"
Jul 21 20:58:00.792848 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.792820    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:58:00.973113 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:00.972785    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"]
Jul 21 20:58:00.976945 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:58:00.976885    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab37a394_c2c1_41bc_8430_f1238d9deea0.slice/crio-81113c08606d2eab1837ad3454bb0029feac066a8c2fd04dd63cedea8da1b9fb WatchSource:0}: Error finding container 81113c08606d2eab1837ad3454bb0029feac066a8c2fd04dd63cedea8da1b9fb: Status 404 returned error can't find the container with id 81113c08606d2eab1837ad3454bb0029feac066a8c2fd04dd63cedea8da1b9fb
Jul 21 20:58:01.484653 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:01.484614    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx" event={"ID":"ab37a394-c2c1-41bc-8430-f1238d9deea0","Type":"ContainerStarted","Data":"64b5190cdce7044f44029dd060a50a5671ac4c956264da0a676dd959f1853510"}
Jul 21 20:58:01.484845 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:01.484665    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx" event={"ID":"ab37a394-c2c1-41bc-8430-f1238d9deea0","Type":"ContainerStarted","Data":"81113c08606d2eab1837ad3454bb0029feac066a8c2fd04dd63cedea8da1b9fb"}
Jul 21 20:58:01.530682 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:01.530598    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx" podStartSLOduration=1.53057603 podStartE2EDuration="1.53057603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:58:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:58:01.527124528 +0000 UTC m=+2632.459522688" watchObservedRunningTime="2026-07-21 20:58:01.53057603 +0000 UTC m=+2632.462974188"
Jul 21 20:58:01.609148 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:01.609104    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:58:01.609608 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:01.609462    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:58:01.611199 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:01.611178    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 20:58:06.512568 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:06.512532    2576 generic.go:356] "Generic (PLEG): container finished" podID="84b8f5c3-b015-41a3-a187-2f62b2be3b8c" containerID="cc0510dc71b9fa9c439be566c73bce839bf714418bda1747fedc4807ec129958" exitCode=0
Jul 21 20:58:06.513192 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:06.512613    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm" event={"ID":"84b8f5c3-b015-41a3-a187-2f62b2be3b8c","Type":"ContainerDied","Data":"cc0510dc71b9fa9c439be566c73bce839bf714418bda1747fedc4807ec129958"}
Jul 21 20:58:06.516709 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:06.513747    2576 scope.go:117] "RemoveContainer" containerID="cc0510dc71b9fa9c439be566c73bce839bf714418bda1747fedc4807ec129958"
Jul 21 20:58:06.521004 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:06.520966    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:58:06.521101 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:06.521084    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:58:06.521189 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:06.521128    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:58:07.520902 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:07.520862    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm" event={"ID":"84b8f5c3-b015-41a3-a187-2f62b2be3b8c","Type":"ContainerStarted","Data":"2958d23c83299bec3674fedd1c8ebafbcbd3b21e841e5b74f48cfcdb703a18f9"}
Jul 21 20:58:07.720145 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:07.720102    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:58:07.720563 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:07.720529    2576 patch_prober.go:28] interesting pod/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 21 20:58:07.720652 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:07.720595    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm" podUID="84b8f5c3-b015-41a3-a187-2f62b2be3b8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 21 20:58:08.138953 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:08.138880    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:58:08.583637 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:08.583593    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:58:08.720252 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:08.720214    2576 patch_prober.go:28] interesting pod/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 21 20:58:08.720571 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:08.720540    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm" podUID="84b8f5c3-b015-41a3-a187-2f62b2be3b8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 21 20:58:09.729713 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:09.724155    2576 patch_prober.go:28] interesting pod/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 21 20:58:09.729713 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:09.724234    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm" podUID="84b8f5c3-b015-41a3-a187-2f62b2be3b8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 21 20:58:10.700078 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:10.700031    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"
Jul 21 20:58:10.700268 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:10.700092    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"
Jul 21 20:58:10.713099 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:10.713071    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"
Jul 21 20:58:10.720640 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:10.720596    2576 patch_prober.go:28] interesting pod/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 21 20:58:10.720839 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:10.720720    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm" podUID="84b8f5c3-b015-41a3-a187-2f62b2be3b8c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 21 20:58:11.573108 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:11.573078    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"
Jul 21 20:58:11.725428 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:11.725396    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:58:11.725743 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:11.725724    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:58:11.726671 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:11.726650    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 20:58:28.075251 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.075210    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"]
Jul 21 20:58:28.078009 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.077983    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"
Jul 21 20:58:28.091636 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.091602    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-351a5d\"/\"kube-root-ca.crt\""
Jul 21 20:58:28.091821 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.091602    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-351a5d\"/\"default-dockercfg-5k2zq\""
Jul 21 20:58:28.091821 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.091602    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-351a5d\"/\"test-model-351a5d-kserve-self-signed-certs\""
Jul 21 20:58:28.091821 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.091621    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-351a5d\"/\"openshift-service-ca.crt\""
Jul 21 20:58:28.151970 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.151934    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"]
Jul 21 20:58:28.160974 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.160944    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-home\") pod \"test-model-351a5d-kserve-6fff4f7c9-jpt2g\" (UID: \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\") " pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"
Jul 21 20:58:28.161155 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.160978    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-model-cache\") pod \"test-model-351a5d-kserve-6fff4f7c9-jpt2g\" (UID: \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\") " pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"
Jul 21 20:58:28.161155 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.161067    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdb84\" (UniqueName: \"kubernetes.io/projected/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-kube-api-access-gdb84\") pod \"test-model-351a5d-kserve-6fff4f7c9-jpt2g\" (UID: \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\") " pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"
Jul 21 20:58:28.161155 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.161110    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-tmp-dir\") pod \"test-model-351a5d-kserve-6fff4f7c9-jpt2g\" (UID: \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\") " pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"
Jul 21 20:58:28.161299 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.161170    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-tls-certs\") pod \"test-model-351a5d-kserve-6fff4f7c9-jpt2g\" (UID: \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\") " pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"
Jul 21 20:58:28.161299 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.161239    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-dshm\") pod \"test-model-351a5d-kserve-6fff4f7c9-jpt2g\" (UID: \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\") " pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"
Jul 21 20:58:28.218812 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.218778    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:58:28.262652 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.262610    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-dshm\") pod \"test-model-351a5d-kserve-6fff4f7c9-jpt2g\" (UID: \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\") " pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"
Jul 21 20:58:28.262862 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.262666    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-home\") pod \"test-model-351a5d-kserve-6fff4f7c9-jpt2g\" (UID: \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\") " pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"
Jul 21 20:58:28.262862 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.262684    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-model-cache\") pod \"test-model-351a5d-kserve-6fff4f7c9-jpt2g\" (UID: \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\") " pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"
Jul 21 20:58:28.262862 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.262740    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdb84\" (UniqueName: \"kubernetes.io/projected/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-kube-api-access-gdb84\") pod \"test-model-351a5d-kserve-6fff4f7c9-jpt2g\" (UID: \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\") " pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"
Jul 21 20:58:28.262862 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.262759    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-tmp-dir\") pod \"test-model-351a5d-kserve-6fff4f7c9-jpt2g\" (UID: \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\") " pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"
Jul 21 20:58:28.263098 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.262871    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-tls-certs\") pod \"test-model-351a5d-kserve-6fff4f7c9-jpt2g\" (UID: \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\") " pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"
Jul 21 20:58:28.263211 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.263191    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-home\") pod \"test-model-351a5d-kserve-6fff4f7c9-jpt2g\" (UID: \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\") " pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"
Jul 21 20:58:28.263259 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.263223    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-model-cache\") pod \"test-model-351a5d-kserve-6fff4f7c9-jpt2g\" (UID: \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\") " pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"
Jul 21 20:58:28.263259 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.263239    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-tmp-dir\") pod \"test-model-351a5d-kserve-6fff4f7c9-jpt2g\" (UID: \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\") " pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"
Jul 21 20:58:28.265062 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.265037    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-dshm\") pod \"test-model-351a5d-kserve-6fff4f7c9-jpt2g\" (UID: \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\") " pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"
Jul 21 20:58:28.265299 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.265281    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-tls-certs\") pod \"test-model-351a5d-kserve-6fff4f7c9-jpt2g\" (UID: \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\") " pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"
Jul 21 20:58:28.276760 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.276731    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdb84\" (UniqueName: \"kubernetes.io/projected/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-kube-api-access-gdb84\") pod \"test-model-351a5d-kserve-6fff4f7c9-jpt2g\" (UID: \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\") " pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"
Jul 21 20:58:28.388055 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.387945    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"
Jul 21 20:58:28.556627 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.556601    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"]
Jul 21 20:58:28.558246 ip-10-0-128-201 kubenswrapper[2576]: W0721 20:58:28.558211    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd28c5cd6_6492_4016_ba78_0212dbb7f4ea.slice/crio-637a5fafa7200d5fda7e83b54a606f78dab3c4a1a47c528e1fc3fec8935b201a WatchSource:0}: Error finding container 637a5fafa7200d5fda7e83b54a606f78dab3c4a1a47c528e1fc3fec8935b201a: Status 404 returned error can't find the container with id 637a5fafa7200d5fda7e83b54a606f78dab3c4a1a47c528e1fc3fec8935b201a
Jul 21 20:58:28.655006 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.654913    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g" event={"ID":"d28c5cd6-6492-4016-ba78-0212dbb7f4ea","Type":"ContainerStarted","Data":"c24a44cf1ba7f0da2fc6b86dd7b352267a58d9d9d23e30d4d0921ef9686bc9cb"}
Jul 21 20:58:28.655006 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.654964    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g" event={"ID":"d28c5cd6-6492-4016-ba78-0212dbb7f4ea","Type":"ContainerStarted","Data":"637a5fafa7200d5fda7e83b54a606f78dab3c4a1a47c528e1fc3fec8935b201a"}
Jul 21 20:58:28.685293 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:28.685238    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g" podStartSLOduration=0.685222349 podStartE2EDuration="685.222349ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:58:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:58:28.68356243 +0000 UTC m=+2659.615960587" watchObservedRunningTime="2026-07-21 20:58:28.685222349 +0000 UTC m=+2659.617620506"
Jul 21 20:58:38.388970 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:38.388930    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"
Jul 21 20:58:38.389389 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:38.389006    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"
Jul 21 20:58:38.401571 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:38.401532    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"
Jul 21 20:58:38.718625 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:58:38.718537    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"
Jul 21 20:59:09.724721 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:09.724676    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w885b_62db291a-14b7-4e35-9550-9fb810f82b8d/console-operator/1.log"
Jul 21 20:59:09.731245 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:09.731207    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-54f9x_55f51c26-71cd-4e1b-84f2-32f2de4138d5/ovn-acl-logging/0.log"
Jul 21 20:59:09.734791 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:09.734770    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w885b_62db291a-14b7-4e35-9550-9fb810f82b8d/console-operator/1.log"
Jul 21 20:59:09.741139 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:09.741121    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-54f9x_55f51c26-71cd-4e1b-84f2-32f2de4138d5/ovn-acl-logging/0.log"
Jul 21 20:59:10.592569 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:10.592534    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"]
Jul 21 20:59:10.609582 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:10.609520    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:59:11.651669 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:11.651635    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:59:11.652430 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:11.652411    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"]
Jul 21 20:59:12.092236 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:12.092199    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:59:17.161474 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:17.161422    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:59:25.613449 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:25.613386    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx" podUID="ab37a394-c2c1-41bc-8430-f1238d9deea0" containerName="main" containerID="cri-o://64b5190cdce7044f44029dd060a50a5671ac4c956264da0a676dd959f1853510" gracePeriod=45
Jul 21 20:59:25.870601 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:25.870530    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"
Jul 21 20:59:25.949219 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:25.949183    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab37a394-c2c1-41bc-8430-f1238d9deea0-tls-certs\") pod \"ab37a394-c2c1-41bc-8430-f1238d9deea0\" (UID: \"ab37a394-c2c1-41bc-8430-f1238d9deea0\") "
Jul 21 20:59:25.949419 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:25.949229    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab37a394-c2c1-41bc-8430-f1238d9deea0-model-cache\") pod \"ab37a394-c2c1-41bc-8430-f1238d9deea0\" (UID: \"ab37a394-c2c1-41bc-8430-f1238d9deea0\") "
Jul 21 20:59:25.949419 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:25.949260    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqfml\" (UniqueName: \"kubernetes.io/projected/ab37a394-c2c1-41bc-8430-f1238d9deea0-kube-api-access-jqfml\") pod \"ab37a394-c2c1-41bc-8430-f1238d9deea0\" (UID: \"ab37a394-c2c1-41bc-8430-f1238d9deea0\") "
Jul 21 20:59:25.949419 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:25.949365    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab37a394-c2c1-41bc-8430-f1238d9deea0-home\") pod \"ab37a394-c2c1-41bc-8430-f1238d9deea0\" (UID: \"ab37a394-c2c1-41bc-8430-f1238d9deea0\") "
Jul 21 20:59:25.949590 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:25.949424    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab37a394-c2c1-41bc-8430-f1238d9deea0-dshm\") pod \"ab37a394-c2c1-41bc-8430-f1238d9deea0\" (UID: \"ab37a394-c2c1-41bc-8430-f1238d9deea0\") "
Jul 21 20:59:25.949590 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:25.949545    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab37a394-c2c1-41bc-8430-f1238d9deea0-model-cache" (OuterVolumeSpecName: "model-cache") pod "ab37a394-c2c1-41bc-8430-f1238d9deea0" (UID: "ab37a394-c2c1-41bc-8430-f1238d9deea0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:59:25.949590 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:25.949555    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab37a394-c2c1-41bc-8430-f1238d9deea0-tmp-dir\") pod \"ab37a394-c2c1-41bc-8430-f1238d9deea0\" (UID: \"ab37a394-c2c1-41bc-8430-f1238d9deea0\") "
Jul 21 20:59:25.949780 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:25.949586    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab37a394-c2c1-41bc-8430-f1238d9deea0-home" (OuterVolumeSpecName: "home") pod "ab37a394-c2c1-41bc-8430-f1238d9deea0" (UID: "ab37a394-c2c1-41bc-8430-f1238d9deea0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:59:25.949780 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:25.949753    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab37a394-c2c1-41bc-8430-f1238d9deea0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ab37a394-c2c1-41bc-8430-f1238d9deea0" (UID: "ab37a394-c2c1-41bc-8430-f1238d9deea0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:59:25.950005 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:25.949984    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab37a394-c2c1-41bc-8430-f1238d9deea0-tmp-dir\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:59:25.950079 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:25.950013    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab37a394-c2c1-41bc-8430-f1238d9deea0-model-cache\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:59:25.950079 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:25.950026    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab37a394-c2c1-41bc-8430-f1238d9deea0-home\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:59:25.951584 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:25.951548    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab37a394-c2c1-41bc-8430-f1238d9deea0-dshm" (OuterVolumeSpecName: "dshm") pod "ab37a394-c2c1-41bc-8430-f1238d9deea0" (UID: "ab37a394-c2c1-41bc-8430-f1238d9deea0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:59:25.951659 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:25.951617    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab37a394-c2c1-41bc-8430-f1238d9deea0-kube-api-access-jqfml" (OuterVolumeSpecName: "kube-api-access-jqfml") pod "ab37a394-c2c1-41bc-8430-f1238d9deea0" (UID: "ab37a394-c2c1-41bc-8430-f1238d9deea0"). InnerVolumeSpecName "kube-api-access-jqfml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:59:25.951714 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:25.951667    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab37a394-c2c1-41bc-8430-f1238d9deea0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ab37a394-c2c1-41bc-8430-f1238d9deea0" (UID: "ab37a394-c2c1-41bc-8430-f1238d9deea0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:59:25.961856 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:25.961830    2576 generic.go:356] "Generic (PLEG): container finished" podID="ab37a394-c2c1-41bc-8430-f1238d9deea0" containerID="64b5190cdce7044f44029dd060a50a5671ac4c956264da0a676dd959f1853510" exitCode=0
Jul 21 20:59:25.961970 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:25.961874    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"
Jul 21 20:59:25.961970 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:25.961912    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx" event={"ID":"ab37a394-c2c1-41bc-8430-f1238d9deea0","Type":"ContainerDied","Data":"64b5190cdce7044f44029dd060a50a5671ac4c956264da0a676dd959f1853510"}
Jul 21 20:59:25.961970 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:25.961957    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx" event={"ID":"ab37a394-c2c1-41bc-8430-f1238d9deea0","Type":"ContainerDied","Data":"81113c08606d2eab1837ad3454bb0029feac066a8c2fd04dd63cedea8da1b9fb"}
Jul 21 20:59:25.962097 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:25.961976    2576 scope.go:117] "RemoveContainer" containerID="64b5190cdce7044f44029dd060a50a5671ac4c956264da0a676dd959f1853510"
Jul 21 20:59:25.971486 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:25.971467    2576 scope.go:117] "RemoveContainer" containerID="64b5190cdce7044f44029dd060a50a5671ac4c956264da0a676dd959f1853510"
Jul 21 20:59:25.971787 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:59:25.971768    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64b5190cdce7044f44029dd060a50a5671ac4c956264da0a676dd959f1853510\": container with ID starting with 64b5190cdce7044f44029dd060a50a5671ac4c956264da0a676dd959f1853510 not found: ID does not exist" containerID="64b5190cdce7044f44029dd060a50a5671ac4c956264da0a676dd959f1853510"
Jul 21 20:59:25.971859 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:25.971796    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64b5190cdce7044f44029dd060a50a5671ac4c956264da0a676dd959f1853510"} err="failed to get container status \"64b5190cdce7044f44029dd060a50a5671ac4c956264da0a676dd959f1853510\": rpc error: code = NotFound desc = could not find container \"64b5190cdce7044f44029dd060a50a5671ac4c956264da0a676dd959f1853510\": container with ID starting with 64b5190cdce7044f44029dd060a50a5671ac4c956264da0a676dd959f1853510 not found: ID does not exist"
Jul 21 20:59:25.987281 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:25.987254    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"]
Jul 21 20:59:25.995634 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:25.995608    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-2ba36e/test-model-2ba36e-kserve-675989859f-gjtfx"]
Jul 21 20:59:26.051051 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:26.051018    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqfml\" (UniqueName: \"kubernetes.io/projected/ab37a394-c2c1-41bc-8430-f1238d9deea0-kube-api-access-jqfml\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:59:26.051051 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:26.051049    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab37a394-c2c1-41bc-8430-f1238d9deea0-dshm\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:59:26.051259 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:26.051064    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab37a394-c2c1-41bc-8430-f1238d9deea0-tls-certs\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:59:26.673129 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:26.673089    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g" podUID="d28c5cd6-6492-4016-ba78-0212dbb7f4ea" containerName="main" containerID="cri-o://c24a44cf1ba7f0da2fc6b86dd7b352267a58d9d9d23e30d4d0921ef9686bc9cb" gracePeriod=45
Jul 21 20:59:26.943025 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:26.942998    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"
Jul 21 20:59:26.971410 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:26.971381    2576 generic.go:356] "Generic (PLEG): container finished" podID="d28c5cd6-6492-4016-ba78-0212dbb7f4ea" containerID="c24a44cf1ba7f0da2fc6b86dd7b352267a58d9d9d23e30d4d0921ef9686bc9cb" exitCode=0
Jul 21 20:59:26.971587 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:26.971422    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"
Jul 21 20:59:26.971587 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:26.971450    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g" event={"ID":"d28c5cd6-6492-4016-ba78-0212dbb7f4ea","Type":"ContainerDied","Data":"c24a44cf1ba7f0da2fc6b86dd7b352267a58d9d9d23e30d4d0921ef9686bc9cb"}
Jul 21 20:59:26.971587 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:26.971478    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g" event={"ID":"d28c5cd6-6492-4016-ba78-0212dbb7f4ea","Type":"ContainerDied","Data":"637a5fafa7200d5fda7e83b54a606f78dab3c4a1a47c528e1fc3fec8935b201a"}
Jul 21 20:59:26.971587 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:26.971495    2576 scope.go:117] "RemoveContainer" containerID="c24a44cf1ba7f0da2fc6b86dd7b352267a58d9d9d23e30d4d0921ef9686bc9cb"
Jul 21 20:59:26.980134 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:26.980108    2576 scope.go:117] "RemoveContainer" containerID="c24a44cf1ba7f0da2fc6b86dd7b352267a58d9d9d23e30d4d0921ef9686bc9cb"
Jul 21 20:59:26.980455 ip-10-0-128-201 kubenswrapper[2576]: E0721 20:59:26.980434    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c24a44cf1ba7f0da2fc6b86dd7b352267a58d9d9d23e30d4d0921ef9686bc9cb\": container with ID starting with c24a44cf1ba7f0da2fc6b86dd7b352267a58d9d9d23e30d4d0921ef9686bc9cb not found: ID does not exist" containerID="c24a44cf1ba7f0da2fc6b86dd7b352267a58d9d9d23e30d4d0921ef9686bc9cb"
Jul 21 20:59:26.980519 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:26.980467    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c24a44cf1ba7f0da2fc6b86dd7b352267a58d9d9d23e30d4d0921ef9686bc9cb"} err="failed to get container status \"c24a44cf1ba7f0da2fc6b86dd7b352267a58d9d9d23e30d4d0921ef9686bc9cb\": rpc error: code = NotFound desc = could not find container \"c24a44cf1ba7f0da2fc6b86dd7b352267a58d9d9d23e30d4d0921ef9686bc9cb\": container with ID starting with c24a44cf1ba7f0da2fc6b86dd7b352267a58d9d9d23e30d4d0921ef9686bc9cb not found: ID does not exist"
Jul 21 20:59:27.062281 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:27.062241    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-dshm\") pod \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\" (UID: \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\") "
Jul 21 20:59:27.062487 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:27.062315    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-tmp-dir\") pod \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\" (UID: \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\") "
Jul 21 20:59:27.062487 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:27.062357    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-model-cache\") pod \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\" (UID: \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\") "
Jul 21 20:59:27.062487 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:27.062408    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdb84\" (UniqueName: \"kubernetes.io/projected/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-kube-api-access-gdb84\") pod \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\" (UID: \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\") "
Jul 21 20:59:27.062487 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:27.062447    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-home\") pod \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\" (UID: \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\") "
Jul 21 20:59:27.062487 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:27.062483    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-tls-certs\") pod \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\" (UID: \"d28c5cd6-6492-4016-ba78-0212dbb7f4ea\") "
Jul 21 20:59:27.062786 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:27.062646    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d28c5cd6-6492-4016-ba78-0212dbb7f4ea" (UID: "d28c5cd6-6492-4016-ba78-0212dbb7f4ea"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:59:27.062786 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:27.062740    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-model-cache" (OuterVolumeSpecName: "model-cache") pod "d28c5cd6-6492-4016-ba78-0212dbb7f4ea" (UID: "d28c5cd6-6492-4016-ba78-0212dbb7f4ea"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:59:27.062786 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:27.062753    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-home" (OuterVolumeSpecName: "home") pod "d28c5cd6-6492-4016-ba78-0212dbb7f4ea" (UID: "d28c5cd6-6492-4016-ba78-0212dbb7f4ea"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:59:27.064766 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:27.064715    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-dshm" (OuterVolumeSpecName: "dshm") pod "d28c5cd6-6492-4016-ba78-0212dbb7f4ea" (UID: "d28c5cd6-6492-4016-ba78-0212dbb7f4ea"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:59:27.064885 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:27.064761    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-kube-api-access-gdb84" (OuterVolumeSpecName: "kube-api-access-gdb84") pod "d28c5cd6-6492-4016-ba78-0212dbb7f4ea" (UID: "d28c5cd6-6492-4016-ba78-0212dbb7f4ea"). InnerVolumeSpecName "kube-api-access-gdb84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:59:27.064885 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:27.064769    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d28c5cd6-6492-4016-ba78-0212dbb7f4ea" (UID: "d28c5cd6-6492-4016-ba78-0212dbb7f4ea"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:59:27.164267 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:27.164228    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-tmp-dir\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:59:27.164267 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:27.164260    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-model-cache\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:59:27.164267 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:27.164270    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdb84\" (UniqueName: \"kubernetes.io/projected/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-kube-api-access-gdb84\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:59:27.164267 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:27.164279    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-home\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:59:27.164558 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:27.164288    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-tls-certs\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:59:27.164558 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:27.164296    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d28c5cd6-6492-4016-ba78-0212dbb7f4ea-dshm\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 20:59:27.296056 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:27.296016    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"]
Jul 21 20:59:27.300475 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:27.300444    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-351a5d/test-model-351a5d-kserve-6fff4f7c9-jpt2g"]
Jul 21 20:59:27.652442 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:27.652355    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab37a394-c2c1-41bc-8430-f1238d9deea0" path="/var/lib/kubelet/pods/ab37a394-c2c1-41bc-8430-f1238d9deea0/volumes"
Jul 21 20:59:27.652813 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:27.652799    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d28c5cd6-6492-4016-ba78-0212dbb7f4ea" path="/var/lib/kubelet/pods/d28c5cd6-6492-4016-ba78-0212dbb7f4ea/volumes"
Jul 21 20:59:54.780958 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:54.780919    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:59:55.079377 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:55.079277    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"]
Jul 21 20:59:55.079556 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:55.079523    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2" podUID="f43f9cc0-8148-4c3d-b39f-695a01dda87d" containerName="istio-proxy" containerID="cri-o://b877a602b69c7b8e3c43c75fd9a935e3ae0eabf6c31546ed2880989f876074a3" gracePeriod=30
Jul 21 20:59:55.082841 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:55.082800    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:59:55.268079 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:55.268031    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 20:59:55.733862 ip-10-0-128-201 kubenswrapper[2576]: I0721 20:59:55.733832    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:00.157613 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.157575    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-672ca14c-29744460-r4vjg"]
Jul 21 21:00:00.158190 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.158164    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d28c5cd6-6492-4016-ba78-0212dbb7f4ea" containerName="main"
Jul 21 21:00:00.158190 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.158190    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d28c5cd6-6492-4016-ba78-0212dbb7f4ea" containerName="main"
Jul 21 21:00:00.158313 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.158222    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab37a394-c2c1-41bc-8430-f1238d9deea0" containerName="main"
Jul 21 21:00:00.158313 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.158230    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab37a394-c2c1-41bc-8430-f1238d9deea0" containerName="main"
Jul 21 21:00:00.158408 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.158333    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab37a394-c2c1-41bc-8430-f1238d9deea0" containerName="main"
Jul 21 21:00:00.158408 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.158347    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d28c5cd6-6492-4016-ba78-0212dbb7f4ea" containerName="main"
Jul 21 21:00:00.161305 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.161284    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-2ba36e-29744460-6cg8f"]
Jul 21 21:00:00.161427 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.161407    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-672ca14c-29744460-r4vjg"
Jul 21 21:00:00.164045 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.164023    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kvpgn\""
Jul 21 21:00:00.164566 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.164541    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-2ba36e-29744460-6cg8f"
Jul 21 21:00:00.174415 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.174381    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-83e6600b-29744460-k9kmt"]
Jul 21 21:00:00.175380 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.175359    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-672ca14c-29744460-r4vjg"
Jul 21 21:00:00.182072 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.181241    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e7adb3ea-29744460-rlbrh"]
Jul 21 21:00:00.182705 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.182284    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-83e6600b-29744460-k9kmt"
Jul 21 21:00:00.185908 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.185434    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-351a5d-29744460-5xk5x"]
Jul 21 21:00:00.188428 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.188353    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e7adb3ea-29744460-rlbrh"
Jul 21 21:00:00.189897 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.189705    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-2ba36e-29744460-6cg8f"
Jul 21 21:00:00.190190 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.190168    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-672ca14c-29744460-r4vjg"]
Jul 21 21:00:00.190284 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.190272    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-351a5d-29744460-5xk5x"
Jul 21 21:00:00.191271 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.191240    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-2ba36e-29744460-6cg8f"]
Jul 21 21:00:00.197943 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.197915    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-868c4ca9-29744460-qs5n8"]
Jul 21 21:00:00.202653 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.202631    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-868c4ca9-29744460-qs5n8"
Jul 21 21:00:00.216834 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.216809    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-351a5d-29744460-5xk5x"]
Jul 21 21:00:00.218872 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.218817    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-83e6600b-29744460-k9kmt"]
Jul 21 21:00:00.223257 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.223172    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e7adb3ea-29744460-rlbrh"]
Jul 21 21:00:00.231905 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.229756    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744460-94gfb"]
Jul 21 21:00:00.234350 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.234210    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744460-94gfb"
Jul 21 21:00:00.234743 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.234664    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-868c4ca9-29744460-qs5n8"]
Jul 21 21:00:00.245236 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.245207    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744460-94gfb"]
Jul 21 21:00:00.245506 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.245255    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-83e6600b-29744460-k9kmt"
Jul 21 21:00:00.256442 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.256033    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e7adb3ea-29744460-rlbrh"
Jul 21 21:00:00.302856 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.302826    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-351a5d-29744460-5xk5x"
Jul 21 21:00:00.352834 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.351916    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-868c4ca9-29744460-qs5n8"
Jul 21 21:00:00.373578 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.373450    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744460-94gfb"
Jul 21 21:00:00.505916 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.505769    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-672ca14c-29744460-r4vjg"]
Jul 21 21:00:00.507971 ip-10-0-128-201 kubenswrapper[2576]: W0721 21:00:00.507621    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod620a3ff8_d7d5_44ea_a370_36ff4c351f83.slice/crio-b8fceb32661216980c833117180530ffb2ed21916038f84ee171174982e4021c WatchSource:0}: Error finding container b8fceb32661216980c833117180530ffb2ed21916038f84ee171174982e4021c: Status 404 returned error can't find the container with id b8fceb32661216980c833117180530ffb2ed21916038f84ee171174982e4021c
Jul 21 21:00:00.515248 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.514942    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 21:00:00.601961 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.601878    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istio-token\") pod \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") "
Jul 21 21:00:00.602104 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.601966    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbbd5\" (UniqueName: \"kubernetes.io/projected/f43f9cc0-8148-4c3d-b39f-695a01dda87d-kube-api-access-kbbd5\") pod \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") "
Jul 21 21:00:00.602104 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.601995    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-workload-socket\") pod \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") "
Jul 21 21:00:00.602104 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.602031    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istiod-ca-cert\") pod \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") "
Jul 21 21:00:00.602104 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.602066    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istio-data\") pod \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") "
Jul 21 21:00:00.602104 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.602103    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istio-podinfo\") pod \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") "
Jul 21 21:00:00.602482 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.602420    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f43f9cc0-8148-4c3d-b39f-695a01dda87d" (UID: "f43f9cc0-8148-4c3d-b39f-695a01dda87d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:00:00.602617 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.602521    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f43f9cc0-8148-4c3d-b39f-695a01dda87d" (UID: "f43f9cc0-8148-4c3d-b39f-695a01dda87d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 21:00:00.602826 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.602802    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-workload-certs\") pod \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") "
Jul 21 21:00:00.602942 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.602910    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istio-envoy\") pod \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") "
Jul 21 21:00:00.603055 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.603008    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istio-data" (OuterVolumeSpecName: "istio-data") pod "f43f9cc0-8148-4c3d-b39f-695a01dda87d" (UID: "f43f9cc0-8148-4c3d-b39f-695a01dda87d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:00:00.603055 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.603008    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-credential-socket\") pod \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\" (UID: \"f43f9cc0-8148-4c3d-b39f-695a01dda87d\") "
Jul 21 21:00:00.603335 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.603182    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f43f9cc0-8148-4c3d-b39f-695a01dda87d" (UID: "f43f9cc0-8148-4c3d-b39f-695a01dda87d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:00:00.603402 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.603334    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f43f9cc0-8148-4c3d-b39f-695a01dda87d" (UID: "f43f9cc0-8148-4c3d-b39f-695a01dda87d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:00:00.603963 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.603940    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-workload-certs\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:00.604048 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.604023    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-credential-socket\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:00.604117 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.604046    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-workload-socket\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:00.604117 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.604061    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istiod-ca-cert\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:00.604224 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.604076    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istio-data\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:00.604752 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.604729    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istio-token" (OuterVolumeSpecName: "istio-token") pod "f43f9cc0-8148-4c3d-b39f-695a01dda87d" (UID: "f43f9cc0-8148-4c3d-b39f-695a01dda87d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:00:00.604938 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.604917    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f43f9cc0-8148-4c3d-b39f-695a01dda87d" (UID: "f43f9cc0-8148-4c3d-b39f-695a01dda87d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 21:00:00.605006 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.604919    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f43f9cc0-8148-4c3d-b39f-695a01dda87d-kube-api-access-kbbd5" (OuterVolumeSpecName: "kube-api-access-kbbd5") pod "f43f9cc0-8148-4c3d-b39f-695a01dda87d" (UID: "f43f9cc0-8148-4c3d-b39f-695a01dda87d"). InnerVolumeSpecName "kube-api-access-kbbd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:00:00.605799 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.605724    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f43f9cc0-8148-4c3d-b39f-695a01dda87d" (UID: "f43f9cc0-8148-4c3d-b39f-695a01dda87d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:00:00.705367 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.705326    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istio-token\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:00.705367 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.705365    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbbd5\" (UniqueName: \"kubernetes.io/projected/f43f9cc0-8148-4c3d-b39f-695a01dda87d-kube-api-access-kbbd5\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:00.705367 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.705378    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istio-podinfo\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:00.705625 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.705391    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f43f9cc0-8148-4c3d-b39f-695a01dda87d-istio-envoy\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:00.746338 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.746302    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-83e6600b-29744460-k9kmt"]
Jul 21 21:00:00.748358 ip-10-0-128-201 kubenswrapper[2576]: W0721 21:00:00.748263    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb54b7992_9f8b_4c35_a4fa_59f6be2a9d6b.slice/crio-4cc9ae6cc8edc2e4c4d5d7f74994381d254f788f27905f86c09e850a9c2801a2 WatchSource:0}: Error finding container 4cc9ae6cc8edc2e4c4d5d7f74994381d254f788f27905f86c09e850a9c2801a2: Status 404 returned error can't find the container with id 4cc9ae6cc8edc2e4c4d5d7f74994381d254f788f27905f86c09e850a9c2801a2
Jul 21 21:00:00.749302 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.749280    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-2ba36e-29744460-6cg8f"]
Jul 21 21:00:00.751247 ip-10-0-128-201 kubenswrapper[2576]: W0721 21:00:00.751225    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a5460b5_f592_4430_9d56_f79831b5ee12.slice/crio-e3eab6ec2e55d5d8fa2263adaa6f4b703a75ad8bc92f84b645f697d2f5083117 WatchSource:0}: Error finding container e3eab6ec2e55d5d8fa2263adaa6f4b703a75ad8bc92f84b645f697d2f5083117: Status 404 returned error can't find the container with id e3eab6ec2e55d5d8fa2263adaa6f4b703a75ad8bc92f84b645f697d2f5083117
Jul 21 21:00:00.806032 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.806005    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e7adb3ea-29744460-rlbrh"]
Jul 21 21:00:00.807869 ip-10-0-128-201 kubenswrapper[2576]: W0721 21:00:00.807835    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc71f251d_a850_4878_a050_5020c0089861.slice/crio-2e45c5b1c8cb2b70fd8f3a1bd2f353d167107258a6c568c3123e8c197a891d39 WatchSource:0}: Error finding container 2e45c5b1c8cb2b70fd8f3a1bd2f353d167107258a6c568c3123e8c197a891d39: Status 404 returned error can't find the container with id 2e45c5b1c8cb2b70fd8f3a1bd2f353d167107258a6c568c3123e8c197a891d39
Jul 21 21:00:00.814553 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.814525    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-351a5d-29744460-5xk5x"]
Jul 21 21:00:00.815804 ip-10-0-128-201 kubenswrapper[2576]: W0721 21:00:00.815719    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd79ac56b_6fbe_403e_bc3c_3788809c114f.slice/crio-c4d9db3777acbaef83122cfdb108137f9c04da28ab8ff1ec3766d321a682bd81 WatchSource:0}: Error finding container c4d9db3777acbaef83122cfdb108137f9c04da28ab8ff1ec3766d321a682bd81: Status 404 returned error can't find the container with id c4d9db3777acbaef83122cfdb108137f9c04da28ab8ff1ec3766d321a682bd81
Jul 21 21:00:00.854848 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.854822    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-868c4ca9-29744460-qs5n8"]
Jul 21 21:00:00.856022 ip-10-0-128-201 kubenswrapper[2576]: W0721 21:00:00.855995    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod027a86eb_2934_4cc6_b95c_f28581009e35.slice/crio-cdb016366017eab0823134a27f6f0e8c8c0e8f2aa240e524e1e18d4a72ca043b WatchSource:0}: Error finding container cdb016366017eab0823134a27f6f0e8c8c0e8f2aa240e524e1e18d4a72ca043b: Status 404 returned error can't find the container with id cdb016366017eab0823134a27f6f0e8c8c0e8f2aa240e524e1e18d4a72ca043b
Jul 21 21:00:00.874240 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:00.874212    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744460-94gfb"]
Jul 21 21:00:00.875503 ip-10-0-128-201 kubenswrapper[2576]: W0721 21:00:00.875473    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f299eae_f722_47be_98d2_436512624278.slice/crio-22282e814bb5afae58bae7427cb9886c3c9d52cfc2e82d1db00b41832b466f25 WatchSource:0}: Error finding container 22282e814bb5afae58bae7427cb9886c3c9d52cfc2e82d1db00b41832b466f25: Status 404 returned error can't find the container with id 22282e814bb5afae58bae7427cb9886c3c9d52cfc2e82d1db00b41832b466f25
Jul 21 21:00:01.156038 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:01.156008    2576 generic.go:356] "Generic (PLEG): container finished" podID="f43f9cc0-8148-4c3d-b39f-695a01dda87d" containerID="b877a602b69c7b8e3c43c75fd9a935e3ae0eabf6c31546ed2880989f876074a3" exitCode=0
Jul 21 21:00:01.156220 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:01.156053    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"
Jul 21 21:00:01.156220 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:01.156094    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2" event={"ID":"f43f9cc0-8148-4c3d-b39f-695a01dda87d","Type":"ContainerDied","Data":"b877a602b69c7b8e3c43c75fd9a935e3ae0eabf6c31546ed2880989f876074a3"}
Jul 21 21:00:01.156220 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:01.156160    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2" event={"ID":"f43f9cc0-8148-4c3d-b39f-695a01dda87d","Type":"ContainerDied","Data":"5226109165bcd86fb8962d48fb51322c6ccc865e8fc8f83de4bce153091616fe"}
Jul 21 21:00:01.156220 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:01.156192    2576 scope.go:117] "RemoveContainer" containerID="b877a602b69c7b8e3c43c75fd9a935e3ae0eabf6c31546ed2880989f876074a3"
Jul 21 21:00:01.157504 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:01.157478    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e7adb3ea-29744460-rlbrh" event={"ID":"c71f251d-a850-4878-a050-5020c0089861","Type":"ContainerStarted","Data":"2e45c5b1c8cb2b70fd8f3a1bd2f353d167107258a6c568c3123e8c197a891d39"}
Jul 21 21:00:01.158857 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:01.158836    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-868c4ca9-29744460-qs5n8" event={"ID":"027a86eb-2934-4cc6-b95c-f28581009e35","Type":"ContainerStarted","Data":"cdb016366017eab0823134a27f6f0e8c8c0e8f2aa240e524e1e18d4a72ca043b"}
Jul 21 21:00:01.160436 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:01.160380    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-83e6600b-29744460-k9kmt" event={"ID":"b54b7992-9f8b-4c35-a4fa-59f6be2a9d6b","Type":"ContainerStarted","Data":"4cc9ae6cc8edc2e4c4d5d7f74994381d254f788f27905f86c09e850a9c2801a2"}
Jul 21 21:00:01.162362 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:01.162338    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-672ca14c-29744460-r4vjg" event={"ID":"620a3ff8-d7d5-44ea-a370-36ff4c351f83","Type":"ContainerStarted","Data":"caf819094c95a6330f6a232c1a0765ff74eab8ac0116385fc067e1e6d9d20a53"}
Jul 21 21:00:01.162474 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:01.162384    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-672ca14c-29744460-r4vjg" event={"ID":"620a3ff8-d7d5-44ea-a370-36ff4c351f83","Type":"ContainerStarted","Data":"b8fceb32661216980c833117180530ffb2ed21916038f84ee171174982e4021c"}
Jul 21 21:00:01.163601 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:01.163573    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-351a5d-29744460-5xk5x" event={"ID":"d79ac56b-6fbe-403e-bc3c-3788809c114f","Type":"ContainerStarted","Data":"c4d9db3777acbaef83122cfdb108137f9c04da28ab8ff1ec3766d321a682bd81"}
Jul 21 21:00:01.164816 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:01.164798    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744460-94gfb" event={"ID":"9f299eae-f722-47be-98d2-436512624278","Type":"ContainerStarted","Data":"22282e814bb5afae58bae7427cb9886c3c9d52cfc2e82d1db00b41832b466f25"}
Jul 21 21:00:01.166955 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:01.166921    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-2ba36e-29744460-6cg8f" event={"ID":"6a5460b5-f592-4430-9d56-f79831b5ee12","Type":"ContainerStarted","Data":"c869b31b7fe3e867d6b32e1434af09294678571b44d478c1c45379caef26fd1f"}
Jul 21 21:00:01.167043 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:01.166966    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-2ba36e-29744460-6cg8f" event={"ID":"6a5460b5-f592-4430-9d56-f79831b5ee12","Type":"ContainerStarted","Data":"e3eab6ec2e55d5d8fa2263adaa6f4b703a75ad8bc92f84b645f697d2f5083117"}
Jul 21 21:00:01.168357 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:01.168342    2576 scope.go:117] "RemoveContainer" containerID="7cc1c8a873dde953920ed6a91559e3275fca23bbc5fc78c597e92ff9a87dba10"
Jul 21 21:00:01.177494 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:01.177473    2576 scope.go:117] "RemoveContainer" containerID="b877a602b69c7b8e3c43c75fd9a935e3ae0eabf6c31546ed2880989f876074a3"
Jul 21 21:00:01.177814 ip-10-0-128-201 kubenswrapper[2576]: E0721 21:00:01.177788    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b877a602b69c7b8e3c43c75fd9a935e3ae0eabf6c31546ed2880989f876074a3\": container with ID starting with b877a602b69c7b8e3c43c75fd9a935e3ae0eabf6c31546ed2880989f876074a3 not found: ID does not exist" containerID="b877a602b69c7b8e3c43c75fd9a935e3ae0eabf6c31546ed2880989f876074a3"
Jul 21 21:00:01.177901 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:01.177827    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b877a602b69c7b8e3c43c75fd9a935e3ae0eabf6c31546ed2880989f876074a3"} err="failed to get container status \"b877a602b69c7b8e3c43c75fd9a935e3ae0eabf6c31546ed2880989f876074a3\": rpc error: code = NotFound desc = could not find container \"b877a602b69c7b8e3c43c75fd9a935e3ae0eabf6c31546ed2880989f876074a3\": container with ID starting with b877a602b69c7b8e3c43c75fd9a935e3ae0eabf6c31546ed2880989f876074a3 not found: ID does not exist"
Jul 21 21:00:01.177901 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:01.177852    2576 scope.go:117] "RemoveContainer" containerID="7cc1c8a873dde953920ed6a91559e3275fca23bbc5fc78c597e92ff9a87dba10"
Jul 21 21:00:01.178121 ip-10-0-128-201 kubenswrapper[2576]: E0721 21:00:01.178103    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cc1c8a873dde953920ed6a91559e3275fca23bbc5fc78c597e92ff9a87dba10\": container with ID starting with 7cc1c8a873dde953920ed6a91559e3275fca23bbc5fc78c597e92ff9a87dba10 not found: ID does not exist" containerID="7cc1c8a873dde953920ed6a91559e3275fca23bbc5fc78c597e92ff9a87dba10"
Jul 21 21:00:01.178167 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:01.178127    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cc1c8a873dde953920ed6a91559e3275fca23bbc5fc78c597e92ff9a87dba10"} err="failed to get container status \"7cc1c8a873dde953920ed6a91559e3275fca23bbc5fc78c597e92ff9a87dba10\": rpc error: code = NotFound desc = could not find container \"7cc1c8a873dde953920ed6a91559e3275fca23bbc5fc78c597e92ff9a87dba10\": container with ID starting with 7cc1c8a873dde953920ed6a91559e3275fca23bbc5fc78c597e92ff9a87dba10 not found: ID does not exist"
Jul 21 21:00:01.181776 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:01.181732    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-672ca14c-29744460-r4vjg" podStartSLOduration=1.181715521 podStartE2EDuration="1.181715521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:00:01.179899244 +0000 UTC m=+2752.112297400" watchObservedRunningTime="2026-07-21 21:00:01.181715521 +0000 UTC m=+2752.114113678"
Jul 21 21:00:01.195759 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:01.195729    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"]
Jul 21 21:00:01.199604 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:01.199571    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-2ba36e-openshift-default-7594b84cf9-zdft2"]
Jul 21 21:00:01.216342 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:01.216276    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-2ba36e-29744460-6cg8f" podStartSLOduration=1.216255279 podStartE2EDuration="1.216255279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:00:01.215540325 +0000 UTC m=+2752.147938482" watchObservedRunningTime="2026-07-21 21:00:01.216255279 +0000 UTC m=+2752.148653436"
Jul 21 21:00:01.653190 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:01.653156    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f43f9cc0-8148-4c3d-b39f-695a01dda87d" path="/var/lib/kubelet/pods/f43f9cc0-8148-4c3d-b39f-695a01dda87d/volumes"
Jul 21 21:00:02.179327 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:02.179289    2576 generic.go:356] "Generic (PLEG): container finished" podID="c71f251d-a850-4878-a050-5020c0089861" containerID="95bf3312d4ad6cc92dd51b254a5b6afcd04224ea657ce79529e90753c2041530" exitCode=0
Jul 21 21:00:02.179757 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:02.179373    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e7adb3ea-29744460-rlbrh" event={"ID":"c71f251d-a850-4878-a050-5020c0089861","Type":"ContainerDied","Data":"95bf3312d4ad6cc92dd51b254a5b6afcd04224ea657ce79529e90753c2041530"}
Jul 21 21:00:02.181136 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:02.181108    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-868c4ca9-29744460-qs5n8" event={"ID":"027a86eb-2934-4cc6-b95c-f28581009e35","Type":"ContainerStarted","Data":"8186533cd2332010cbfebd81aefb72849dedb89557ff1f8ed217616650ec25bd"}
Jul 21 21:00:02.182933 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:02.182884    2576 generic.go:356] "Generic (PLEG): container finished" podID="b54b7992-9f8b-4c35-a4fa-59f6be2a9d6b" containerID="64b6e245f810e355f424a672bf3355a06a629629b73b188da02f49843fe5de1e" exitCode=0
Jul 21 21:00:02.183051 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:02.183006    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-83e6600b-29744460-k9kmt" event={"ID":"b54b7992-9f8b-4c35-a4fa-59f6be2a9d6b","Type":"ContainerDied","Data":"64b6e245f810e355f424a672bf3355a06a629629b73b188da02f49843fe5de1e"}
Jul 21 21:00:02.185003 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:02.184977    2576 generic.go:356] "Generic (PLEG): container finished" podID="620a3ff8-d7d5-44ea-a370-36ff4c351f83" containerID="caf819094c95a6330f6a232c1a0765ff74eab8ac0116385fc067e1e6d9d20a53" exitCode=0
Jul 21 21:00:02.185101 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:02.185055    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-672ca14c-29744460-r4vjg" event={"ID":"620a3ff8-d7d5-44ea-a370-36ff4c351f83","Type":"ContainerDied","Data":"caf819094c95a6330f6a232c1a0765ff74eab8ac0116385fc067e1e6d9d20a53"}
Jul 21 21:00:02.186534 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:02.186512    2576 generic.go:356] "Generic (PLEG): container finished" podID="d79ac56b-6fbe-403e-bc3c-3788809c114f" containerID="06c2489061369d131880b75a956bee11cf8acf72ba3ff2c5f354738913c4a205" exitCode=0
Jul 21 21:00:02.186618 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:02.186583    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-351a5d-29744460-5xk5x" event={"ID":"d79ac56b-6fbe-403e-bc3c-3788809c114f","Type":"ContainerDied","Data":"06c2489061369d131880b75a956bee11cf8acf72ba3ff2c5f354738913c4a205"}
Jul 21 21:00:02.188530 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:02.188505    2576 generic.go:356] "Generic (PLEG): container finished" podID="9f299eae-f722-47be-98d2-436512624278" containerID="190244bc6abdc1ff74cdf1a1927d3318e617f171aac508f106b31d674e4a07d1" exitCode=0
Jul 21 21:00:02.188761 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:02.188556    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744460-94gfb" event={"ID":"9f299eae-f722-47be-98d2-436512624278","Type":"ContainerDied","Data":"190244bc6abdc1ff74cdf1a1927d3318e617f171aac508f106b31d674e4a07d1"}
Jul 21 21:00:02.190242 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:02.190221    2576 generic.go:356] "Generic (PLEG): container finished" podID="6a5460b5-f592-4430-9d56-f79831b5ee12" containerID="c869b31b7fe3e867d6b32e1434af09294678571b44d478c1c45379caef26fd1f" exitCode=0
Jul 21 21:00:02.190321 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:02.190257    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-2ba36e-29744460-6cg8f" event={"ID":"6a5460b5-f592-4430-9d56-f79831b5ee12","Type":"ContainerDied","Data":"c869b31b7fe3e867d6b32e1434af09294678571b44d478c1c45379caef26fd1f"}
Jul 21 21:00:02.265383 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:02.265354    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:02.279971 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:02.279629    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-868c4ca9-29744460-qs5n8" podStartSLOduration=2.279604489 podStartE2EDuration="2.279604489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:00:02.258840322 +0000 UTC m=+2753.191238480" watchObservedRunningTime="2026-07-21 21:00:02.279604489 +0000 UTC m=+2753.212002647"
Jul 21 21:00:02.345208 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:02.345171    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:02.556660 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:02.556616    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"]
Jul 21 21:00:02.556912 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:02.556881    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm" podUID="84b8f5c3-b015-41a3-a187-2f62b2be3b8c" containerName="istio-proxy" containerID="cri-o://2958d23c83299bec3674fedd1c8ebafbcbd3b21e841e5b74f48cfcdb703a18f9" gracePeriod=30
Jul 21 21:00:02.573250 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:02.573225    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:03.198767 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.198723    2576 generic.go:356] "Generic (PLEG): container finished" podID="027a86eb-2934-4cc6-b95c-f28581009e35" containerID="8186533cd2332010cbfebd81aefb72849dedb89557ff1f8ed217616650ec25bd" exitCode=0
Jul 21 21:00:03.199218 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.198764    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-868c4ca9-29744460-qs5n8" event={"ID":"027a86eb-2934-4cc6-b95c-f28581009e35","Type":"ContainerDied","Data":"8186533cd2332010cbfebd81aefb72849dedb89557ff1f8ed217616650ec25bd"}
Jul 21 21:00:03.218293 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.218260    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:03.352498 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.352468    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:03.368139 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.368108    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-672ca14c-29744460-r4vjg"
Jul 21 21:00:03.439977 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.437870    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e7adb3ea-29744460-rlbrh"
Jul 21 21:00:03.475479 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.475453    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744460-94gfb"
Jul 21 21:00:03.479261 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.479235    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-2ba36e-29744460-6cg8f"
Jul 21 21:00:03.483458 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.483408    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-351a5d-29744460-5xk5x"
Jul 21 21:00:03.489236 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.489213    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-83e6600b-29744460-k9kmt"
Jul 21 21:00:03.561458 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.561420    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"]
Jul 21 21:00:03.562104 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.562083    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="620a3ff8-d7d5-44ea-a370-36ff4c351f83" containerName="cleanup"
Jul 21 21:00:03.562188 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.562108    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="620a3ff8-d7d5-44ea-a370-36ff4c351f83" containerName="cleanup"
Jul 21 21:00:03.562188 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.562132    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a5460b5-f592-4430-9d56-f79831b5ee12" containerName="cleanup"
Jul 21 21:00:03.562188 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.562141    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a5460b5-f592-4430-9d56-f79831b5ee12" containerName="cleanup"
Jul 21 21:00:03.562188 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.562161    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f43f9cc0-8148-4c3d-b39f-695a01dda87d" containerName="istio-proxy"
Jul 21 21:00:03.562188 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.562170    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f43f9cc0-8148-4c3d-b39f-695a01dda87d" containerName="istio-proxy"
Jul 21 21:00:03.562460 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.562192    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c71f251d-a850-4878-a050-5020c0089861" containerName="cleanup"
Jul 21 21:00:03.562460 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.562200    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c71f251d-a850-4878-a050-5020c0089861" containerName="cleanup"
Jul 21 21:00:03.562460 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.562210    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d79ac56b-6fbe-403e-bc3c-3788809c114f" containerName="cleanup"
Jul 21 21:00:03.562460 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.562218    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d79ac56b-6fbe-403e-bc3c-3788809c114f" containerName="cleanup"
Jul 21 21:00:03.562460 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.562235    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f299eae-f722-47be-98d2-436512624278" containerName="cleanup"
Jul 21 21:00:03.562460 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.562244    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f299eae-f722-47be-98d2-436512624278" containerName="cleanup"
Jul 21 21:00:03.562460 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.562255    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b54b7992-9f8b-4c35-a4fa-59f6be2a9d6b" containerName="cleanup"
Jul 21 21:00:03.562460 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.562264    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b54b7992-9f8b-4c35-a4fa-59f6be2a9d6b" containerName="cleanup"
Jul 21 21:00:03.562460 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.562362    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c71f251d-a850-4878-a050-5020c0089861" containerName="cleanup"
Jul 21 21:00:03.562460 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.562375    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d79ac56b-6fbe-403e-bc3c-3788809c114f" containerName="cleanup"
Jul 21 21:00:03.562460 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.562384    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f43f9cc0-8148-4c3d-b39f-695a01dda87d" containerName="istio-proxy"
Jul 21 21:00:03.562460 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.562395    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="620a3ff8-d7d5-44ea-a370-36ff4c351f83" containerName="cleanup"
Jul 21 21:00:03.562460 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.562405    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f43f9cc0-8148-4c3d-b39f-695a01dda87d" containerName="istio-proxy"
Jul 21 21:00:03.562460 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.562415    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b54b7992-9f8b-4c35-a4fa-59f6be2a9d6b" containerName="cleanup"
Jul 21 21:00:03.562460 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.562424    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f299eae-f722-47be-98d2-436512624278" containerName="cleanup"
Jul 21 21:00:03.562460 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.562435    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a5460b5-f592-4430-9d56-f79831b5ee12" containerName="cleanup"
Jul 21 21:00:03.566016 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.565996    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:03.572029 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.572003    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-04e869-openshift-default-dockercfg-8d88m\""
Jul 21 21:00:03.592343 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.592307    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"]
Jul 21 21:00:03.635893 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.635857    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istio-data\") pod \"e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") " pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:03.636079 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.635923    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istio-token\") pod \"e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") " pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:03.636079 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.635966    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istiod-ca-cert\") pod \"e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") " pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:03.636079 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.635996    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-workload-certs\") pod \"e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") " pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:03.636202 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.636087    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-workload-socket\") pod \"e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") " pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:03.636202 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.636124    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-credential-socket\") pod \"e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") " pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:03.636202 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.636158    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istio-envoy\") pod \"e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") " pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:03.636202 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.636200    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2b9m\" (UniqueName: \"kubernetes.io/projected/b0e0de7b-615a-4f4d-9b89-e3da502dd773-kube-api-access-m2b9m\") pod \"e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") " pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:03.636336 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.636233    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istio-podinfo\") pod \"e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") " pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:03.643255 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.643218    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:03.737619 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.737521    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istio-data\") pod \"e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") " pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:03.737619 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.737560    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istio-token\") pod \"e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") " pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:03.737619 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.737593    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istiod-ca-cert\") pod \"e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") " pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:03.737886 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.737626    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-workload-certs\") pod \"e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") " pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:03.737886 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.737708    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-workload-socket\") pod \"e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") " pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:03.737886 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.737751    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-credential-socket\") pod \"e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") " pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:03.737886 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.737794    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istio-envoy\") pod \"e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") " pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:03.737886 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.737832    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2b9m\" (UniqueName: \"kubernetes.io/projected/b0e0de7b-615a-4f4d-9b89-e3da502dd773-kube-api-access-m2b9m\") pod \"e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") " pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:03.737886 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.737886    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istio-podinfo\") pod \"e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") " pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:03.738218 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.738040    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istio-data\") pod \"e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") " pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:03.738275 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.738238    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-workload-socket\") pod \"e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") " pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:03.738757 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.738532    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-workload-certs\") pod \"e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") " pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:03.738757 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.738707    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istiod-ca-cert\") pod \"e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") " pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:03.738948 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.738920    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-credential-socket\") pod \"e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") " pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:03.740518 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.740485    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istio-podinfo\") pod \"e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") " pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:03.740809 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.740790    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istio-envoy\") pod \"e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") " pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:03.751040 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.751010    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2b9m\" (UniqueName: \"kubernetes.io/projected/b0e0de7b-615a-4f4d-9b89-e3da502dd773-kube-api-access-m2b9m\") pod \"e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") " pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:03.751332 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.751014    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istio-token\") pod \"e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") " pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:03.865022 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.864987    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:03.876961 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:03.876936    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:04.028874 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:04.028835    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"]
Jul 21 21:00:04.029269 ip-10-0-128-201 kubenswrapper[2576]: W0721 21:00:04.029233    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0e0de7b_615a_4f4d_9b89_e3da502dd773.slice/crio-d60cac2118022ba99af38ea0b48ab07845381b33d1c66056e6c203f17db95f8c WatchSource:0}: Error finding container d60cac2118022ba99af38ea0b48ab07845381b33d1c66056e6c203f17db95f8c: Status 404 returned error can't find the container with id d60cac2118022ba99af38ea0b48ab07845381b33d1c66056e6c203f17db95f8c
Jul 21 21:00:04.031441 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:04.031408    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:00:04.031518 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:04.031477    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:00:04.031558 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:04.031524    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:00:04.208230 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:04.208200    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-83e6600b-29744460-k9kmt"
Jul 21 21:00:04.208727 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:04.208199    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-83e6600b-29744460-k9kmt" event={"ID":"b54b7992-9f8b-4c35-a4fa-59f6be2a9d6b","Type":"ContainerDied","Data":"4cc9ae6cc8edc2e4c4d5d7f74994381d254f788f27905f86c09e850a9c2801a2"}
Jul 21 21:00:04.208727 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:04.208328    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4cc9ae6cc8edc2e4c4d5d7f74994381d254f788f27905f86c09e850a9c2801a2"
Jul 21 21:00:04.209881 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:04.209858    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-672ca14c-29744460-r4vjg"
Jul 21 21:00:04.210030 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:04.209896    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-672ca14c-29744460-r4vjg" event={"ID":"620a3ff8-d7d5-44ea-a370-36ff4c351f83","Type":"ContainerDied","Data":"b8fceb32661216980c833117180530ffb2ed21916038f84ee171174982e4021c"}
Jul 21 21:00:04.210030 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:04.209942    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b8fceb32661216980c833117180530ffb2ed21916038f84ee171174982e4021c"
Jul 21 21:00:04.211481 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:04.211450    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-351a5d-29744460-5xk5x"
Jul 21 21:00:04.211481 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:04.211467    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-351a5d-29744460-5xk5x" event={"ID":"d79ac56b-6fbe-403e-bc3c-3788809c114f","Type":"ContainerDied","Data":"c4d9db3777acbaef83122cfdb108137f9c04da28ab8ff1ec3766d321a682bd81"}
Jul 21 21:00:04.211671 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:04.211510    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4d9db3777acbaef83122cfdb108137f9c04da28ab8ff1ec3766d321a682bd81"
Jul 21 21:00:04.213444 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:04.213418    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf" event={"ID":"b0e0de7b-615a-4f4d-9b89-e3da502dd773","Type":"ContainerStarted","Data":"cee651e8daeaa223d92b343b71f49b31ad5a07c74fa7923def8814fa73efd8f2"}
Jul 21 21:00:04.213567 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:04.213470    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf" event={"ID":"b0e0de7b-615a-4f4d-9b89-e3da502dd773","Type":"ContainerStarted","Data":"d60cac2118022ba99af38ea0b48ab07845381b33d1c66056e6c203f17db95f8c"}
Jul 21 21:00:04.215020 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:04.215004    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744460-94gfb"
Jul 21 21:00:04.215020 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:04.215010    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744460-94gfb" event={"ID":"9f299eae-f722-47be-98d2-436512624278","Type":"ContainerDied","Data":"22282e814bb5afae58bae7427cb9886c3c9d52cfc2e82d1db00b41832b466f25"}
Jul 21 21:00:04.215159 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:04.215044    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="22282e814bb5afae58bae7427cb9886c3c9d52cfc2e82d1db00b41832b466f25"
Jul 21 21:00:04.216595 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:04.216480    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-2ba36e-29744460-6cg8f"
Jul 21 21:00:04.216595 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:04.216523    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-2ba36e-29744460-6cg8f" event={"ID":"6a5460b5-f592-4430-9d56-f79831b5ee12","Type":"ContainerDied","Data":"e3eab6ec2e55d5d8fa2263adaa6f4b703a75ad8bc92f84b645f697d2f5083117"}
Jul 21 21:00:04.216595 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:04.216562    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3eab6ec2e55d5d8fa2263adaa6f4b703a75ad8bc92f84b645f697d2f5083117"
Jul 21 21:00:04.218252 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:04.218224    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e7adb3ea-29744460-rlbrh"
Jul 21 21:00:04.218353 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:04.218257    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e7adb3ea-29744460-rlbrh" event={"ID":"c71f251d-a850-4878-a050-5020c0089861","Type":"ContainerDied","Data":"2e45c5b1c8cb2b70fd8f3a1bd2f353d167107258a6c568c3123e8c197a891d39"}
Jul 21 21:00:04.218855 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:04.218841    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e45c5b1c8cb2b70fd8f3a1bd2f353d167107258a6c568c3123e8c197a891d39"
Jul 21 21:00:04.249307 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:04.249108    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf" podStartSLOduration=1.249086124 podStartE2EDuration="1.249086124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:00:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:00:04.246770107 +0000 UTC m=+2755.179168264" watchObservedRunningTime="2026-07-21 21:00:04.249086124 +0000 UTC m=+2755.181484282"
Jul 21 21:00:04.385945 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:04.385919    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-868c4ca9-29744460-qs5n8"
Jul 21 21:00:04.877965 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:04.877914    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:05.219985 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:05.219874    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:05.228891 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:05.228841    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-868c4ca9-29744460-qs5n8"
Jul 21 21:00:05.228891 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:05.228857    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-868c4ca9-29744460-qs5n8" event={"ID":"027a86eb-2934-4cc6-b95c-f28581009e35","Type":"ContainerDied","Data":"cdb016366017eab0823134a27f6f0e8c8c0e8f2aa240e524e1e18d4a72ca043b"}
Jul 21 21:00:05.229090 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:05.228952    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cdb016366017eab0823134a27f6f0e8c8c0e8f2aa240e524e1e18d4a72ca043b"
Jul 21 21:00:05.334080 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:05.334046    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:05.476250 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:05.476161    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-04e869-664f988c5-z7h9k"]
Jul 21 21:00:05.476575 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:05.476563    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f43f9cc0-8148-4c3d-b39f-695a01dda87d" containerName="istio-proxy"
Jul 21 21:00:05.476614 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:05.476577    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f43f9cc0-8148-4c3d-b39f-695a01dda87d" containerName="istio-proxy"
Jul 21 21:00:05.476614 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:05.476600    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="027a86eb-2934-4cc6-b95c-f28581009e35" containerName="cleanup"
Jul 21 21:00:05.476614 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:05.476605    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="027a86eb-2934-4cc6-b95c-f28581009e35" containerName="cleanup"
Jul 21 21:00:05.476741 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:05.476672    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="027a86eb-2934-4cc6-b95c-f28581009e35" containerName="cleanup"
Jul 21 21:00:05.479969 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:05.479951    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04e869-664f988c5-z7h9k"
Jul 21 21:00:05.484524 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:05.484497    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-zjkdf\""
Jul 21 21:00:05.484775 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:05.484758    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 21:00:05.484892 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:05.484819    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-04e869-serving-cert\""
Jul 21 21:00:05.485259 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:05.485244    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 21:00:05.496744 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:05.496717    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-04e869-664f988c5-z7h9k"]
Jul 21 21:00:05.546868 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:05.546831    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:05.556518 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:05.556487    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdac95cb-fd78-4201-a51a-0ca323b2c87f-maas-api-tls\") pod \"maas-api-e2e-api-a-04e869-664f988c5-z7h9k\" (UID: \"bdac95cb-fd78-4201-a51a-0ca323b2c87f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04e869-664f988c5-z7h9k"
Jul 21 21:00:05.556672 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:05.556549    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs5n2\" (UniqueName: \"kubernetes.io/projected/bdac95cb-fd78-4201-a51a-0ca323b2c87f-kube-api-access-zs5n2\") pod \"maas-api-e2e-api-a-04e869-664f988c5-z7h9k\" (UID: \"bdac95cb-fd78-4201-a51a-0ca323b2c87f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04e869-664f988c5-z7h9k"
Jul 21 21:00:05.556762 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:05.556675    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdac95cb-fd78-4201-a51a-0ca323b2c87f-openshift-service-ca\") pod \"maas-api-e2e-api-a-04e869-664f988c5-z7h9k\" (UID: \"bdac95cb-fd78-4201-a51a-0ca323b2c87f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04e869-664f988c5-z7h9k"
Jul 21 21:00:05.658130 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:05.658093    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdac95cb-fd78-4201-a51a-0ca323b2c87f-openshift-service-ca\") pod \"maas-api-e2e-api-a-04e869-664f988c5-z7h9k\" (UID: \"bdac95cb-fd78-4201-a51a-0ca323b2c87f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04e869-664f988c5-z7h9k"
Jul 21 21:00:05.658300 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:05.658165    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdac95cb-fd78-4201-a51a-0ca323b2c87f-maas-api-tls\") pod \"maas-api-e2e-api-a-04e869-664f988c5-z7h9k\" (UID: \"bdac95cb-fd78-4201-a51a-0ca323b2c87f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04e869-664f988c5-z7h9k"
Jul 21 21:00:05.658300 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:05.658215    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs5n2\" (UniqueName: \"kubernetes.io/projected/bdac95cb-fd78-4201-a51a-0ca323b2c87f-kube-api-access-zs5n2\") pod \"maas-api-e2e-api-a-04e869-664f988c5-z7h9k\" (UID: \"bdac95cb-fd78-4201-a51a-0ca323b2c87f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04e869-664f988c5-z7h9k"
Jul 21 21:00:05.658379 ip-10-0-128-201 kubenswrapper[2576]: E0721 21:00:05.658299    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-04e869-serving-cert: secret "maas-api-e2e-api-a-04e869-serving-cert" not found
Jul 21 21:00:05.658379 ip-10-0-128-201 kubenswrapper[2576]: E0721 21:00:05.658367    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdac95cb-fd78-4201-a51a-0ca323b2c87f-maas-api-tls podName:bdac95cb-fd78-4201-a51a-0ca323b2c87f nodeName:}" failed. No retries permitted until 2026-07-21 21:00:06.158349901 +0000 UTC m=+2757.090748036 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bdac95cb-fd78-4201-a51a-0ca323b2c87f-maas-api-tls") pod "maas-api-e2e-api-a-04e869-664f988c5-z7h9k" (UID: "bdac95cb-fd78-4201-a51a-0ca323b2c87f") : secret "maas-api-e2e-api-a-04e869-serving-cert" not found
Jul 21 21:00:05.658746 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:05.658728    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdac95cb-fd78-4201-a51a-0ca323b2c87f-openshift-service-ca\") pod \"maas-api-e2e-api-a-04e869-664f988c5-z7h9k\" (UID: \"bdac95cb-fd78-4201-a51a-0ca323b2c87f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04e869-664f988c5-z7h9k"
Jul 21 21:00:05.677786 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:05.677751    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs5n2\" (UniqueName: \"kubernetes.io/projected/bdac95cb-fd78-4201-a51a-0ca323b2c87f-kube-api-access-zs5n2\") pod \"maas-api-e2e-api-a-04e869-664f988c5-z7h9k\" (UID: \"bdac95cb-fd78-4201-a51a-0ca323b2c87f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04e869-664f988c5-z7h9k"
Jul 21 21:00:05.829514 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:05.829481    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:05.882830 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:05.882802    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:06.163458 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:06.163370    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdac95cb-fd78-4201-a51a-0ca323b2c87f-maas-api-tls\") pod \"maas-api-e2e-api-a-04e869-664f988c5-z7h9k\" (UID: \"bdac95cb-fd78-4201-a51a-0ca323b2c87f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04e869-664f988c5-z7h9k"
Jul 21 21:00:06.166000 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:06.165977    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdac95cb-fd78-4201-a51a-0ca323b2c87f-maas-api-tls\") pod \"maas-api-e2e-api-a-04e869-664f988c5-z7h9k\" (UID: \"bdac95cb-fd78-4201-a51a-0ca323b2c87f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04e869-664f988c5-z7h9k"
Jul 21 21:00:06.201831 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:06.201801    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:06.237019 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:06.236988    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:06.238002 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:06.237980    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:06.307255 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:06.307221    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:06.390821 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:06.390782    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04e869-664f988c5-z7h9k"
Jul 21 21:00:06.561261 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:06.561231    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-04e869-664f988c5-z7h9k"]
Jul 21 21:00:06.562323 ip-10-0-128-201 kubenswrapper[2576]: W0721 21:00:06.562299    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdac95cb_fd78_4201_a51a_0ca323b2c87f.slice/crio-c4d9ba72d9d312442df343e78e53dbfa6df83cff1b1f43d2773859f83eb90c29 WatchSource:0}: Error finding container c4d9ba72d9d312442df343e78e53dbfa6df83cff1b1f43d2773859f83eb90c29: Status 404 returned error can't find the container with id c4d9ba72d9d312442df343e78e53dbfa6df83cff1b1f43d2773859f83eb90c29
Jul 21 21:00:06.563715 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:06.563683    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 21:00:07.243762 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.243724    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04e869-664f988c5-z7h9k" event={"ID":"bdac95cb-fd78-4201-a51a-0ca323b2c87f","Type":"ContainerStarted","Data":"c4d9ba72d9d312442df343e78e53dbfa6df83cff1b1f43d2773859f83eb90c29"}
Jul 21 21:00:07.826757 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.826672    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 21:00:07.881185 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.881147    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hn7nf\" (UniqueName: \"kubernetes.io/projected/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-kube-api-access-hn7nf\") pod \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") "
Jul 21 21:00:07.881185 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.881204    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-workload-socket\") pod \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") "
Jul 21 21:00:07.881453 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.881268    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istiod-ca-cert\") pod \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") "
Jul 21 21:00:07.881453 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.881299    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-workload-certs\") pod \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") "
Jul 21 21:00:07.881453 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.881376    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istio-podinfo\") pod \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") "
Jul 21 21:00:07.881453 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.881410    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istio-data\") pod \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") "
Jul 21 21:00:07.881453 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.881445    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-credential-socket\") pod \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") "
Jul 21 21:00:07.881722 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.881475    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istio-envoy\") pod \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") "
Jul 21 21:00:07.881722 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.881494    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "84b8f5c3-b015-41a3-a187-2f62b2be3b8c" (UID: "84b8f5c3-b015-41a3-a187-2f62b2be3b8c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:00:07.881722 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.881538    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istio-token\") pod \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\" (UID: \"84b8f5c3-b015-41a3-a187-2f62b2be3b8c\") "
Jul 21 21:00:07.881722 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.881627    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "84b8f5c3-b015-41a3-a187-2f62b2be3b8c" (UID: "84b8f5c3-b015-41a3-a187-2f62b2be3b8c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:00:07.881912 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.881735    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "84b8f5c3-b015-41a3-a187-2f62b2be3b8c" (UID: "84b8f5c3-b015-41a3-a187-2f62b2be3b8c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:00:07.881912 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.881778    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "84b8f5c3-b015-41a3-a187-2f62b2be3b8c" (UID: "84b8f5c3-b015-41a3-a187-2f62b2be3b8c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 21:00:07.882025 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.881933    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istiod-ca-cert\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:07.882025 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.881956    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-workload-certs\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:07.882025 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.881970    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-credential-socket\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:07.882025 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.881984    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-workload-socket\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:07.882304 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.882280    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istio-data" (OuterVolumeSpecName: "istio-data") pod "84b8f5c3-b015-41a3-a187-2f62b2be3b8c" (UID: "84b8f5c3-b015-41a3-a187-2f62b2be3b8c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:00:07.883623 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.883592    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istio-token" (OuterVolumeSpecName: "istio-token") pod "84b8f5c3-b015-41a3-a187-2f62b2be3b8c" (UID: "84b8f5c3-b015-41a3-a187-2f62b2be3b8c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:00:07.883975 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.883947    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-kube-api-access-hn7nf" (OuterVolumeSpecName: "kube-api-access-hn7nf") pod "84b8f5c3-b015-41a3-a187-2f62b2be3b8c" (UID: "84b8f5c3-b015-41a3-a187-2f62b2be3b8c"). InnerVolumeSpecName "kube-api-access-hn7nf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:00:07.884085 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.883977    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "84b8f5c3-b015-41a3-a187-2f62b2be3b8c" (UID: "84b8f5c3-b015-41a3-a187-2f62b2be3b8c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 21:00:07.884085 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.883991    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "84b8f5c3-b015-41a3-a187-2f62b2be3b8c" (UID: "84b8f5c3-b015-41a3-a187-2f62b2be3b8c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:00:07.982723 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.982677    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istio-podinfo\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:07.982723 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.982724    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istio-data\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:07.982953 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.982740    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istio-envoy\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:07.982953 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.982755    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-istio-token\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:07.982953 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:07.982768    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hn7nf\" (UniqueName: \"kubernetes.io/projected/84b8f5c3-b015-41a3-a187-2f62b2be3b8c-kube-api-access-hn7nf\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:08.254868 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:08.254772    2576 generic.go:356] "Generic (PLEG): container finished" podID="84b8f5c3-b015-41a3-a187-2f62b2be3b8c" containerID="2958d23c83299bec3674fedd1c8ebafbcbd3b21e841e5b74f48cfcdb703a18f9" exitCode=0
Jul 21 21:00:08.254868 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:08.254850    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"
Jul 21 21:00:08.255379 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:08.254856    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm" event={"ID":"84b8f5c3-b015-41a3-a187-2f62b2be3b8c","Type":"ContainerDied","Data":"2958d23c83299bec3674fedd1c8ebafbcbd3b21e841e5b74f48cfcdb703a18f9"}
Jul 21 21:00:08.255379 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:08.254983    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm" event={"ID":"84b8f5c3-b015-41a3-a187-2f62b2be3b8c","Type":"ContainerDied","Data":"3f08c9fbba78580ed031d20af34bc3dcd0378adb9cd09468e08707b41eea47b5"}
Jul 21 21:00:08.255379 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:08.255031    2576 scope.go:117] "RemoveContainer" containerID="2958d23c83299bec3674fedd1c8ebafbcbd3b21e841e5b74f48cfcdb703a18f9"
Jul 21 21:00:08.269106 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:08.269082    2576 scope.go:117] "RemoveContainer" containerID="cc0510dc71b9fa9c439be566c73bce839bf714418bda1747fedc4807ec129958"
Jul 21 21:00:08.280394 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:08.280369    2576 scope.go:117] "RemoveContainer" containerID="2958d23c83299bec3674fedd1c8ebafbcbd3b21e841e5b74f48cfcdb703a18f9"
Jul 21 21:00:08.280769 ip-10-0-128-201 kubenswrapper[2576]: E0721 21:00:08.280733    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2958d23c83299bec3674fedd1c8ebafbcbd3b21e841e5b74f48cfcdb703a18f9\": container with ID starting with 2958d23c83299bec3674fedd1c8ebafbcbd3b21e841e5b74f48cfcdb703a18f9 not found: ID does not exist" containerID="2958d23c83299bec3674fedd1c8ebafbcbd3b21e841e5b74f48cfcdb703a18f9"
Jul 21 21:00:08.280887 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:08.280777    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2958d23c83299bec3674fedd1c8ebafbcbd3b21e841e5b74f48cfcdb703a18f9"} err="failed to get container status \"2958d23c83299bec3674fedd1c8ebafbcbd3b21e841e5b74f48cfcdb703a18f9\": rpc error: code = NotFound desc = could not find container \"2958d23c83299bec3674fedd1c8ebafbcbd3b21e841e5b74f48cfcdb703a18f9\": container with ID starting with 2958d23c83299bec3674fedd1c8ebafbcbd3b21e841e5b74f48cfcdb703a18f9 not found: ID does not exist"
Jul 21 21:00:08.280887 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:08.280803    2576 scope.go:117] "RemoveContainer" containerID="cc0510dc71b9fa9c439be566c73bce839bf714418bda1747fedc4807ec129958"
Jul 21 21:00:08.281306 ip-10-0-128-201 kubenswrapper[2576]: E0721 21:00:08.281273    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc0510dc71b9fa9c439be566c73bce839bf714418bda1747fedc4807ec129958\": container with ID starting with cc0510dc71b9fa9c439be566c73bce839bf714418bda1747fedc4807ec129958 not found: ID does not exist" containerID="cc0510dc71b9fa9c439be566c73bce839bf714418bda1747fedc4807ec129958"
Jul 21 21:00:08.281413 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:08.281308    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc0510dc71b9fa9c439be566c73bce839bf714418bda1747fedc4807ec129958"} err="failed to get container status \"cc0510dc71b9fa9c439be566c73bce839bf714418bda1747fedc4807ec129958\": rpc error: code = NotFound desc = could not find container \"cc0510dc71b9fa9c439be566c73bce839bf714418bda1747fedc4807ec129958\": container with ID starting with cc0510dc71b9fa9c439be566c73bce839bf714418bda1747fedc4807ec129958 not found: ID does not exist"
Jul 21 21:00:08.289140 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:08.289111    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"]
Jul 21 21:00:08.292184 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:08.292159    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-351a5d-openshift-default-6df74576cc-rbppm"]
Jul 21 21:00:09.653870 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:09.653830    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84b8f5c3-b015-41a3-a187-2f62b2be3b8c" path="/var/lib/kubelet/pods/84b8f5c3-b015-41a3-a187-2f62b2be3b8c/volumes"
Jul 21 21:00:10.271545 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:10.271505    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04e869-664f988c5-z7h9k" event={"ID":"bdac95cb-fd78-4201-a51a-0ca323b2c87f","Type":"ContainerStarted","Data":"88e435c3325bef22e08f8c2c7d37e50d2ef348f47ade51023628a8470b824c52"}
Jul 21 21:00:10.271766 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:10.271609    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04e869-664f988c5-z7h9k"
Jul 21 21:00:10.305916 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:10.305863    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04e869-664f988c5-z7h9k" podStartSLOduration=2.12533794 podStartE2EDuration="5.305847213s" totalImagesPullingTime="3.180509273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:00:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:00:10.301843344 +0000 UTC m=+2761.234241500" watchObservedRunningTime="2026-07-21 21:00:10.305847213 +0000 UTC m=+2761.238245370"
Jul 21 21:00:10.767748 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:10.767719    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:11.171134 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.171048    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:11.485258 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.485177    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"]
Jul 21 21:00:11.485596 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.485584    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84b8f5c3-b015-41a3-a187-2f62b2be3b8c" containerName="istio-proxy"
Jul 21 21:00:11.485644 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.485598    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="84b8f5c3-b015-41a3-a187-2f62b2be3b8c" containerName="istio-proxy"
Jul 21 21:00:11.485644 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.485608    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84b8f5c3-b015-41a3-a187-2f62b2be3b8c" containerName="istio-proxy"
Jul 21 21:00:11.485644 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.485614    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="84b8f5c3-b015-41a3-a187-2f62b2be3b8c" containerName="istio-proxy"
Jul 21 21:00:11.485770 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.485684    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="84b8f5c3-b015-41a3-a187-2f62b2be3b8c" containerName="istio-proxy"
Jul 21 21:00:11.485770 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.485724    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="84b8f5c3-b015-41a3-a187-2f62b2be3b8c" containerName="istio-proxy"
Jul 21 21:00:11.490255 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.490229    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.496554 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.496534    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-280285-openshift-default-dockercfg-ks6hv\""
Jul 21 21:00:11.511070 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.511037    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"]
Jul 21 21:00:11.551506 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.551478    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:11.618138 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.618094    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istio-envoy\") pod \"e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") " pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.618350 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.618150    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istiod-ca-cert\") pod \"e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") " pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.618350 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.618186    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-workload-certs\") pod \"e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") " pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.618350 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.618286    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istio-token\") pod \"e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") " pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.618350 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.618317    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-workload-socket\") pod \"e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") " pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.618350 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.618344    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istio-podinfo\") pod \"e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") " pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.618529 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.618414    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istio-data\") pod \"e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") " pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.618529 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.618471    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-credential-socket\") pod \"e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") " pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.618529 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.618525    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjm9g\" (UniqueName: \"kubernetes.io/projected/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-kube-api-access-vjm9g\") pod \"e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") " pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.719066 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.719030    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istio-token\") pod \"e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") " pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.719243 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.719074    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-workload-socket\") pod \"e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") " pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.719243 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.719103    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istio-podinfo\") pod \"e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") " pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.719243 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.719132    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istio-data\") pod \"e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") " pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.719243 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.719170    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-credential-socket\") pod \"e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") " pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.719243 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.719233    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjm9g\" (UniqueName: \"kubernetes.io/projected/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-kube-api-access-vjm9g\") pod \"e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") " pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.719517 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.719271    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istio-envoy\") pod \"e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") " pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.719517 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.719317    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istiod-ca-cert\") pod \"e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") " pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.719517 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.719345    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-workload-certs\") pod \"e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") " pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.719517 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.719510    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-workload-socket\") pod \"e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") " pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.719781 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.719586    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istio-data\") pod \"e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") " pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.719781 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.719674    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-workload-certs\") pod \"e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") " pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.719781 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.719722    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-credential-socket\") pod \"e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") " pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.720138 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.720114    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istiod-ca-cert\") pod \"e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") " pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.722223 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.722196    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istio-envoy\") pod \"e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") " pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.722681 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.722661    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istio-podinfo\") pod \"e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") " pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.729029 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.729001    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istio-token\") pod \"e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") " pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.729634 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.729617    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjm9g\" (UniqueName: \"kubernetes.io/projected/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-kube-api-access-vjm9g\") pod \"e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") " pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.749554 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.749468    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:11.800658 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.800614    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:11.960734 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.958960    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"]
Jul 21 21:00:11.966614 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.966563    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:00:11.966796 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.966658    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:00:11.966796 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:11.966727    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:00:12.285414 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:12.285369    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8" event={"ID":"0cc99e82-9c30-451f-9e6b-85719cb2d0f1","Type":"ContainerStarted","Data":"c21e6e9c5c69cc561c8ae05e0eb26fe7b7340ae0b2bbcf89aae78296c5b00dfa"}
Jul 21 21:00:12.285594 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:12.285432    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8" event={"ID":"0cc99e82-9c30-451f-9e6b-85719cb2d0f1","Type":"ContainerStarted","Data":"283c5d140184592b0cf6f00cc7ab430b643109c0d4999059dd803c55d2d27635"}
Jul 21 21:00:12.316387 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:12.316334    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8" podStartSLOduration=1.316317541 podStartE2EDuration="1.316317541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:00:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:00:12.313980695 +0000 UTC m=+2763.246378852" watchObservedRunningTime="2026-07-21 21:00:12.316317541 +0000 UTC m=+2763.248715698"
Jul 21 21:00:12.801097 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:12.801060    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:13.230275 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:13.230197    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:13.339149 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:13.339118    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:13.432221 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:13.432187    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:13.537644 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:13.537615    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:13.807335 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:13.807253    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:14.071785 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:14.071672    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:14.186489 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:14.186454    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:14.296856 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:14.296822    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:14.297802 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:14.297783    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:14.970596 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:14.970561    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:16.283401 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:16.283375    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04e869-664f988c5-z7h9k"
Jul 21 21:00:18.747437 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:18.747393    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:21.870421 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:21.868914    2576 patch_prober.go:28] interesting pod/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": read tcp 10.133.0.2:33390->10.133.0.65:15021: read: connection reset by peer" start-of-body=
Jul 21 21:00:21.870421 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:21.868993    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf" podUID="b0e0de7b-615a-4f4d-9b89-e3da502dd773" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": read tcp 10.133.0.2:33390->10.133.0.65:15021: read: connection reset by peer"
Jul 21 21:00:22.352966 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:22.352933    2576 generic.go:356] "Generic (PLEG): container finished" podID="b0e0de7b-615a-4f4d-9b89-e3da502dd773" containerID="cee651e8daeaa223d92b343b71f49b31ad5a07c74fa7923def8814fa73efd8f2" exitCode=0
Jul 21 21:00:22.353239 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:22.353004    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf" event={"ID":"b0e0de7b-615a-4f4d-9b89-e3da502dd773","Type":"ContainerDied","Data":"cee651e8daeaa223d92b343b71f49b31ad5a07c74fa7923def8814fa73efd8f2"}
Jul 21 21:00:22.353439 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:22.353425    2576 scope.go:117] "RemoveContainer" containerID="cee651e8daeaa223d92b343b71f49b31ad5a07c74fa7923def8814fa73efd8f2"
Jul 21 21:00:22.354456 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:22.354424    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:00:22.354544 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:22.354527    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:00:22.354587 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:22.354569    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:00:23.360990 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:23.360954    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf" event={"ID":"b0e0de7b-615a-4f4d-9b89-e3da502dd773","Type":"ContainerStarted","Data":"10dc4f0be4ec8c2d7aaced294fe7a7c670043f5f041eef6497a237a18e3df4c0"}
Jul 21 21:00:23.877954 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:23.877911    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:23.878176 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:23.878153    2576 patch_prober.go:28] interesting pod/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 21 21:00:23.878240 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:23.878222    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf" podUID="b0e0de7b-615a-4f4d-9b89-e3da502dd773" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 21 21:00:24.877577 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:24.877541    2576 patch_prober.go:28] interesting pod/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 21 21:00:24.878109 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:24.877605    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf" podUID="b0e0de7b-615a-4f4d-9b89-e3da502dd773" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 21 21:00:25.877898 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:25.877856    2576 patch_prober.go:28] interesting pod/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 21 21:00:25.878501 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:25.877924    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf" podUID="b0e0de7b-615a-4f4d-9b89-e3da502dd773" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 21 21:00:26.734452 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:26.734407    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:26.877977 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:26.877943    2576 patch_prober.go:28] interesting pod/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 21 21:00:26.878426 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:26.878402    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf" podUID="b0e0de7b-615a-4f4d-9b89-e3da502dd773" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 21 21:00:27.142910 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:27.142866    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:27.881141 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:27.881110    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:27.881560 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:27.881436    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:27.882177 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:27.882157    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:33.418662 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:33.418626    2576 generic.go:356] "Generic (PLEG): container finished" podID="0cc99e82-9c30-451f-9e6b-85719cb2d0f1" containerID="c21e6e9c5c69cc561c8ae05e0eb26fe7b7340ae0b2bbcf89aae78296c5b00dfa" exitCode=0
Jul 21 21:00:33.419165 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:33.418673    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8" event={"ID":"0cc99e82-9c30-451f-9e6b-85719cb2d0f1","Type":"ContainerDied","Data":"c21e6e9c5c69cc561c8ae05e0eb26fe7b7340ae0b2bbcf89aae78296c5b00dfa"}
Jul 21 21:00:33.419208 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:33.419189    2576 scope.go:117] "RemoveContainer" containerID="c21e6e9c5c69cc561c8ae05e0eb26fe7b7340ae0b2bbcf89aae78296c5b00dfa"
Jul 21 21:00:33.420370 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:33.420340    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:00:33.420446 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:33.420417    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:00:33.420563 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:33.420451    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:00:33.939741 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:33.939684    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:34.430999 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:34.430956    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8" event={"ID":"0cc99e82-9c30-451f-9e6b-85719cb2d0f1","Type":"ContainerStarted","Data":"0666feff6845a7330163fd402ff5ced2a99ee76fd7e5a6862e350524ec548f17"}
Jul 21 21:00:34.801098 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:34.801061    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:34.801304 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:34.801281    2576 patch_prober.go:28] interesting pod/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 21 21:00:34.801357 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:34.801340    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8" podUID="0cc99e82-9c30-451f-9e6b-85719cb2d0f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 21 21:00:35.801148 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:35.801109    2576 patch_prober.go:28] interesting pod/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 21 21:00:35.801564 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:35.801172    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8" podUID="0cc99e82-9c30-451f-9e6b-85719cb2d0f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 21 21:00:36.801775 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:36.801734    2576 patch_prober.go:28] interesting pod/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 21 21:00:36.802171 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:36.801804    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8" podUID="0cc99e82-9c30-451f-9e6b-85719cb2d0f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 21 21:00:37.801280 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:37.801244    2576 patch_prober.go:28] interesting pod/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 21 21:00:37.801476 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:37.801317    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8" podUID="0cc99e82-9c30-451f-9e6b-85719cb2d0f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 21 21:00:38.806164 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:38.806134    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:38.806577 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:38.806547    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:38.807350 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:38.807328    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:40.005221 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:40.005179    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:40.103789 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:40.103753    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:40.260400 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:40.260371    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"]
Jul 21 21:00:40.260586 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:40.260567    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf" podUID="b0e0de7b-615a-4f4d-9b89-e3da502dd773" containerName="istio-proxy" containerID="cri-o://10dc4f0be4ec8c2d7aaced294fe7a7c670043f5f041eef6497a237a18e3df4c0" gracePeriod=30
Jul 21 21:00:40.295038 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:40.295007    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:40.516973 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:40.516896    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:40.992999 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:40.992911    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:42.883797 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:42.883750    2576 patch_prober.go:28] interesting pod/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 21 21:00:42.884184 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:42.883817    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf" podUID="b0e0de7b-615a-4f4d-9b89-e3da502dd773" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 21:00:45.507338 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.507307    2576 generic.go:356] "Generic (PLEG): container finished" podID="b0e0de7b-615a-4f4d-9b89-e3da502dd773" containerID="10dc4f0be4ec8c2d7aaced294fe7a7c670043f5f041eef6497a237a18e3df4c0" exitCode=0
Jul 21 21:00:45.507782 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.507389    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf" event={"ID":"b0e0de7b-615a-4f4d-9b89-e3da502dd773","Type":"ContainerDied","Data":"10dc4f0be4ec8c2d7aaced294fe7a7c670043f5f041eef6497a237a18e3df4c0"}
Jul 21 21:00:45.507782 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.507507    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf" event={"ID":"b0e0de7b-615a-4f4d-9b89-e3da502dd773","Type":"ContainerDied","Data":"d60cac2118022ba99af38ea0b48ab07845381b33d1c66056e6c203f17db95f8c"}
Jul 21 21:00:45.507782 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.507535    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d60cac2118022ba99af38ea0b48ab07845381b33d1c66056e6c203f17db95f8c"
Jul 21 21:00:45.507782 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.507557    2576 scope.go:117] "RemoveContainer" containerID="cee651e8daeaa223d92b343b71f49b31ad5a07c74fa7923def8814fa73efd8f2"
Jul 21 21:00:45.518699 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.518649    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:45.563391 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.563300    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istio-podinfo\") pod \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") "
Jul 21 21:00:45.563391 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.563375    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-workload-socket\") pod \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") "
Jul 21 21:00:45.563642 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.563398    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istiod-ca-cert\") pod \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") "
Jul 21 21:00:45.563642 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.563502    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istio-data\") pod \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") "
Jul 21 21:00:45.563642 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.563555    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istio-token\") pod \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") "
Jul 21 21:00:45.563833 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.563660    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2b9m\" (UniqueName: \"kubernetes.io/projected/b0e0de7b-615a-4f4d-9b89-e3da502dd773-kube-api-access-m2b9m\") pod \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") "
Jul 21 21:00:45.563833 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.563730    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-workload-certs\") pod \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") "
Jul 21 21:00:45.563833 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.563812    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istio-envoy\") pod \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") "
Jul 21 21:00:45.563989 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.563869    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-credential-socket\") pod \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\" (UID: \"b0e0de7b-615a-4f4d-9b89-e3da502dd773\") "
Jul 21 21:00:45.563989 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.563732    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b0e0de7b-615a-4f4d-9b89-e3da502dd773" (UID: "b0e0de7b-615a-4f4d-9b89-e3da502dd773"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:00:45.564111 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.563811    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b0e0de7b-615a-4f4d-9b89-e3da502dd773" (UID: "b0e0de7b-615a-4f4d-9b89-e3da502dd773"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 21:00:45.564111 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.564035    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b0e0de7b-615a-4f4d-9b89-e3da502dd773" (UID: "b0e0de7b-615a-4f4d-9b89-e3da502dd773"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:00:45.564222 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.564208    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b0e0de7b-615a-4f4d-9b89-e3da502dd773" (UID: "b0e0de7b-615a-4f4d-9b89-e3da502dd773"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:00:45.564304 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.564271    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-workload-certs\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:45.564304 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.564298    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-workload-socket\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:45.564414 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.564314    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istiod-ca-cert\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:45.564414 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.564373    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istio-data" (OuterVolumeSpecName: "istio-data") pod "b0e0de7b-615a-4f4d-9b89-e3da502dd773" (UID: "b0e0de7b-615a-4f4d-9b89-e3da502dd773"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:00:45.565815 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.565782    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b0e0de7b-615a-4f4d-9b89-e3da502dd773" (UID: "b0e0de7b-615a-4f4d-9b89-e3da502dd773"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 21:00:45.565941 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.565887    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0e0de7b-615a-4f4d-9b89-e3da502dd773-kube-api-access-m2b9m" (OuterVolumeSpecName: "kube-api-access-m2b9m") pod "b0e0de7b-615a-4f4d-9b89-e3da502dd773" (UID: "b0e0de7b-615a-4f4d-9b89-e3da502dd773"). InnerVolumeSpecName "kube-api-access-m2b9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:00:45.566350 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.566327    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b0e0de7b-615a-4f4d-9b89-e3da502dd773" (UID: "b0e0de7b-615a-4f4d-9b89-e3da502dd773"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:00:45.566350 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.566336    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istio-token" (OuterVolumeSpecName: "istio-token") pod "b0e0de7b-615a-4f4d-9b89-e3da502dd773" (UID: "b0e0de7b-615a-4f4d-9b89-e3da502dd773"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:00:45.665737 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.665704    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-credential-socket\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:45.665737 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.665732    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istio-podinfo\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:45.665737 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.665741    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istio-data\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:45.665950 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.665750    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istio-token\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:45.665950 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.665758    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2b9m\" (UniqueName: \"kubernetes.io/projected/b0e0de7b-615a-4f4d-9b89-e3da502dd773-kube-api-access-m2b9m\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:45.665950 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:45.665766    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0e0de7b-615a-4f4d-9b89-e3da502dd773-istio-envoy\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:46.514493 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:46.514464    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"
Jul 21 21:00:46.556741 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:46.556701    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"]
Jul 21 21:00:46.565763 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:46.565732    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-04e869-openshift-default-68885d96f9-rfcgf"]
Jul 21 21:00:47.579534 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:47.579497    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:47.652395 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:47.652358    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0e0de7b-615a-4f4d-9b89-e3da502dd773" path="/var/lib/kubelet/pods/b0e0de7b-615a-4f4d-9b89-e3da502dd773/volumes"
Jul 21 21:00:53.721377 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:53.721326    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:53.823655 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:53.823621    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:54.003388 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:54.003295    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"]
Jul 21 21:00:54.003583 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:54.003541    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8" podUID="0cc99e82-9c30-451f-9e6b-85719cb2d0f1" containerName="istio-proxy" containerID="cri-o://0666feff6845a7330163fd402ff5ced2a99ee76fd7e5a6862e350524ec548f17" gracePeriod=30
Jul 21 21:00:54.037364 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:54.037327    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:54.253625 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:54.253543    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:54.600076 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:54.600037    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:54.939584 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:54.939501    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"]
Jul 21 21:00:54.940189 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:54.940164    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0e0de7b-615a-4f4d-9b89-e3da502dd773" containerName="istio-proxy"
Jul 21 21:00:54.940189 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:54.940189    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0e0de7b-615a-4f4d-9b89-e3da502dd773" containerName="istio-proxy"
Jul 21 21:00:54.940385 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:54.940347    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0e0de7b-615a-4f4d-9b89-e3da502dd773" containerName="istio-proxy"
Jul 21 21:00:54.944433 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:54.944409    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:54.947554 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:54.947534    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-1ad4ca-openshift-default-dockercfg-dwmh2\""
Jul 21 21:00:54.962931 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:54.962899    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"]
Jul 21 21:00:54.976007 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:54.975980    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:55.060554 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.060510    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5d81463-ffb6-4688-8288-8258859dc11a-istio-token\") pod \"e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") " pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:55.060766 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.060566    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tskpv\" (UniqueName: \"kubernetes.io/projected/f5d81463-ffb6-4688-8288-8258859dc11a-kube-api-access-tskpv\") pod \"e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") " pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:55.060766 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.060641    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-credential-socket\") pod \"e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") " pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:55.060766 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.060719    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-workload-socket\") pod \"e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") " pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:55.060766 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.060745    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5d81463-ffb6-4688-8288-8258859dc11a-istiod-ca-cert\") pod \"e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") " pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:55.060959 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.060843    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-istio-data\") pod \"e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") " pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:55.060959 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.060884    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5d81463-ffb6-4688-8288-8258859dc11a-istio-podinfo\") pod \"e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") " pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:55.061067 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.060960    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-workload-certs\") pod \"e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") " pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:55.061067 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.061013    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-istio-envoy\") pod \"e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") " pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:55.138102 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.138071    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:55.161706 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.161651    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5d81463-ffb6-4688-8288-8258859dc11a-istio-token\") pod \"e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") " pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:55.161876 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.161723    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tskpv\" (UniqueName: \"kubernetes.io/projected/f5d81463-ffb6-4688-8288-8258859dc11a-kube-api-access-tskpv\") pod \"e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") " pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:55.161876 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.161770    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-credential-socket\") pod \"e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") " pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:55.161876 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.161802    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-workload-socket\") pod \"e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") " pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:55.161876 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.161825    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5d81463-ffb6-4688-8288-8258859dc11a-istiod-ca-cert\") pod \"e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") " pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:55.162016 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.161907    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-istio-data\") pod \"e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") " pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:55.162016 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.161948    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5d81463-ffb6-4688-8288-8258859dc11a-istio-podinfo\") pod \"e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") " pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:55.162016 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.161994    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-workload-certs\") pod \"e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") " pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:55.162110 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.162028    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-istio-envoy\") pod \"e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") " pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:55.162218 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.162193    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-workload-socket\") pod \"e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") " pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:55.162355 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.162327    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-credential-socket\") pod \"e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") " pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:55.162582 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.162557    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-workload-certs\") pod \"e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") " pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:55.162664 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.162581    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-istio-data\") pod \"e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") " pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:55.162946 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.162925    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5d81463-ffb6-4688-8288-8258859dc11a-istiod-ca-cert\") pod \"e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") " pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:55.164576 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.164553    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5d81463-ffb6-4688-8288-8258859dc11a-istio-podinfo\") pod \"e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") " pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:55.164684 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.164663    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-istio-envoy\") pod \"e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") " pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:55.176975 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.176949    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5d81463-ffb6-4688-8288-8258859dc11a-istio-token\") pod \"e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") " pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:55.181515 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.181491    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tskpv\" (UniqueName: \"kubernetes.io/projected/f5d81463-ffb6-4688-8288-8258859dc11a-kube-api-access-tskpv\") pod \"e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") " pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:55.255431 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.255337    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:55.421034 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.421004    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"]
Jul 21 21:00:55.424317 ip-10-0-128-201 kubenswrapper[2576]: W0721 21:00:55.424292    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5d81463_ffb6_4688_8288_8258859dc11a.slice/crio-aae8f6c5c084cb413313655cd746a935954c112ea02a1fa4a12e4fc13f7d9836 WatchSource:0}: Error finding container aae8f6c5c084cb413313655cd746a935954c112ea02a1fa4a12e4fc13f7d9836: Status 404 returned error can't find the container with id aae8f6c5c084cb413313655cd746a935954c112ea02a1fa4a12e4fc13f7d9836
Jul 21 21:00:55.427213 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.427177    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:00:55.427320 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.427245    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:00:55.427320 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.427278    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:00:55.569254 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.569177    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw" event={"ID":"f5d81463-ffb6-4688-8288-8258859dc11a","Type":"ContainerStarted","Data":"7b7269db7cd6573a3ef1f2f4ee010e3827855a564d70ffeba650f1c3dfcf40f3"}
Jul 21 21:00:55.569485 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.569269    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw" event={"ID":"f5d81463-ffb6-4688-8288-8258859dc11a","Type":"ContainerStarted","Data":"aae8f6c5c084cb413313655cd746a935954c112ea02a1fa4a12e4fc13f7d9836"}
Jul 21 21:00:55.600577 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:55.600509    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw" podStartSLOduration=1.60048258 podStartE2EDuration="1.60048258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:00:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:00:55.59693695 +0000 UTC m=+2806.529335107" watchObservedRunningTime="2026-07-21 21:00:55.60048258 +0000 UTC m=+2806.532880738"
Jul 21 21:00:56.255658 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:56.255619    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:56.260907 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:56.260880    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:56.572958 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:56.572849    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:56.574980 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:56.574958    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:56.575978 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:56.575957    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:00:56.699212 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:56.699175    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:56.752785 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:56.752745    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9"]
Jul 21 21:00:56.753168 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:56.753154    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0e0de7b-615a-4f4d-9b89-e3da502dd773" containerName="istio-proxy"
Jul 21 21:00:56.753168 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:56.753168    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0e0de7b-615a-4f4d-9b89-e3da502dd773" containerName="istio-proxy"
Jul 21 21:00:56.753298 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:56.753250    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0e0de7b-615a-4f4d-9b89-e3da502dd773" containerName="istio-proxy"
Jul 21 21:00:56.756259 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:56.756237    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9"
Jul 21 21:00:56.758961 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:56.758938    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-1ad4ca-serving-cert\""
Jul 21 21:00:56.768359 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:56.768331    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9"]
Jul 21 21:00:56.808536 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:56.808501    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:56.879638 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:56.879538    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1248e5fb-d7f3-431b-832b-a54246297997-maas-api-tls\") pod \"maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9\" (UID: \"1248e5fb-d7f3-431b-832b-a54246297997\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9"
Jul 21 21:00:56.879638 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:56.879579    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1248e5fb-d7f3-431b-832b-a54246297997-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9\" (UID: \"1248e5fb-d7f3-431b-832b-a54246297997\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9"
Jul 21 21:00:56.879875 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:56.879722    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d7gd\" (UniqueName: \"kubernetes.io/projected/1248e5fb-d7f3-431b-832b-a54246297997-kube-api-access-2d7gd\") pod \"maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9\" (UID: \"1248e5fb-d7f3-431b-832b-a54246297997\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9"
Jul 21 21:00:56.943457 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:56.943421    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:56.980508 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:56.980467    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1248e5fb-d7f3-431b-832b-a54246297997-maas-api-tls\") pod \"maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9\" (UID: \"1248e5fb-d7f3-431b-832b-a54246297997\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9"
Jul 21 21:00:56.980508 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:56.980508    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1248e5fb-d7f3-431b-832b-a54246297997-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9\" (UID: \"1248e5fb-d7f3-431b-832b-a54246297997\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9"
Jul 21 21:00:56.980778 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:56.980603    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d7gd\" (UniqueName: \"kubernetes.io/projected/1248e5fb-d7f3-431b-832b-a54246297997-kube-api-access-2d7gd\") pod \"maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9\" (UID: \"1248e5fb-d7f3-431b-832b-a54246297997\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9"
Jul 21 21:00:56.981497 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:56.981466    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1248e5fb-d7f3-431b-832b-a54246297997-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9\" (UID: \"1248e5fb-d7f3-431b-832b-a54246297997\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9"
Jul 21 21:00:56.983170 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:56.983148    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1248e5fb-d7f3-431b-832b-a54246297997-maas-api-tls\") pod \"maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9\" (UID: \"1248e5fb-d7f3-431b-832b-a54246297997\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9"
Jul 21 21:00:56.993059 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:56.993033    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d7gd\" (UniqueName: \"kubernetes.io/projected/1248e5fb-d7f3-431b-832b-a54246297997-kube-api-access-2d7gd\") pod \"maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9\" (UID: \"1248e5fb-d7f3-431b-832b-a54246297997\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9"
Jul 21 21:00:57.068052 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:57.068015    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9"
Jul 21 21:00:57.218562 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:57.218535    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9"]
Jul 21 21:00:57.227546 ip-10-0-128-201 kubenswrapper[2576]: W0721 21:00:57.221068    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1248e5fb_d7f3_431b_832b_a54246297997.slice/crio-79566c856f2e984b29a74dd1090cca21001a7707f7980ff26a959ad733b64e5a WatchSource:0}: Error finding container 79566c856f2e984b29a74dd1090cca21001a7707f7980ff26a959ad733b64e5a: Status 404 returned error can't find the container with id 79566c856f2e984b29a74dd1090cca21001a7707f7980ff26a959ad733b64e5a
Jul 21 21:00:57.356032 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:57.355992    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:57.450259 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:57.450146    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:00:57.581423 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:57.581387    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9" event={"ID":"1248e5fb-d7f3-431b-832b-a54246297997","Type":"ContainerStarted","Data":"79566c856f2e984b29a74dd1090cca21001a7707f7980ff26a959ad733b64e5a"}
Jul 21 21:00:58.588325 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:58.588217    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9" event={"ID":"1248e5fb-d7f3-431b-832b-a54246297997","Type":"ContainerStarted","Data":"b218f2904492addbbc11096adcbc33165e31770e3f0db42b51009b85b16169f5"}
Jul 21 21:00:58.588729 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:58.588427    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9"
Jul 21 21:00:58.613487 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:58.613432    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9" podStartSLOduration=1.523678364 podStartE2EDuration="2.613414374s" totalImagesPullingTime="1.08973601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:00:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:00:58.611025144 +0000 UTC m=+2809.543423302" watchObservedRunningTime="2026-07-21 21:00:58.613414374 +0000 UTC m=+2809.545812530"
Jul 21 21:00:59.275424 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.275352    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:59.403889 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.403851    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istio-envoy\") pod \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") "
Jul 21 21:00:59.404082 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.403899    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istiod-ca-cert\") pod \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") "
Jul 21 21:00:59.404082 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.403937    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjm9g\" (UniqueName: \"kubernetes.io/projected/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-kube-api-access-vjm9g\") pod \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") "
Jul 21 21:00:59.404082 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.403989    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istio-data\") pod \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") "
Jul 21 21:00:59.404082 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.404032    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-workload-certs\") pod \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") "
Jul 21 21:00:59.404302 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.404105    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istio-podinfo\") pod \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") "
Jul 21 21:00:59.404302 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.404154    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-workload-socket\") pod \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") "
Jul 21 21:00:59.404302 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.404211    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-credential-socket\") pod \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") "
Jul 21 21:00:59.404302 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.404245    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istio-token\") pod \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\" (UID: \"0cc99e82-9c30-451f-9e6b-85719cb2d0f1\") "
Jul 21 21:00:59.404511 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.404363    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0cc99e82-9c30-451f-9e6b-85719cb2d0f1" (UID: "0cc99e82-9c30-451f-9e6b-85719cb2d0f1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:00:59.404511 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.404411    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0cc99e82-9c30-451f-9e6b-85719cb2d0f1" (UID: "0cc99e82-9c30-451f-9e6b-85719cb2d0f1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 21:00:59.404781 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.404654    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istiod-ca-cert\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:59.404781 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.404666    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0cc99e82-9c30-451f-9e6b-85719cb2d0f1" (UID: "0cc99e82-9c30-451f-9e6b-85719cb2d0f1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:00:59.404781 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.404681    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-workload-certs\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:59.405108 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.404874    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0cc99e82-9c30-451f-9e6b-85719cb2d0f1" (UID: "0cc99e82-9c30-451f-9e6b-85719cb2d0f1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:00:59.405108 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.405007    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istio-data" (OuterVolumeSpecName: "istio-data") pod "0cc99e82-9c30-451f-9e6b-85719cb2d0f1" (UID: "0cc99e82-9c30-451f-9e6b-85719cb2d0f1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:00:59.406296 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.406264    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-kube-api-access-vjm9g" (OuterVolumeSpecName: "kube-api-access-vjm9g") pod "0cc99e82-9c30-451f-9e6b-85719cb2d0f1" (UID: "0cc99e82-9c30-451f-9e6b-85719cb2d0f1"). InnerVolumeSpecName "kube-api-access-vjm9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:00:59.406296 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.406269    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0cc99e82-9c30-451f-9e6b-85719cb2d0f1" (UID: "0cc99e82-9c30-451f-9e6b-85719cb2d0f1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:00:59.406476 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.406277    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0cc99e82-9c30-451f-9e6b-85719cb2d0f1" (UID: "0cc99e82-9c30-451f-9e6b-85719cb2d0f1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 21:00:59.406476 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.406337    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istio-token" (OuterVolumeSpecName: "istio-token") pod "0cc99e82-9c30-451f-9e6b-85719cb2d0f1" (UID: "0cc99e82-9c30-451f-9e6b-85719cb2d0f1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:00:59.505913 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.505862    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjm9g\" (UniqueName: \"kubernetes.io/projected/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-kube-api-access-vjm9g\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:59.505913 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.505907    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istio-data\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:59.505913 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.505918    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istio-podinfo\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:59.505913 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.505926    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-workload-socket\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:59.505913 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.505936    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-credential-socket\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:59.506230 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.505945    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istio-token\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:59.506230 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.505954    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cc99e82-9c30-451f-9e6b-85719cb2d0f1-istio-envoy\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:00:59.595496 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.595411    2576 generic.go:356] "Generic (PLEG): container finished" podID="0cc99e82-9c30-451f-9e6b-85719cb2d0f1" containerID="0666feff6845a7330163fd402ff5ced2a99ee76fd7e5a6862e350524ec548f17" exitCode=0
Jul 21 21:00:59.595496 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.595457    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"
Jul 21 21:00:59.595980 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.595499    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8" event={"ID":"0cc99e82-9c30-451f-9e6b-85719cb2d0f1","Type":"ContainerDied","Data":"0666feff6845a7330163fd402ff5ced2a99ee76fd7e5a6862e350524ec548f17"}
Jul 21 21:00:59.595980 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.595561    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8" event={"ID":"0cc99e82-9c30-451f-9e6b-85719cb2d0f1","Type":"ContainerDied","Data":"283c5d140184592b0cf6f00cc7ab430b643109c0d4999059dd803c55d2d27635"}
Jul 21 21:00:59.595980 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.595595    2576 scope.go:117] "RemoveContainer" containerID="0666feff6845a7330163fd402ff5ced2a99ee76fd7e5a6862e350524ec548f17"
Jul 21 21:00:59.605308 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.605287    2576 scope.go:117] "RemoveContainer" containerID="c21e6e9c5c69cc561c8ae05e0eb26fe7b7340ae0b2bbcf89aae78296c5b00dfa"
Jul 21 21:00:59.614301 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.614279    2576 scope.go:117] "RemoveContainer" containerID="0666feff6845a7330163fd402ff5ced2a99ee76fd7e5a6862e350524ec548f17"
Jul 21 21:00:59.614602 ip-10-0-128-201 kubenswrapper[2576]: E0721 21:00:59.614582    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0666feff6845a7330163fd402ff5ced2a99ee76fd7e5a6862e350524ec548f17\": container with ID starting with 0666feff6845a7330163fd402ff5ced2a99ee76fd7e5a6862e350524ec548f17 not found: ID does not exist" containerID="0666feff6845a7330163fd402ff5ced2a99ee76fd7e5a6862e350524ec548f17"
Jul 21 21:00:59.614668 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.614611    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0666feff6845a7330163fd402ff5ced2a99ee76fd7e5a6862e350524ec548f17"} err="failed to get container status \"0666feff6845a7330163fd402ff5ced2a99ee76fd7e5a6862e350524ec548f17\": rpc error: code = NotFound desc = could not find container \"0666feff6845a7330163fd402ff5ced2a99ee76fd7e5a6862e350524ec548f17\": container with ID starting with 0666feff6845a7330163fd402ff5ced2a99ee76fd7e5a6862e350524ec548f17 not found: ID does not exist"
Jul 21 21:00:59.614668 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.614632    2576 scope.go:117] "RemoveContainer" containerID="c21e6e9c5c69cc561c8ae05e0eb26fe7b7340ae0b2bbcf89aae78296c5b00dfa"
Jul 21 21:00:59.614995 ip-10-0-128-201 kubenswrapper[2576]: E0721 21:00:59.614972    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c21e6e9c5c69cc561c8ae05e0eb26fe7b7340ae0b2bbcf89aae78296c5b00dfa\": container with ID starting with c21e6e9c5c69cc561c8ae05e0eb26fe7b7340ae0b2bbcf89aae78296c5b00dfa not found: ID does not exist" containerID="c21e6e9c5c69cc561c8ae05e0eb26fe7b7340ae0b2bbcf89aae78296c5b00dfa"
Jul 21 21:00:59.615093 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.615000    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c21e6e9c5c69cc561c8ae05e0eb26fe7b7340ae0b2bbcf89aae78296c5b00dfa"} err="failed to get container status \"c21e6e9c5c69cc561c8ae05e0eb26fe7b7340ae0b2bbcf89aae78296c5b00dfa\": rpc error: code = NotFound desc = could not find container \"c21e6e9c5c69cc561c8ae05e0eb26fe7b7340ae0b2bbcf89aae78296c5b00dfa\": container with ID starting with c21e6e9c5c69cc561c8ae05e0eb26fe7b7340ae0b2bbcf89aae78296c5b00dfa not found: ID does not exist"
Jul 21 21:00:59.619301 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.619255    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"]
Jul 21 21:00:59.622281 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.622257    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-280285-openshift-default-6d5546dc95-6zxr8"]
Jul 21 21:00:59.658091 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:00:59.658053    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cc99e82-9c30-451f-9e6b-85719cb2d0f1" path="/var/lib/kubelet/pods/0cc99e82-9c30-451f-9e6b-85719cb2d0f1/volumes"
Jul 21 21:01:02.075609 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.075568    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:01:02.415014 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.414930    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:01:02.730152 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.730066    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"]
Jul 21 21:01:02.730515 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.730501    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cc99e82-9c30-451f-9e6b-85719cb2d0f1" containerName="istio-proxy"
Jul 21 21:01:02.730570 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.730516    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cc99e82-9c30-451f-9e6b-85719cb2d0f1" containerName="istio-proxy"
Jul 21 21:01:02.730570 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.730529    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cc99e82-9c30-451f-9e6b-85719cb2d0f1" containerName="istio-proxy"
Jul 21 21:01:02.730570 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.730535    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cc99e82-9c30-451f-9e6b-85719cb2d0f1" containerName="istio-proxy"
Jul 21 21:01:02.730663 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.730618    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cc99e82-9c30-451f-9e6b-85719cb2d0f1" containerName="istio-proxy"
Jul 21 21:01:02.730663 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.730629    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cc99e82-9c30-451f-9e6b-85719cb2d0f1" containerName="istio-proxy"
Jul 21 21:01:02.735183 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.735159    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:02.737900 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.737870    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-9b964f-openshift-default-dockercfg-s5rcw\""
Jul 21 21:01:02.747807 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.747777    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"]
Jul 21 21:01:02.758806 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.758774    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:01:02.840611 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.840574    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-workload-socket\") pod \"e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") " pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:02.840829 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.840619    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-workload-certs\") pod \"e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") " pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:02.840829 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.840639    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-credential-socket\") pod \"e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") " pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:02.840829 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.840728    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsdgq\" (UniqueName: \"kubernetes.io/projected/1c66d874-eb52-451c-91a8-206bd5201d1e-kube-api-access-nsdgq\") pod \"e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") " pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:02.840829 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.840814    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c66d874-eb52-451c-91a8-206bd5201d1e-istiod-ca-cert\") pod \"e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") " pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:02.841005 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.840850    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c66d874-eb52-451c-91a8-206bd5201d1e-istio-podinfo\") pod \"e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") " pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:02.841005 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.840907    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-istio-envoy\") pod \"e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") " pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:02.841005 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.840933    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c66d874-eb52-451c-91a8-206bd5201d1e-istio-token\") pod \"e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") " pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:02.841005 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.840973    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-istio-data\") pod \"e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") " pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:02.882944 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.882909    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:01:02.942193 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.942149    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c66d874-eb52-451c-91a8-206bd5201d1e-istiod-ca-cert\") pod \"e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") " pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:02.942375 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.942210    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c66d874-eb52-451c-91a8-206bd5201d1e-istio-podinfo\") pod \"e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") " pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:02.942375 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.942250    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-istio-envoy\") pod \"e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") " pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:02.942375 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.942277    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c66d874-eb52-451c-91a8-206bd5201d1e-istio-token\") pod \"e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") " pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:02.942375 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.942330    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-istio-data\") pod \"e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") " pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:02.942607 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.942393    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-workload-socket\") pod \"e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") " pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:02.942607 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.942516    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-workload-certs\") pod \"e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") " pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:02.942607 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.942557    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-credential-socket\") pod \"e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") " pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:02.942607 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.942583    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsdgq\" (UniqueName: \"kubernetes.io/projected/1c66d874-eb52-451c-91a8-206bd5201d1e-kube-api-access-nsdgq\") pod \"e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") " pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:02.942865 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.942784    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-workload-socket\") pod \"e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") " pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:02.942950 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.942922    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-workload-certs\") pod \"e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") " pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:02.943013 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.942997    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-istio-data\") pod \"e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") " pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:02.943079 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.943058    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c66d874-eb52-451c-91a8-206bd5201d1e-istiod-ca-cert\") pod \"e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") " pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:02.943119 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.943057    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-credential-socket\") pod \"e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") " pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:02.945236 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.945210    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-istio-envoy\") pod \"e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") " pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:02.945420 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.945405    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c66d874-eb52-451c-91a8-206bd5201d1e-istio-podinfo\") pod \"e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") " pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:02.951758 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.951730    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c66d874-eb52-451c-91a8-206bd5201d1e-istio-token\") pod \"e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") " pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:02.953835 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:02.953811    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsdgq\" (UniqueName: \"kubernetes.io/projected/1c66d874-eb52-451c-91a8-206bd5201d1e-kube-api-access-nsdgq\") pod \"e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") " pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:03.046429 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:03.046398    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:03.204277 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:03.204245    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"]
Jul 21 21:01:03.205600 ip-10-0-128-201 kubenswrapper[2576]: W0721 21:01:03.205571    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c66d874_eb52_451c_91a8_206bd5201d1e.slice/crio-c6a7f9a3cce6d1beb21bc9bea52ef27f6869ebc9b134e7624ee244abf2e153a5 WatchSource:0}: Error finding container c6a7f9a3cce6d1beb21bc9bea52ef27f6869ebc9b134e7624ee244abf2e153a5: Status 404 returned error can't find the container with id c6a7f9a3cce6d1beb21bc9bea52ef27f6869ebc9b134e7624ee244abf2e153a5
Jul 21 21:01:03.208027 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:03.207994    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:01:03.208096 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:03.208072    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:01:03.208135 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:03.208103    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:01:03.622998 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:03.622955    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q" event={"ID":"1c66d874-eb52-451c-91a8-206bd5201d1e","Type":"ContainerStarted","Data":"95377eb156ee2bc7260ba4900aae5ed0f9b7f795ddc21652e10261437112e9ba"}
Jul 21 21:01:03.623188 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:03.623025    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q" event={"ID":"1c66d874-eb52-451c-91a8-206bd5201d1e","Type":"ContainerStarted","Data":"c6a7f9a3cce6d1beb21bc9bea52ef27f6869ebc9b134e7624ee244abf2e153a5"}
Jul 21 21:01:03.653747 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:03.653677    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q" podStartSLOduration=1.65366175 podStartE2EDuration="1.65366175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:01:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:01:03.651428787 +0000 UTC m=+2814.583826957" watchObservedRunningTime="2026-07-21 21:01:03.65366175 +0000 UTC m=+2814.586059935"
Jul 21 21:01:04.047172 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:04.047140    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:04.052314 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:04.052289    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:04.602478 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:04.602448    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9"
Jul 21 21:01:04.625996 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:04.625906    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:01:04.630454 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:04.630425    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:04.631619 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:04.631598    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:04.750088 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:04.750050    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:01:04.857546 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:04.857507    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9b964f-7f6b587785-7z629"]
Jul 21 21:01:04.861790 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:04.861765    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9b964f-7f6b587785-7z629"
Jul 21 21:01:04.865439 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:04.865412    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-9b964f-serving-cert\""
Jul 21 21:01:04.883539 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:04.883449    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9b964f-7f6b587785-7z629"]
Jul 21 21:01:04.921519 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:04.921462    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:01:04.965261 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:04.965224    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04f69d7a-fd6c-484b-ae89-f335473f381b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-9b964f-7f6b587785-7z629\" (UID: \"04f69d7a-fd6c-484b-ae89-f335473f381b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9b964f-7f6b587785-7z629"
Jul 21 21:01:04.965261 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:04.965273    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czxc7\" (UniqueName: \"kubernetes.io/projected/04f69d7a-fd6c-484b-ae89-f335473f381b-kube-api-access-czxc7\") pod \"maas-api-e2e-shared-b-9b964f-7f6b587785-7z629\" (UID: \"04f69d7a-fd6c-484b-ae89-f335473f381b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9b964f-7f6b587785-7z629"
Jul 21 21:01:04.965558 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:04.965452    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04f69d7a-fd6c-484b-ae89-f335473f381b-maas-api-tls\") pod \"maas-api-e2e-shared-b-9b964f-7f6b587785-7z629\" (UID: \"04f69d7a-fd6c-484b-ae89-f335473f381b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9b964f-7f6b587785-7z629"
Jul 21 21:01:05.066358 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:05.066313    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04f69d7a-fd6c-484b-ae89-f335473f381b-maas-api-tls\") pod \"maas-api-e2e-shared-b-9b964f-7f6b587785-7z629\" (UID: \"04f69d7a-fd6c-484b-ae89-f335473f381b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9b964f-7f6b587785-7z629"
Jul 21 21:01:05.066569 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:05.066470    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04f69d7a-fd6c-484b-ae89-f335473f381b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-9b964f-7f6b587785-7z629\" (UID: \"04f69d7a-fd6c-484b-ae89-f335473f381b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9b964f-7f6b587785-7z629"
Jul 21 21:01:05.066569 ip-10-0-128-201 kubenswrapper[2576]: E0721 21:01:05.066483    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-9b964f-serving-cert: secret "maas-api-e2e-shared-b-9b964f-serving-cert" not found
Jul 21 21:01:05.066569 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:05.066507    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czxc7\" (UniqueName: \"kubernetes.io/projected/04f69d7a-fd6c-484b-ae89-f335473f381b-kube-api-access-czxc7\") pod \"maas-api-e2e-shared-b-9b964f-7f6b587785-7z629\" (UID: \"04f69d7a-fd6c-484b-ae89-f335473f381b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9b964f-7f6b587785-7z629"
Jul 21 21:01:05.066569 ip-10-0-128-201 kubenswrapper[2576]: E0721 21:01:05.066570    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04f69d7a-fd6c-484b-ae89-f335473f381b-maas-api-tls podName:04f69d7a-fd6c-484b-ae89-f335473f381b nodeName:}" failed. No retries permitted until 2026-07-21 21:01:05.566548061 +0000 UTC m=+2816.498946207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/04f69d7a-fd6c-484b-ae89-f335473f381b-maas-api-tls") pod "maas-api-e2e-shared-b-9b964f-7f6b587785-7z629" (UID: "04f69d7a-fd6c-484b-ae89-f335473f381b") : secret "maas-api-e2e-shared-b-9b964f-serving-cert" not found
Jul 21 21:01:05.067211 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:05.067188    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04f69d7a-fd6c-484b-ae89-f335473f381b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-9b964f-7f6b587785-7z629\" (UID: \"04f69d7a-fd6c-484b-ae89-f335473f381b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9b964f-7f6b587785-7z629"
Jul 21 21:01:05.112470 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:05.112432    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czxc7\" (UniqueName: \"kubernetes.io/projected/04f69d7a-fd6c-484b-ae89-f335473f381b-kube-api-access-czxc7\") pod \"maas-api-e2e-shared-b-9b964f-7f6b587785-7z629\" (UID: \"04f69d7a-fd6c-484b-ae89-f335473f381b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9b964f-7f6b587785-7z629"
Jul 21 21:01:05.251578 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:05.251497    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:01:05.571182 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:05.571132    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04f69d7a-fd6c-484b-ae89-f335473f381b-maas-api-tls\") pod \"maas-api-e2e-shared-b-9b964f-7f6b587785-7z629\" (UID: \"04f69d7a-fd6c-484b-ae89-f335473f381b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9b964f-7f6b587785-7z629"
Jul 21 21:01:05.573611 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:05.573590    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04f69d7a-fd6c-484b-ae89-f335473f381b-maas-api-tls\") pod \"maas-api-e2e-shared-b-9b964f-7f6b587785-7z629\" (UID: \"04f69d7a-fd6c-484b-ae89-f335473f381b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9b964f-7f6b587785-7z629"
Jul 21 21:01:05.726818 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:05.726780    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:01:05.773172 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:05.773137    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9b964f-7f6b587785-7z629"
Jul 21 21:01:05.830051 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:05.829993    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:01:05.943371 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:05.943344    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-9b964f-7f6b587785-7z629"]
Jul 21 21:01:05.945271 ip-10-0-128-201 kubenswrapper[2576]: W0721 21:01:05.945233    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04f69d7a_fd6c_484b_ae89_f335473f381b.slice/crio-2433e645e2b6c49ad3cd561819f1fd441630ce0c74f6e5e1b2957aff19b1d142 WatchSource:0}: Error finding container 2433e645e2b6c49ad3cd561819f1fd441630ce0c74f6e5e1b2957aff19b1d142: Status 404 returned error can't find the container with id 2433e645e2b6c49ad3cd561819f1fd441630ce0c74f6e5e1b2957aff19b1d142
Jul 21 21:01:06.641976 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:06.641939    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9b964f-7f6b587785-7z629" event={"ID":"04f69d7a-fd6c-484b-ae89-f335473f381b","Type":"ContainerStarted","Data":"2433e645e2b6c49ad3cd561819f1fd441630ce0c74f6e5e1b2957aff19b1d142"}
Jul 21 21:01:07.651492 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:07.651458    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9b964f-7f6b587785-7z629" event={"ID":"04f69d7a-fd6c-484b-ae89-f335473f381b","Type":"ContainerStarted","Data":"7fc299b462d66ab8e07e5b0db2c4092379ba7a7f85a351d7c91d1d0c9a1cdde2"}
Jul 21 21:01:07.651889 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:07.651517    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9b964f-7f6b587785-7z629"
Jul 21 21:01:07.668904 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:07.668854    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9b964f-7f6b587785-7z629" podStartSLOduration=2.841019504 podStartE2EDuration="3.668838093s" totalImagesPullingTime="827.818589ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:01:07.667655517 +0000 UTC m=+2818.600053675" watchObservedRunningTime="2026-07-21 21:01:07.668838093 +0000 UTC m=+2818.601236251"
Jul 21 21:01:10.135726 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:10.135678    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:01:13.666926 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:13.666891    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-9b964f-7f6b587785-7z629"
Jul 21 21:01:17.719620 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:17.719570    2576 generic.go:356] "Generic (PLEG): container finished" podID="f5d81463-ffb6-4688-8288-8258859dc11a" containerID="7b7269db7cd6573a3ef1f2f4ee010e3827855a564d70ffeba650f1c3dfcf40f3" exitCode=0
Jul 21 21:01:17.720160 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:17.719645    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw" event={"ID":"f5d81463-ffb6-4688-8288-8258859dc11a","Type":"ContainerDied","Data":"7b7269db7cd6573a3ef1f2f4ee010e3827855a564d70ffeba650f1c3dfcf40f3"}
Jul 21 21:01:17.720645 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:17.720259    2576 scope.go:117] "RemoveContainer" containerID="7b7269db7cd6573a3ef1f2f4ee010e3827855a564d70ffeba650f1c3dfcf40f3"
Jul 21 21:01:17.721620 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:17.721534    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:01:17.721774 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:17.721622    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:01:17.721774 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:17.721634    2576 generic.go:356] "Generic (PLEG): container finished" podID="1c66d874-eb52-451c-91a8-206bd5201d1e" containerID="95377eb156ee2bc7260ba4900aae5ed0f9b7f795ddc21652e10261437112e9ba" exitCode=0
Jul 21 21:01:17.721774 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:17.721676    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:01:17.721774 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:17.721721    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q" event={"ID":"1c66d874-eb52-451c-91a8-206bd5201d1e","Type":"ContainerDied","Data":"95377eb156ee2bc7260ba4900aae5ed0f9b7f795ddc21652e10261437112e9ba"}
Jul 21 21:01:17.722100 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:17.722083    2576 scope.go:117] "RemoveContainer" containerID="95377eb156ee2bc7260ba4900aae5ed0f9b7f795ddc21652e10261437112e9ba"
Jul 21 21:01:17.723126 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:17.723097    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:01:17.723234 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:17.723179    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:01:17.723300 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:17.723231    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:01:18.215136 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:18.215101    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:01:18.733509 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:18.733461    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q" event={"ID":"1c66d874-eb52-451c-91a8-206bd5201d1e","Type":"ContainerStarted","Data":"2befe5326f74b0e7f12da4391582cdf90e827991e79627b360971cd42be35b26"}
Jul 21 21:01:18.737361 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:18.737323    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw" event={"ID":"f5d81463-ffb6-4688-8288-8258859dc11a","Type":"ContainerStarted","Data":"9157a8fc0f873a561cac48abbb1d57a000d805f26eeecb6ac5188ad31d59e9be"}
Jul 21 21:01:19.047707 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:19.047647    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:19.048839 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:19.048811    2576 patch_prober.go:28] interesting pod/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 21 21:01:19.048985 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:19.048864    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q" podUID="1c66d874-eb52-451c-91a8-206bd5201d1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 21 21:01:19.256203 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:19.256158    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:01:19.256413 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:19.256299    2576 patch_prober.go:28] interesting pod/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 21 21:01:19.256413 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:19.256345    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw" podUID="f5d81463-ffb6-4688-8288-8258859dc11a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 21 21:01:19.630837 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:19.630793    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:20.047599 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:20.047546    2576 patch_prober.go:28] interesting pod/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 21 21:01:20.048137 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:20.047635    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q" podUID="1c66d874-eb52-451c-91a8-206bd5201d1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 21 21:01:20.256000 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:20.255962    2576 patch_prober.go:28] interesting pod/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 21 21:01:20.256298 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:20.256269    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw" podUID="f5d81463-ffb6-4688-8288-8258859dc11a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 21 21:01:20.328853 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:20.328755    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:01:21.047471 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:21.047417    2576 patch_prober.go:28] interesting pod/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 21 21:01:21.047733 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:21.047508    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q" podUID="1c66d874-eb52-451c-91a8-206bd5201d1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 21 21:01:21.255941 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:21.255895    2576 patch_prober.go:28] interesting pod/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 21 21:01:21.256163 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:21.255980    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw" podUID="f5d81463-ffb6-4688-8288-8258859dc11a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 21 21:01:22.047130 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:22.047091    2576 patch_prober.go:28] interesting pod/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 21 21:01:22.047419 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:22.047392    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q" podUID="1c66d874-eb52-451c-91a8-206bd5201d1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 21 21:01:22.256583 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:22.256144    2576 patch_prober.go:28] interesting pod/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 21 21:01:22.256583 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:22.256206    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw" podUID="f5d81463-ffb6-4688-8288-8258859dc11a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 21 21:01:23.052557 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:23.052524    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:23.053525 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:23.053507    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:01:23.256065 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:23.256028    2576 patch_prober.go:28] interesting pod/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 21 21:01:23.256241 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:23.256087    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw" podUID="f5d81463-ffb6-4688-8288-8258859dc11a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 21 21:01:24.260561 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:24.260530    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:01:24.261041 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:24.260828    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:01:24.261769 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:24.261748    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:01:25.741549 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:25.741513    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:01:26.606715 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:26.606654    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:01:26.747596 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:26.747561    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:01:51.079415 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:01:51.079375    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:02:04.316607 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:02:04.316526    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:02:04.413786 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:02:04.413751    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:03:06.868979 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:03:06.868942    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:04:09.760831 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:09.760799    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w885b_62db291a-14b7-4e35-9550-9fb810f82b8d/console-operator/1.log"
Jul 21 21:04:09.767416 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:09.767390    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-54f9x_55f51c26-71cd-4e1b-84f2-32f2de4138d5/ovn-acl-logging/0.log"
Jul 21 21:04:09.771615 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:09.771590    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w885b_62db291a-14b7-4e35-9550-9fb810f82b8d/console-operator/1.log"
Jul 21 21:04:09.778317 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:09.778294    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-54f9x_55f51c26-71cd-4e1b-84f2-32f2de4138d5/ovn-acl-logging/0.log"
Jul 21 21:04:28.661745 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:28.661670    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:04:29.663968 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:29.663939    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:04:43.396197 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.396162    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"]
Jul 21 21:04:43.398680 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.398663    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"
Jul 21 21:04:43.402125 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.402100    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-1ad4ca\"/\"openshift-service-ca.crt\""
Jul 21 21:04:43.402362 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.402339    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-1ad4ca\"/\"sub-test-model-1ad4ca-kserve-self-signed-certs\""
Jul 21 21:04:43.402427 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.402386    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-1ad4ca\"/\"kube-root-ca.crt\""
Jul 21 21:04:43.402427 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.402401    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-1ad4ca\"/\"default-dockercfg-pvtlr\""
Jul 21 21:04:43.412118 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.412087    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"]
Jul 21 21:04:43.427589 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.427554    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-tmp-dir\") pod \"sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn\" (UID: \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\") " pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"
Jul 21 21:04:43.427809 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.427604    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-dshm\") pod \"sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn\" (UID: \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\") " pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"
Jul 21 21:04:43.427809 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.427632    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-model-cache\") pod \"sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn\" (UID: \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\") " pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"
Jul 21 21:04:43.427809 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.427722    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-tls-certs\") pod \"sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn\" (UID: \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\") " pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"
Jul 21 21:04:43.427985 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.427858    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-home\") pod \"sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn\" (UID: \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\") " pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"
Jul 21 21:04:43.427985 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.427904    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8x2s\" (UniqueName: \"kubernetes.io/projected/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-kube-api-access-c8x2s\") pod \"sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn\" (UID: \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\") " pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"
Jul 21 21:04:43.434756 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.434724    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:04:43.529165 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.529124    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-tmp-dir\") pod \"sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn\" (UID: \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\") " pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"
Jul 21 21:04:43.529352 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.529174    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-dshm\") pod \"sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn\" (UID: \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\") " pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"
Jul 21 21:04:43.529352 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.529194    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-model-cache\") pod \"sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn\" (UID: \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\") " pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"
Jul 21 21:04:43.529352 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.529242    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-tls-certs\") pod \"sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn\" (UID: \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\") " pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"
Jul 21 21:04:43.529352 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.529323    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-home\") pod \"sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn\" (UID: \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\") " pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"
Jul 21 21:04:43.529564 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.529352    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8x2s\" (UniqueName: \"kubernetes.io/projected/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-kube-api-access-c8x2s\") pod \"sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn\" (UID: \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\") " pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"
Jul 21 21:04:43.529627 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.529566    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-tmp-dir\") pod \"sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn\" (UID: \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\") " pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"
Jul 21 21:04:43.529721 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.529680    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-model-cache\") pod \"sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn\" (UID: \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\") " pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"
Jul 21 21:04:43.529794 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.529684    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-home\") pod \"sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn\" (UID: \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\") " pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"
Jul 21 21:04:43.531646 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.531622    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-dshm\") pod \"sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn\" (UID: \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\") " pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"
Jul 21 21:04:43.531823 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.531806    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-tls-certs\") pod \"sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn\" (UID: \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\") " pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"
Jul 21 21:04:43.540720 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.540675    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8x2s\" (UniqueName: \"kubernetes.io/projected/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-kube-api-access-c8x2s\") pod \"sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn\" (UID: \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\") " pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"
Jul 21 21:04:43.708436 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.708331    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"
Jul 21 21:04:43.862349 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.862321    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"]
Jul 21 21:04:43.863809 ip-10-0-128-201 kubenswrapper[2576]: W0721 21:04:43.863766    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c7c8b3a_6b89_4650_9fcc_e82e672482d4.slice/crio-2aadd8c9e1b9dc66d54e632e3698e4c067dde548388e147d229563c66c7b08b0 WatchSource:0}: Error finding container 2aadd8c9e1b9dc66d54e632e3698e4c067dde548388e147d229563c66c7b08b0: Status 404 returned error can't find the container with id 2aadd8c9e1b9dc66d54e632e3698e4c067dde548388e147d229563c66c7b08b0
Jul 21 21:04:43.950381 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.950345    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn" event={"ID":"5c7c8b3a-6b89-4650-9fcc-e82e672482d4","Type":"ContainerStarted","Data":"f81369988fb0bc7ed4cf3523dd5d0adcdd2ee31710a67f6a37e9cd315cea025d"}
Jul 21 21:04:43.950556 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.950392    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn" event={"ID":"5c7c8b3a-6b89-4650-9fcc-e82e672482d4","Type":"ContainerStarted","Data":"2aadd8c9e1b9dc66d54e632e3698e4c067dde548388e147d229563c66c7b08b0"}
Jul 21 21:04:43.972162 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:43.972043    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn" podStartSLOduration=0.972026598 podStartE2EDuration="972.026598ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:04:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:04:43.971256243 +0000 UTC m=+3034.903654399" watchObservedRunningTime="2026-07-21 21:04:43.972026598 +0000 UTC m=+3034.904424754"
Jul 21 21:04:53.709491 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:53.709444    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"
Jul 21 21:04:53.709982 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:53.709508    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"
Jul 21 21:04:53.724092 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:53.724059    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"
Jul 21 21:04:54.017782 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:04:54.017748    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"
Jul 21 21:05:08.941550 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:05:08.941468    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:05:18.416918 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:05:18.416886    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:05:18.518057 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:05:18.518015    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:06:00.206610 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:00.206575    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"]
Jul 21 21:06:00.231933 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:00.231902    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:06:01.156162 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:01.156132    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:06:12.726302 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:12.726261    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:06:15.228797 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.228734    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn" podUID="5c7c8b3a-6b89-4650-9fcc-e82e672482d4" containerName="main" containerID="cri-o://f81369988fb0bc7ed4cf3523dd5d0adcdd2ee31710a67f6a37e9cd315cea025d" gracePeriod=45
Jul 21 21:06:15.486127 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.486067    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"
Jul 21 21:06:15.488433 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.488407    2576 generic.go:356] "Generic (PLEG): container finished" podID="5c7c8b3a-6b89-4650-9fcc-e82e672482d4" containerID="f81369988fb0bc7ed4cf3523dd5d0adcdd2ee31710a67f6a37e9cd315cea025d" exitCode=0
Jul 21 21:06:15.488566 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.488444    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"
Jul 21 21:06:15.488566 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.488491    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn" event={"ID":"5c7c8b3a-6b89-4650-9fcc-e82e672482d4","Type":"ContainerDied","Data":"f81369988fb0bc7ed4cf3523dd5d0adcdd2ee31710a67f6a37e9cd315cea025d"}
Jul 21 21:06:15.488566 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.488539    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn" event={"ID":"5c7c8b3a-6b89-4650-9fcc-e82e672482d4","Type":"ContainerDied","Data":"2aadd8c9e1b9dc66d54e632e3698e4c067dde548388e147d229563c66c7b08b0"}
Jul 21 21:06:15.488566 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.488562    2576 scope.go:117] "RemoveContainer" containerID="f81369988fb0bc7ed4cf3523dd5d0adcdd2ee31710a67f6a37e9cd315cea025d"
Jul 21 21:06:15.498897 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.498873    2576 scope.go:117] "RemoveContainer" containerID="f81369988fb0bc7ed4cf3523dd5d0adcdd2ee31710a67f6a37e9cd315cea025d"
Jul 21 21:06:15.499225 ip-10-0-128-201 kubenswrapper[2576]: E0721 21:06:15.499203    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f81369988fb0bc7ed4cf3523dd5d0adcdd2ee31710a67f6a37e9cd315cea025d\": container with ID starting with f81369988fb0bc7ed4cf3523dd5d0adcdd2ee31710a67f6a37e9cd315cea025d not found: ID does not exist" containerID="f81369988fb0bc7ed4cf3523dd5d0adcdd2ee31710a67f6a37e9cd315cea025d"
Jul 21 21:06:15.499324 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.499235    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f81369988fb0bc7ed4cf3523dd5d0adcdd2ee31710a67f6a37e9cd315cea025d"} err="failed to get container status \"f81369988fb0bc7ed4cf3523dd5d0adcdd2ee31710a67f6a37e9cd315cea025d\": rpc error: code = NotFound desc = could not find container \"f81369988fb0bc7ed4cf3523dd5d0adcdd2ee31710a67f6a37e9cd315cea025d\": container with ID starting with f81369988fb0bc7ed4cf3523dd5d0adcdd2ee31710a67f6a37e9cd315cea025d not found: ID does not exist"
Jul 21 21:06:15.586901 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.586868    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-tls-certs\") pod \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\" (UID: \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\") "
Jul 21 21:06:15.587112 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.586938    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-model-cache\") pod \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\" (UID: \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\") "
Jul 21 21:06:15.587112 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.586977    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-home\") pod \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\" (UID: \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\") "
Jul 21 21:06:15.587112 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.586997    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8x2s\" (UniqueName: \"kubernetes.io/projected/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-kube-api-access-c8x2s\") pod \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\" (UID: \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\") "
Jul 21 21:06:15.587112 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.587018    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-dshm\") pod \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\" (UID: \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\") "
Jul 21 21:06:15.587112 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.587087    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-tmp-dir\") pod \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\" (UID: \"5c7c8b3a-6b89-4650-9fcc-e82e672482d4\") "
Jul 21 21:06:15.587384 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.587284    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-home" (OuterVolumeSpecName: "home") pod "5c7c8b3a-6b89-4650-9fcc-e82e672482d4" (UID: "5c7c8b3a-6b89-4650-9fcc-e82e672482d4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:06:15.587384 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.587300    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-model-cache" (OuterVolumeSpecName: "model-cache") pod "5c7c8b3a-6b89-4650-9fcc-e82e672482d4" (UID: "5c7c8b3a-6b89-4650-9fcc-e82e672482d4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:06:15.587501 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.587483    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-home\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:06:15.587552 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.587509    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-model-cache\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:06:15.587552 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.587484    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5c7c8b3a-6b89-4650-9fcc-e82e672482d4" (UID: "5c7c8b3a-6b89-4650-9fcc-e82e672482d4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:06:15.589265 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.589239    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-kube-api-access-c8x2s" (OuterVolumeSpecName: "kube-api-access-c8x2s") pod "5c7c8b3a-6b89-4650-9fcc-e82e672482d4" (UID: "5c7c8b3a-6b89-4650-9fcc-e82e672482d4"). InnerVolumeSpecName "kube-api-access-c8x2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:06:15.589265 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.589259    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5c7c8b3a-6b89-4650-9fcc-e82e672482d4" (UID: "5c7c8b3a-6b89-4650-9fcc-e82e672482d4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 21:06:15.589407 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.589264    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-dshm" (OuterVolumeSpecName: "dshm") pod "5c7c8b3a-6b89-4650-9fcc-e82e672482d4" (UID: "5c7c8b3a-6b89-4650-9fcc-e82e672482d4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:06:15.688541 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.688504    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8x2s\" (UniqueName: \"kubernetes.io/projected/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-kube-api-access-c8x2s\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:06:15.688541 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.688535    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-dshm\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:06:15.688541 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.688547    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-tmp-dir\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:06:15.688833 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.688555    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c7c8b3a-6b89-4650-9fcc-e82e672482d4-tls-certs\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:06:15.805531 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.805492    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"]
Jul 21 21:06:15.809784 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:15.809752    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-1ad4ca/sub-test-model-1ad4ca-kserve-87f77d44c-kjbvn"]
Jul 21 21:06:17.652073 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:17.651960    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c7c8b3a-6b89-4650-9fcc-e82e672482d4" path="/var/lib/kubelet/pods/5c7c8b3a-6b89-4650-9fcc-e82e672482d4/volumes"
Jul 21 21:06:19.215128 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:19.215091    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:06:19.316609 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:19.316565    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:06:27.549396 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:27.549358    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:06:28.836301 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:28.836266    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:06:31.279374 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:31.279286    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:06:54.308987 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:06:54.308948    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:07:05.268221 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:05.268186    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:07:05.366119 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:05.366086    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:07:09.945460 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:09.945423    2576 scope.go:117] "RemoveContainer" containerID="10dc4f0be4ec8c2d7aaced294fe7a7c670043f5f041eef6497a237a18e3df4c0"
Jul 21 21:07:36.703274 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:36.703234    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:07:37.700579 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:37.700526    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:07:45.185108 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:45.185068    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7138-140442617992800"]
Jul 21 21:07:45.185533 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:45.185516    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c7c8b3a-6b89-4650-9fcc-e82e672482d4" containerName="main"
Jul 21 21:07:45.185533 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:45.185527    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c7c8b3a-6b89-4650-9fcc-e82e672482d4" containerName="main"
Jul 21 21:07:45.185612 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:45.185606    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c7c8b3a-6b89-4650-9fcc-e82e672482d4" containerName="main"
Jul 21 21:07:45.188905 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:45.188886    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7138-140442617992800"
Jul 21 21:07:45.191748 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:45.191727    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-pr87k\""
Jul 21 21:07:45.194015 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:45.193984    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9567\" (UniqueName: \"kubernetes.io/projected/6a503a3a-0fd0-4530-9824-6fcb58271413-kube-api-access-f9567\") pod \"test-curl-7138-140442617992800\" (UID: \"6a503a3a-0fd0-4530-9824-6fcb58271413\") " pod="opendatahub/test-curl-7138-140442617992800"
Jul 21 21:07:45.196968 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:45.196860    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7138-140442617992800"]
Jul 21 21:07:45.295118 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:45.295070    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9567\" (UniqueName: \"kubernetes.io/projected/6a503a3a-0fd0-4530-9824-6fcb58271413-kube-api-access-f9567\") pod \"test-curl-7138-140442617992800\" (UID: \"6a503a3a-0fd0-4530-9824-6fcb58271413\") " pod="opendatahub/test-curl-7138-140442617992800"
Jul 21 21:07:45.311598 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:45.311563    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9567\" (UniqueName: \"kubernetes.io/projected/6a503a3a-0fd0-4530-9824-6fcb58271413-kube-api-access-f9567\") pod \"test-curl-7138-140442617992800\" (UID: \"6a503a3a-0fd0-4530-9824-6fcb58271413\") " pod="opendatahub/test-curl-7138-140442617992800"
Jul 21 21:07:45.499933 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:45.499841    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7138-140442617992800"
Jul 21 21:07:45.643782 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:45.643744    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7138-140442617992800"]
Jul 21 21:07:45.644928 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:45.644905    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 21:07:46.026452 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:46.026395    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7138-140442617992800" event={"ID":"6a503a3a-0fd0-4530-9824-6fcb58271413","Type":"ContainerStarted","Data":"364a0fa21b6c537ae5bc6720acb270e314021a03a592f51695b8298ef734a4d3"}
Jul 21 21:07:47.033740 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:47.033685    2576 generic.go:356] "Generic (PLEG): container finished" podID="6a503a3a-0fd0-4530-9824-6fcb58271413" containerID="99bfeeca6fa1789771e7cfc286698f7f3e7aa1ca6937b3aea4fc7105f15e5d56" exitCode=0
Jul 21 21:07:47.034133 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:47.033756    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7138-140442617992800" event={"ID":"6a503a3a-0fd0-4530-9824-6fcb58271413","Type":"ContainerDied","Data":"99bfeeca6fa1789771e7cfc286698f7f3e7aa1ca6937b3aea4fc7105f15e5d56"}
Jul 21 21:07:48.179722 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:48.179675    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7138-140442617992800"
Jul 21 21:07:48.200730 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:48.200673    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7138-140442617992800_6a503a3a-0fd0-4530-9824-6fcb58271413/test-curl-7138-140442617992800/0.log"
Jul 21 21:07:48.217984 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:48.217953    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9567\" (UniqueName: \"kubernetes.io/projected/6a503a3a-0fd0-4530-9824-6fcb58271413-kube-api-access-f9567\") pod \"6a503a3a-0fd0-4530-9824-6fcb58271413\" (UID: \"6a503a3a-0fd0-4530-9824-6fcb58271413\") "
Jul 21 21:07:48.220353 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:48.220320    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a503a3a-0fd0-4530-9824-6fcb58271413-kube-api-access-f9567" (OuterVolumeSpecName: "kube-api-access-f9567") pod "6a503a3a-0fd0-4530-9824-6fcb58271413" (UID: "6a503a3a-0fd0-4530-9824-6fcb58271413"). InnerVolumeSpecName "kube-api-access-f9567". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:07:48.225683 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:48.225652    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7138-140442617992800"]
Jul 21 21:07:48.229684 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:48.229659    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7138-140442617992800"]
Jul 21 21:07:48.318892 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:48.318806    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9567\" (UniqueName: \"kubernetes.io/projected/6a503a3a-0fd0-4530-9824-6fcb58271413-kube-api-access-f9567\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:07:49.045785 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:49.045758    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="364a0fa21b6c537ae5bc6720acb270e314021a03a592f51695b8298ef734a4d3"
Jul 21 21:07:49.045955 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:49.045808    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7138-140442617992800"
Jul 21 21:07:49.055886 ip-10-0-128-201 kubenswrapper[2576]: E0721 21:07:49.055855    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7138-140442617992800\" is forbidden: User \"system:node:ip-10-0-128-201.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-201.ec2.internal' and this object" podUID="6a503a3a-0fd0-4530-9824-6fcb58271413" pod="opendatahub/test-curl-7138-140442617992800"
Jul 21 21:07:49.650204 ip-10-0-128-201 kubenswrapper[2576]: E0721 21:07:49.650166    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7138-140442617992800\" is forbidden: User \"system:node:ip-10-0-128-201.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-201.ec2.internal' and this object" podUID="6a503a3a-0fd0-4530-9824-6fcb58271413" pod="opendatahub/test-curl-7138-140442617992800"
Jul 21 21:07:49.651385 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:49.651365    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a503a3a-0fd0-4530-9824-6fcb58271413" path="/var/lib/kubelet/pods/6a503a3a-0fd0-4530-9824-6fcb58271413/volumes"
Jul 21 21:07:57.643763 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:07:57.643730    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:08:03.089017 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:03.088941    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:08:03.153840 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:03.153811    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:08:03.708433 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:03.708394    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:08:03.808883 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:03.808849    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:08:03.966289 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:03.966200    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"]
Jul 21 21:08:03.966468 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:03.966438    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw" podUID="f5d81463-ffb6-4688-8288-8258859dc11a" containerName="istio-proxy" containerID="cri-o://9157a8fc0f873a561cac48abbb1d57a000d805f26eeecb6ac5188ad31d59e9be" gracePeriod=30
Jul 21 21:08:03.973951 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:03.973869    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:08:04.194207 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:04.194163    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:08:04.668948 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:04.668917    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:08:09.169004 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.168976    2576 generic.go:356] "Generic (PLEG): container finished" podID="f5d81463-ffb6-4688-8288-8258859dc11a" containerID="9157a8fc0f873a561cac48abbb1d57a000d805f26eeecb6ac5188ad31d59e9be" exitCode=0
Jul 21 21:08:09.169437 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.169045    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw" event={"ID":"f5d81463-ffb6-4688-8288-8258859dc11a","Type":"ContainerDied","Data":"9157a8fc0f873a561cac48abbb1d57a000d805f26eeecb6ac5188ad31d59e9be"}
Jul 21 21:08:09.169437 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.169108    2576 scope.go:117] "RemoveContainer" containerID="7b7269db7cd6573a3ef1f2f4ee010e3827855a564d70ffeba650f1c3dfcf40f3"
Jul 21 21:08:09.236087 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.236020    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:08:09.327070 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.327032    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5d81463-ffb6-4688-8288-8258859dc11a-istio-podinfo\") pod \"f5d81463-ffb6-4688-8288-8258859dc11a\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") "
Jul 21 21:08:09.327257 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.327089    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-istio-envoy\") pod \"f5d81463-ffb6-4688-8288-8258859dc11a\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") "
Jul 21 21:08:09.327257 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.327111    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5d81463-ffb6-4688-8288-8258859dc11a-istiod-ca-cert\") pod \"f5d81463-ffb6-4688-8288-8258859dc11a\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") "
Jul 21 21:08:09.327257 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.327130    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-workload-certs\") pod \"f5d81463-ffb6-4688-8288-8258859dc11a\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") "
Jul 21 21:08:09.327257 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.327173    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-workload-socket\") pod \"f5d81463-ffb6-4688-8288-8258859dc11a\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") "
Jul 21 21:08:09.327257 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.327223    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-istio-data\") pod \"f5d81463-ffb6-4688-8288-8258859dc11a\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") "
Jul 21 21:08:09.327536 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.327258    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5d81463-ffb6-4688-8288-8258859dc11a-istio-token\") pod \"f5d81463-ffb6-4688-8288-8258859dc11a\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") "
Jul 21 21:08:09.327536 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.327300    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tskpv\" (UniqueName: \"kubernetes.io/projected/f5d81463-ffb6-4688-8288-8258859dc11a-kube-api-access-tskpv\") pod \"f5d81463-ffb6-4688-8288-8258859dc11a\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") "
Jul 21 21:08:09.327536 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.327373    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-credential-socket\") pod \"f5d81463-ffb6-4688-8288-8258859dc11a\" (UID: \"f5d81463-ffb6-4688-8288-8258859dc11a\") "
Jul 21 21:08:09.327536 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.327491    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f5d81463-ffb6-4688-8288-8258859dc11a" (UID: "f5d81463-ffb6-4688-8288-8258859dc11a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:08:09.327536 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.327508    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f5d81463-ffb6-4688-8288-8258859dc11a" (UID: "f5d81463-ffb6-4688-8288-8258859dc11a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:08:09.327824 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.327589    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5d81463-ffb6-4688-8288-8258859dc11a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f5d81463-ffb6-4688-8288-8258859dc11a" (UID: "f5d81463-ffb6-4688-8288-8258859dc11a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 21:08:09.327824 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.327744    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f5d81463-ffb6-4688-8288-8258859dc11a" (UID: "f5d81463-ffb6-4688-8288-8258859dc11a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:08:09.327936 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.327906    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-credential-socket\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:08:09.327936 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.327930    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5d81463-ffb6-4688-8288-8258859dc11a-istiod-ca-cert\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:08:09.328047 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.327943    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-workload-certs\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:08:09.328047 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.327956    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-workload-socket\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:08:09.328575 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.328546    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-istio-data" (OuterVolumeSpecName: "istio-data") pod "f5d81463-ffb6-4688-8288-8258859dc11a" (UID: "f5d81463-ffb6-4688-8288-8258859dc11a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:08:09.329633 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.329606    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f5d81463-ffb6-4688-8288-8258859dc11a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f5d81463-ffb6-4688-8288-8258859dc11a" (UID: "f5d81463-ffb6-4688-8288-8258859dc11a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 21:08:09.329633 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.329616    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f5d81463-ffb6-4688-8288-8258859dc11a" (UID: "f5d81463-ffb6-4688-8288-8258859dc11a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:08:09.329780 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.329670    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5d81463-ffb6-4688-8288-8258859dc11a-kube-api-access-tskpv" (OuterVolumeSpecName: "kube-api-access-tskpv") pod "f5d81463-ffb6-4688-8288-8258859dc11a" (UID: "f5d81463-ffb6-4688-8288-8258859dc11a"). InnerVolumeSpecName "kube-api-access-tskpv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:08:09.329851 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.329831    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5d81463-ffb6-4688-8288-8258859dc11a-istio-token" (OuterVolumeSpecName: "istio-token") pod "f5d81463-ffb6-4688-8288-8258859dc11a" (UID: "f5d81463-ffb6-4688-8288-8258859dc11a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:08:09.429380 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.429340    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-istio-data\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:08:09.429380 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.429370    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5d81463-ffb6-4688-8288-8258859dc11a-istio-token\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:08:09.429380 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.429382    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tskpv\" (UniqueName: \"kubernetes.io/projected/f5d81463-ffb6-4688-8288-8258859dc11a-kube-api-access-tskpv\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:08:09.429380 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.429390    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5d81463-ffb6-4688-8288-8258859dc11a-istio-podinfo\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:08:09.429785 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.429398    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5d81463-ffb6-4688-8288-8258859dc11a-istio-envoy\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:08:09.972239 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:09.972153    2576 scope.go:117] "RemoveContainer" containerID="9157a8fc0f873a561cac48abbb1d57a000d805f26eeecb6ac5188ad31d59e9be"
Jul 21 21:08:10.175379 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:10.175335    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw" event={"ID":"f5d81463-ffb6-4688-8288-8258859dc11a","Type":"ContainerDied","Data":"aae8f6c5c084cb413313655cd746a935954c112ea02a1fa4a12e4fc13f7d9836"}
Jul 21 21:08:10.175803 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:10.175404    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"
Jul 21 21:08:10.211764 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:10.211720    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"]
Jul 21 21:08:10.216916 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:10.216884    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-1ad4ca-openshift-default-6bc96c95f-2gstw"]
Jul 21 21:08:10.790919 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:10.790888    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:08:10.892077 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:10.892044    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:08:11.006254 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:11.006220    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"]
Jul 21 21:08:11.006462 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:11.006437    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q" podUID="1c66d874-eb52-451c-91a8-206bd5201d1e" containerName="istio-proxy" containerID="cri-o://2befe5326f74b0e7f12da4391582cdf90e827991e79627b360971cd42be35b26" gracePeriod=30
Jul 21 21:08:11.033863 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:11.033812    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:08:11.226115 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:11.226023    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:08:11.653125 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:11.653093    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5d81463-ffb6-4688-8288-8258859dc11a" path="/var/lib/kubelet/pods/f5d81463-ffb6-4688-8288-8258859dc11a/volumes"
Jul 21 21:08:16.212596 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.212565    2576 generic.go:356] "Generic (PLEG): container finished" podID="1c66d874-eb52-451c-91a8-206bd5201d1e" containerID="2befe5326f74b0e7f12da4391582cdf90e827991e79627b360971cd42be35b26" exitCode=0
Jul 21 21:08:16.213018 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.212635    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q" event={"ID":"1c66d874-eb52-451c-91a8-206bd5201d1e","Type":"ContainerDied","Data":"2befe5326f74b0e7f12da4391582cdf90e827991e79627b360971cd42be35b26"}
Jul 21 21:08:16.213018 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.212745    2576 scope.go:117] "RemoveContainer" containerID="95377eb156ee2bc7260ba4900aae5ed0f9b7f795ddc21652e10261437112e9ba"
Jul 21 21:08:16.275212 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.275146    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:08:16.401876 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.401848    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c66d874-eb52-451c-91a8-206bd5201d1e-istio-podinfo\") pod \"1c66d874-eb52-451c-91a8-206bd5201d1e\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") "
Jul 21 21:08:16.401876 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.401885    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-credential-socket\") pod \"1c66d874-eb52-451c-91a8-206bd5201d1e\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") "
Jul 21 21:08:16.402152 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.401915    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsdgq\" (UniqueName: \"kubernetes.io/projected/1c66d874-eb52-451c-91a8-206bd5201d1e-kube-api-access-nsdgq\") pod \"1c66d874-eb52-451c-91a8-206bd5201d1e\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") "
Jul 21 21:08:16.402152 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.401997    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-istio-data\") pod \"1c66d874-eb52-451c-91a8-206bd5201d1e\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") "
Jul 21 21:08:16.402152 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.402036    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c66d874-eb52-451c-91a8-206bd5201d1e-istiod-ca-cert\") pod \"1c66d874-eb52-451c-91a8-206bd5201d1e\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") "
Jul 21 21:08:16.402152 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.402090    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c66d874-eb52-451c-91a8-206bd5201d1e-istio-token\") pod \"1c66d874-eb52-451c-91a8-206bd5201d1e\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") "
Jul 21 21:08:16.402152 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.402128    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-workload-socket\") pod \"1c66d874-eb52-451c-91a8-206bd5201d1e\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") "
Jul 21 21:08:16.402418 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.402168    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-workload-certs\") pod \"1c66d874-eb52-451c-91a8-206bd5201d1e\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") "
Jul 21 21:08:16.402418 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.402198    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1c66d874-eb52-451c-91a8-206bd5201d1e" (UID: "1c66d874-eb52-451c-91a8-206bd5201d1e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:08:16.402418 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.402211    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-istio-envoy\") pod \"1c66d874-eb52-451c-91a8-206bd5201d1e\" (UID: \"1c66d874-eb52-451c-91a8-206bd5201d1e\") "
Jul 21 21:08:16.402612 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.402572    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1c66d874-eb52-451c-91a8-206bd5201d1e" (UID: "1c66d874-eb52-451c-91a8-206bd5201d1e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:08:16.402701 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.402667    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-credential-socket\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:08:16.402765 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.402640    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c66d874-eb52-451c-91a8-206bd5201d1e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1c66d874-eb52-451c-91a8-206bd5201d1e" (UID: "1c66d874-eb52-451c-91a8-206bd5201d1e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 21:08:16.403060 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.403030    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1c66d874-eb52-451c-91a8-206bd5201d1e" (UID: "1c66d874-eb52-451c-91a8-206bd5201d1e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:08:16.403388 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.403361    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-istio-data" (OuterVolumeSpecName: "istio-data") pod "1c66d874-eb52-451c-91a8-206bd5201d1e" (UID: "1c66d874-eb52-451c-91a8-206bd5201d1e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:08:16.404438 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.404389    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1c66d874-eb52-451c-91a8-206bd5201d1e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1c66d874-eb52-451c-91a8-206bd5201d1e" (UID: "1c66d874-eb52-451c-91a8-206bd5201d1e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 21:08:16.404581 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.404549    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c66d874-eb52-451c-91a8-206bd5201d1e-istio-token" (OuterVolumeSpecName: "istio-token") pod "1c66d874-eb52-451c-91a8-206bd5201d1e" (UID: "1c66d874-eb52-451c-91a8-206bd5201d1e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:08:16.404801 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.404771    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c66d874-eb52-451c-91a8-206bd5201d1e-kube-api-access-nsdgq" (OuterVolumeSpecName: "kube-api-access-nsdgq") pod "1c66d874-eb52-451c-91a8-206bd5201d1e" (UID: "1c66d874-eb52-451c-91a8-206bd5201d1e"). InnerVolumeSpecName "kube-api-access-nsdgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:08:16.404876 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.404804    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1c66d874-eb52-451c-91a8-206bd5201d1e" (UID: "1c66d874-eb52-451c-91a8-206bd5201d1e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:08:16.504088 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.504047    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-workload-socket\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:08:16.504088 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.504080    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-workload-certs\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:08:16.504088 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.504089    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-istio-envoy\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:08:16.504088 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.504097    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c66d874-eb52-451c-91a8-206bd5201d1e-istio-podinfo\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:08:16.504375 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.504105    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsdgq\" (UniqueName: \"kubernetes.io/projected/1c66d874-eb52-451c-91a8-206bd5201d1e-kube-api-access-nsdgq\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:08:16.504375 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.504115    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c66d874-eb52-451c-91a8-206bd5201d1e-istio-data\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:08:16.504375 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.504126    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c66d874-eb52-451c-91a8-206bd5201d1e-istiod-ca-cert\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:08:16.504375 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:16.504135    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c66d874-eb52-451c-91a8-206bd5201d1e-istio-token\") on node \"ip-10-0-128-201.ec2.internal\" DevicePath \"\""
Jul 21 21:08:17.098762 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:17.098728    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-79vlc_804d9d71-4793-4dc1-8e6b-efeebab2810f/manager/0.log"
Jul 21 21:08:17.222594 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:17.222564    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"
Jul 21 21:08:17.223115 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:17.222564    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q" event={"ID":"1c66d874-eb52-451c-91a8-206bd5201d1e","Type":"ContainerDied","Data":"c6a7f9a3cce6d1beb21bc9bea52ef27f6869ebc9b134e7624ee244abf2e153a5"}
Jul 21 21:08:17.223115 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:17.222758    2576 scope.go:117] "RemoveContainer" containerID="2befe5326f74b0e7f12da4391582cdf90e827991e79627b360971cd42be35b26"
Jul 21 21:08:17.223240 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:17.223206    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-m9r6q_346b733b-6a38-4212-bde3-f656f1e81818/manager/0.log"
Jul 21 21:08:17.247432 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:17.247399    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"]
Jul 21 21:08:17.251287 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:17.251260    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-9b964f-openshift-default-c85d99f4c-qrt9q"]
Jul 21 21:08:17.483796 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:17.483714    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ft8wg_86789bc1-c91f-443b-a6d5-a7176a68bb73/server/0.log"
Jul 21 21:08:17.606419 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:17.606390    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-j7dwm_47854321-c87f-4d4e-95f7-7f12b2b0f7ca/manager/0.log"
Jul 21 21:08:17.653724 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:17.653670    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c66d874-eb52-451c-91a8-206bd5201d1e" path="/var/lib/kubelet/pods/1c66d874-eb52-451c-91a8-206bd5201d1e/volumes"
Jul 21 21:08:17.980179 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:17.980147    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk_a1453d50-9dc6-4df3-a2bd-1f0c0a281742/copy-manifests/0.log"
Jul 21 21:08:17.986816 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:17.986788    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk_a1453d50-9dc6-4df3-a2bd-1f0c0a281742/manager/0.log"
Jul 21 21:08:18.732082 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:18.732051    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-api-a-04e869-664f988c5-z7h9k_bdac95cb-fd78-4201-a51a-0ca323b2c87f/maas-api/0.log"
Jul 21 21:08:19.692875 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:19.692845    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-shared-a-1ad4ca-66cf5cfb58-qpll9_1248e5fb-d7f3-431b-832b-a54246297997/maas-api/0.log"
Jul 21 21:08:19.810125 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:19.810088    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-shared-b-9b964f-7f6b587785-7z629_04f69d7a-fd6c-484b-ae89-f335473f381b/maas-api/0.log"
Jul 21 21:08:19.922188 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:19.922161    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29744430-92bpg_b671a4f5-b9bc-47f7-a7f3-28c9771b5401/cleanup/0.log"
Jul 21 21:08:20.038533 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:20.038507    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29744445-vgtw9_0c502475-4e24-42f5-b048-06f5cf182ed9/cleanup/0.log"
Jul 21 21:08:20.147172 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:20.147142    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29744460-94gfb_9f299eae-f722-47be-98d2-436512624278/cleanup/0.log"
Jul 21 21:08:20.263217 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:20.263185    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-ait-672ca14c-29744460-r4vjg_620a3ff8-d7d5-44ea-a370-36ff4c351f83/cleanup/0.log"
Jul 21 21:08:20.606642 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:20.606607    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-inf-a-2ba36e-29744460-6cg8f_6a5460b5-f592-4430-9d56-f79831b5ee12/cleanup/0.log"
Jul 21 21:08:20.722375 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:20.722343    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-inf-b-351a5d-29744460-5xk5x_d79ac56b-6fbe-403e-bc3c-3788809c114f/cleanup/0.log"
Jul 21 21:08:20.836676 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:20.836638    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-migrate-868c4ca9-29744460-qs5n8_027a86eb-2934-4cc6-b95c-f28581009e35/cleanup/0.log"
Jul 21 21:08:20.944956 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:20.944880    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-mt-83e6600b-29744460-k9kmt_b54b7992-9f8b-4c35-a4fa-59f6be2a9d6b/cleanup/0.log"
Jul 21 21:08:21.055222 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:21.055183    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-mt-e7adb3ea-29744460-rlbrh_c71f251d-a850-4878-a050-5020c0089861/cleanup/0.log"
Jul 21 21:08:22.516703 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:22.516656    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wdqps_35b3a7fb-d981-48ba-b81b-b4adfe9bde5e/manager/0.log"
Jul 21 21:08:22.631332 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:22.631300    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-4v7vb_c1002ac0-c600-4537-b23f-e5cbe0567091/manager/0.log"
Jul 21 21:08:22.737723 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:22.737658    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-pz5fz_9a3a602d-3121-4018-aabb-0d58f39e795f/kuadrant-console-plugin/0.log"
Jul 21 21:08:22.849410 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:22.849327    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-54np5_c2f42ac6-8028-470f-94de-ec2abfb65d2e/registry-server/0.log"
Jul 21 21:08:22.968486 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:22.968454    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-wlnzc_6f410cdc-8371-43fd-8e23-97af02ffe2f8/manager/0.log"
Jul 21 21:08:23.201583 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:23.201503    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7qm8r_7b753179-05f2-42c1-98f8-8a69b464e793/manager/0.log"
Jul 21 21:08:23.548316 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:23.548288    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4sgr65_fedda947-c0a8-4c66-8fd7-c593c16b66a6/istio-proxy/0.log"
Jul 21 21:08:23.787501 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:23.787472    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-567c747899-qh6vd_b5b5b76c-cf49-4413-9bc3-633c4f1d1087/kube-auth-proxy/0.log"
Jul 21 21:08:24.037244 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:24.037209    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mblp4_f1f31d79-4f75-4116-ace5-592dfda94493/istio-proxy/1.log"
Jul 21 21:08:24.420346 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:24.420260    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b5b675cf6-8dh6k_736f340d-c51f-430c-927b-313fffbe0f68/router/0.log"
Jul 21 21:08:25.006225 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:25.006191    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-xbcqr_e3d2a55a-0560-4afc-b9ac-cf7e363c4cb1/main/0.log"
Jul 21 21:08:25.260385 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:25.260306    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-n7mb8_6e882580-1e73-4620-b33e-a9b535cdad5c/main/0.log"
Jul 21 21:08:30.425051 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:30.425015    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:08:30.519741 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:30.519679    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log" limit=1024
Jul 21 21:08:33.272803 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:33.272778    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7fmhc_329479f3-ad8b-4d55-8902-fd524ced9b32/global-pull-secret-syncer/0.log"
Jul 21 21:08:33.422997 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:33.422966    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-46pn7_abe5ed79-25df-4e07-a3b4-c8014119e03e/konnectivity-agent/0.log"
Jul 21 21:08:33.529423 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:33.529343    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-201.ec2.internal_c92ea5607a4c49d38cbe93e974df244d/haproxy/0.log"
Jul 21 21:08:39.529097 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:39.529065    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wdqps_35b3a7fb-d981-48ba-b81b-b4adfe9bde5e/manager/0.log"
Jul 21 21:08:39.560252 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:39.560210    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-4v7vb_c1002ac0-c600-4537-b23f-e5cbe0567091/manager/0.log"
Jul 21 21:08:39.588302 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:39.588243    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-pz5fz_9a3a602d-3121-4018-aabb-0d58f39e795f/kuadrant-console-plugin/0.log"
Jul 21 21:08:39.639708 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:39.639653    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-54np5_c2f42ac6-8028-470f-94de-ec2abfb65d2e/registry-server/0.log"
Jul 21 21:08:39.862315 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:39.862227    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-wlnzc_6f410cdc-8371-43fd-8e23-97af02ffe2f8/manager/0.log"
Jul 21 21:08:39.981358 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:39.981324    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7qm8r_7b753179-05f2-42c1-98f8-8a69b464e793/manager/0.log"
Jul 21 21:08:41.551609 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:41.551573    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e88681af-cbca-4796-b909-ccb5e2a930c3/alertmanager/0.log"
Jul 21 21:08:41.579646 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:41.579615    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e88681af-cbca-4796-b909-ccb5e2a930c3/config-reloader/0.log"
Jul 21 21:08:41.604901 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:41.604829    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e88681af-cbca-4796-b909-ccb5e2a930c3/kube-rbac-proxy-web/0.log"
Jul 21 21:08:41.630685 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:41.630661    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e88681af-cbca-4796-b909-ccb5e2a930c3/kube-rbac-proxy/0.log"
Jul 21 21:08:41.656641 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:41.656612    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e88681af-cbca-4796-b909-ccb5e2a930c3/kube-rbac-proxy-metric/0.log"
Jul 21 21:08:41.681325 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:41.681296    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e88681af-cbca-4796-b909-ccb5e2a930c3/prom-label-proxy/0.log"
Jul 21 21:08:41.706477 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:41.706438    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e88681af-cbca-4796-b909-ccb5e2a930c3/init-config-reloader/0.log"
Jul 21 21:08:41.888436 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:41.888405    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-zn7kf_097cf97f-e669-4efd-80be-6962502529fb/monitoring-plugin/0.log"
Jul 21 21:08:42.080706 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:42.080669    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vfdbh_e66a2c6b-c268-41f4-bded-727ee846c342/node-exporter/0.log"
Jul 21 21:08:42.106383 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:42.106352    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vfdbh_e66a2c6b-c268-41f4-bded-727ee846c342/kube-rbac-proxy/0.log"
Jul 21 21:08:42.128642 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:42.128569    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vfdbh_e66a2c6b-c268-41f4-bded-727ee846c342/init-textfile/0.log"
Jul 21 21:08:42.252540 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:42.252511    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e4061785-d49e-4e3c-88c8-62c0bbf0f933/prometheus/0.log"
Jul 21 21:08:42.279652 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:42.279626    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e4061785-d49e-4e3c-88c8-62c0bbf0f933/config-reloader/0.log"
Jul 21 21:08:42.308371 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:42.308342    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e4061785-d49e-4e3c-88c8-62c0bbf0f933/thanos-sidecar/0.log"
Jul 21 21:08:42.338503 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:42.338479    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e4061785-d49e-4e3c-88c8-62c0bbf0f933/kube-rbac-proxy-web/0.log"
Jul 21 21:08:42.365429 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:42.365400    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e4061785-d49e-4e3c-88c8-62c0bbf0f933/kube-rbac-proxy/0.log"
Jul 21 21:08:42.394181 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:42.394103    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e4061785-d49e-4e3c-88c8-62c0bbf0f933/kube-rbac-proxy-thanos/0.log"
Jul 21 21:08:42.418855 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:42.418831    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e4061785-d49e-4e3c-88c8-62c0bbf0f933/init-config-reloader/0.log"
Jul 21 21:08:43.368132 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.368095    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jgpxl/perf-node-gather-daemonset-5r88l"]
Jul 21 21:08:43.368564 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.368551    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a503a3a-0fd0-4530-9824-6fcb58271413" containerName="test-curl-7138-140442617992800"
Jul 21 21:08:43.368617 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.368566    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a503a3a-0fd0-4530-9824-6fcb58271413" containerName="test-curl-7138-140442617992800"
Jul 21 21:08:43.368617 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.368582    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5d81463-ffb6-4688-8288-8258859dc11a" containerName="istio-proxy"
Jul 21 21:08:43.368617 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.368588    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5d81463-ffb6-4688-8288-8258859dc11a" containerName="istio-proxy"
Jul 21 21:08:43.368617 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.368599    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c66d874-eb52-451c-91a8-206bd5201d1e" containerName="istio-proxy"
Jul 21 21:08:43.368617 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.368604    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c66d874-eb52-451c-91a8-206bd5201d1e" containerName="istio-proxy"
Jul 21 21:08:43.368617 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.368616    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c66d874-eb52-451c-91a8-206bd5201d1e" containerName="istio-proxy"
Jul 21 21:08:43.368839 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.368620    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c66d874-eb52-451c-91a8-206bd5201d1e" containerName="istio-proxy"
Jul 21 21:08:43.368839 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.368628    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5d81463-ffb6-4688-8288-8258859dc11a" containerName="istio-proxy"
Jul 21 21:08:43.368839 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.368633    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5d81463-ffb6-4688-8288-8258859dc11a" containerName="istio-proxy"
Jul 21 21:08:43.368839 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.368725    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c66d874-eb52-451c-91a8-206bd5201d1e" containerName="istio-proxy"
Jul 21 21:08:43.368839 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.368733    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a503a3a-0fd0-4530-9824-6fcb58271413" containerName="test-curl-7138-140442617992800"
Jul 21 21:08:43.368839 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.368740    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5d81463-ffb6-4688-8288-8258859dc11a" containerName="istio-proxy"
Jul 21 21:08:43.368839 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.368746    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5d81463-ffb6-4688-8288-8258859dc11a" containerName="istio-proxy"
Jul 21 21:08:43.371671 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.371653    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-5r88l"
Jul 21 21:08:43.374140 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.374113    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jgpxl\"/\"openshift-service-ca.crt\""
Jul 21 21:08:43.374279 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.374137    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jgpxl\"/\"kube-root-ca.crt\""
Jul 21 21:08:43.374858 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.374845    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jgpxl\"/\"default-dockercfg-kgt6b\""
Jul 21 21:08:43.382108 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.382081    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jgpxl/perf-node-gather-daemonset-5r88l"]
Jul 21 21:08:43.469566 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.469528    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/80723929-3cd4-49f9-ae1a-3cd77ff5e6f2-proc\") pod \"perf-node-gather-daemonset-5r88l\" (UID: \"80723929-3cd4-49f9-ae1a-3cd77ff5e6f2\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-5r88l"
Jul 21 21:08:43.469774 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.469599    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80723929-3cd4-49f9-ae1a-3cd77ff5e6f2-sys\") pod \"perf-node-gather-daemonset-5r88l\" (UID: \"80723929-3cd4-49f9-ae1a-3cd77ff5e6f2\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-5r88l"
Jul 21 21:08:43.469774 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.469628    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80723929-3cd4-49f9-ae1a-3cd77ff5e6f2-lib-modules\") pod \"perf-node-gather-daemonset-5r88l\" (UID: \"80723929-3cd4-49f9-ae1a-3cd77ff5e6f2\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-5r88l"
Jul 21 21:08:43.469774 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.469756    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/80723929-3cd4-49f9-ae1a-3cd77ff5e6f2-podres\") pod \"perf-node-gather-daemonset-5r88l\" (UID: \"80723929-3cd4-49f9-ae1a-3cd77ff5e6f2\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-5r88l"
Jul 21 21:08:43.469884 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.469797    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw8vv\" (UniqueName: \"kubernetes.io/projected/80723929-3cd4-49f9-ae1a-3cd77ff5e6f2-kube-api-access-dw8vv\") pod \"perf-node-gather-daemonset-5r88l\" (UID: \"80723929-3cd4-49f9-ae1a-3cd77ff5e6f2\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-5r88l"
Jul 21 21:08:43.570336 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.570298    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80723929-3cd4-49f9-ae1a-3cd77ff5e6f2-lib-modules\") pod \"perf-node-gather-daemonset-5r88l\" (UID: \"80723929-3cd4-49f9-ae1a-3cd77ff5e6f2\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-5r88l"
Jul 21 21:08:43.570520 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.570373    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/80723929-3cd4-49f9-ae1a-3cd77ff5e6f2-podres\") pod \"perf-node-gather-daemonset-5r88l\" (UID: \"80723929-3cd4-49f9-ae1a-3cd77ff5e6f2\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-5r88l"
Jul 21 21:08:43.570520 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.570403    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw8vv\" (UniqueName: \"kubernetes.io/projected/80723929-3cd4-49f9-ae1a-3cd77ff5e6f2-kube-api-access-dw8vv\") pod \"perf-node-gather-daemonset-5r88l\" (UID: \"80723929-3cd4-49f9-ae1a-3cd77ff5e6f2\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-5r88l"
Jul 21 21:08:43.570520 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.570433    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/80723929-3cd4-49f9-ae1a-3cd77ff5e6f2-proc\") pod \"perf-node-gather-daemonset-5r88l\" (UID: \"80723929-3cd4-49f9-ae1a-3cd77ff5e6f2\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-5r88l"
Jul 21 21:08:43.570520 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.570481    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80723929-3cd4-49f9-ae1a-3cd77ff5e6f2-sys\") pod \"perf-node-gather-daemonset-5r88l\" (UID: \"80723929-3cd4-49f9-ae1a-3cd77ff5e6f2\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-5r88l"
Jul 21 21:08:43.570520 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.570505    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/80723929-3cd4-49f9-ae1a-3cd77ff5e6f2-lib-modules\") pod \"perf-node-gather-daemonset-5r88l\" (UID: \"80723929-3cd4-49f9-ae1a-3cd77ff5e6f2\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-5r88l"
Jul 21 21:08:43.570736 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.570532    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/80723929-3cd4-49f9-ae1a-3cd77ff5e6f2-proc\") pod \"perf-node-gather-daemonset-5r88l\" (UID: \"80723929-3cd4-49f9-ae1a-3cd77ff5e6f2\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-5r88l"
Jul 21 21:08:43.570736 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.570565    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80723929-3cd4-49f9-ae1a-3cd77ff5e6f2-sys\") pod \"perf-node-gather-daemonset-5r88l\" (UID: \"80723929-3cd4-49f9-ae1a-3cd77ff5e6f2\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-5r88l"
Jul 21 21:08:43.570736 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.570565    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/80723929-3cd4-49f9-ae1a-3cd77ff5e6f2-podres\") pod \"perf-node-gather-daemonset-5r88l\" (UID: \"80723929-3cd4-49f9-ae1a-3cd77ff5e6f2\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-5r88l"
Jul 21 21:08:43.579180 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.579153    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw8vv\" (UniqueName: \"kubernetes.io/projected/80723929-3cd4-49f9-ae1a-3cd77ff5e6f2-kube-api-access-dw8vv\") pod \"perf-node-gather-daemonset-5r88l\" (UID: \"80723929-3cd4-49f9-ae1a-3cd77ff5e6f2\") " pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-5r88l"
Jul 21 21:08:43.683074 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.682975    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-5r88l"
Jul 21 21:08:43.831469 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:43.831438    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jgpxl/perf-node-gather-daemonset-5r88l"]
Jul 21 21:08:43.832913 ip-10-0-128-201 kubenswrapper[2576]: W0721 21:08:43.832876    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod80723929_3cd4_49f9_ae1a_3cd77ff5e6f2.slice/crio-9215feba495d529a2a0c1d0c9b9698d758bcf6a77a7f1ea0e07887b146eb582e WatchSource:0}: Error finding container 9215feba495d529a2a0c1d0c9b9698d758bcf6a77a7f1ea0e07887b146eb582e: Status 404 returned error can't find the container with id 9215feba495d529a2a0c1d0c9b9698d758bcf6a77a7f1ea0e07887b146eb582e
Jul 21 21:08:44.374077 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:44.374041    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-5r88l" event={"ID":"80723929-3cd4-49f9-ae1a-3cd77ff5e6f2","Type":"ContainerStarted","Data":"3689661a6bfb9ccd0537087477f10a5a8c34a2ccdc50271f949ea8209055eb8b"}
Jul 21 21:08:44.374476 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:44.374097    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-5r88l" event={"ID":"80723929-3cd4-49f9-ae1a-3cd77ff5e6f2","Type":"ContainerStarted","Data":"9215feba495d529a2a0c1d0c9b9698d758bcf6a77a7f1ea0e07887b146eb582e"}
Jul 21 21:08:44.374476 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:44.374127    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-5r88l"
Jul 21 21:08:44.393127 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:44.393069    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-5r88l" podStartSLOduration=1.393051773 podStartE2EDuration="1.393051773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 21:08:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:08:44.392610621 +0000 UTC m=+3275.325008778" watchObservedRunningTime="2026-07-21 21:08:44.393051773 +0000 UTC m=+3275.325449952"
Jul 21 21:08:44.477335 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:44.477287    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w885b_62db291a-14b7-4e35-9550-9fb810f82b8d/console-operator/1.log"
Jul 21 21:08:44.482023 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:44.481997    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-w885b_62db291a-14b7-4e35-9550-9fb810f82b8d/console-operator/2.log"
Jul 21 21:08:46.662577 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:46.662546    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-666gc_835a703c-f349-475e-b945-9291e474ad83/dns/0.log"
Jul 21 21:08:46.687938 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:46.687910    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-666gc_835a703c-f349-475e-b945-9291e474ad83/kube-rbac-proxy/0.log"
Jul 21 21:08:46.883974 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:46.883944    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tttht_38dce886-864e-4891-aa0c-80b892634b99/dns-node-resolver/0.log"
Jul 21 21:08:47.494833 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:47.494796    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6956754d67-pfgpq_a084aa9c-59d0-484b-a16d-ee606fb51418/registry/0.log"
Jul 21 21:08:47.568340 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:47.568313    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j55fg_20c1b2ab-1a68-456f-bf0c-53417e458643/node-ca/0.log"
Jul 21 21:08:48.550538 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:48.550498    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4sgr65_fedda947-c0a8-4c66-8fd7-c593c16b66a6/istio-proxy/0.log"
Jul 21 21:08:48.765408 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:48.765376    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-567c747899-qh6vd_b5b5b76c-cf49-4413-9bc3-633c4f1d1087/kube-auth-proxy/0.log"
Jul 21 21:08:48.825116 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:48.825036    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mblp4_f1f31d79-4f75-4116-ace5-592dfda94493/istio-proxy/0.log"
Jul 21 21:08:48.853872 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:48.853837    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mblp4_f1f31d79-4f75-4116-ace5-592dfda94493/istio-proxy/1.log"
Jul 21 21:08:48.956060 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:48.956021    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b5b675cf6-8dh6k_736f340d-c51f-430c-927b-313fffbe0f68/router/0.log"
Jul 21 21:08:49.675557 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:49.675527    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dnn52_e23c3058-7bcf-4207-878a-1fb665d74d22/serve-healthcheck-canary/0.log"
Jul 21 21:08:50.302820 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:50.302791    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bhw49_ea8468e5-954c-4015-8e56-626f7db866a1/kube-rbac-proxy/0.log"
Jul 21 21:08:50.326232 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:50.326206    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bhw49_ea8468e5-954c-4015-8e56-626f7db866a1/exporter/0.log"
Jul 21 21:08:50.351209 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:50.351179    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bhw49_ea8468e5-954c-4015-8e56-626f7db866a1/extractor/0.log"
Jul 21 21:08:50.390032 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:50.390006    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jgpxl/perf-node-gather-daemonset-5r88l"
Jul 21 21:08:52.899396 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:52.899368    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-79vlc_804d9d71-4793-4dc1-8e6b-efeebab2810f/manager/0.log"
Jul 21 21:08:53.042167 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:53.042129    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-m9r6q_346b733b-6a38-4212-bde3-f656f1e81818/manager/0.log"
Jul 21 21:08:53.250587 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:53.250554    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ft8wg_86789bc1-c91f-443b-a6d5-a7176a68bb73/server/0.log"
Jul 21 21:08:53.322839 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:53.322806    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-j7dwm_47854321-c87f-4d4e-95f7-7f12b2b0f7ca/manager/0.log"
Jul 21 21:08:53.556943 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:53.556904    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk_a1453d50-9dc6-4df3-a2bd-1f0c0a281742/manager/0.log"
Jul 21 21:08:53.581258 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:53.581233    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b9bbc76fb-kgtjk_a1453d50-9dc6-4df3-a2bd-1f0c0a281742/copy-manifests/0.log"
Jul 21 21:08:54.187088 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:54.187061    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4sgr65_fedda947-c0a8-4c66-8fd7-c593c16b66a6/istio-proxy/0.log"
Jul 21 21:08:54.383536 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:54.383508    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-567c747899-qh6vd_b5b5b76c-cf49-4413-9bc3-633c4f1d1087/kube-auth-proxy/0.log"
Jul 21 21:08:54.418745 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:54.418715    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mblp4_f1f31d79-4f75-4116-ace5-592dfda94493/istio-proxy/0.log"
Jul 21 21:08:54.447248 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:54.447159    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mblp4_f1f31d79-4f75-4116-ace5-592dfda94493/istio-proxy/1.log"
Jul 21 21:08:54.518957 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:54.518921    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b5b675cf6-8dh6k_736f340d-c51f-430c-927b-313fffbe0f68/router/0.log"
Jul 21 21:08:55.816590 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:55.816556    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4sgr65_fedda947-c0a8-4c66-8fd7-c593c16b66a6/istio-proxy/0.log"
Jul 21 21:08:56.025429 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:56.025384    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-567c747899-qh6vd_b5b5b76c-cf49-4413-9bc3-633c4f1d1087/kube-auth-proxy/0.log"
Jul 21 21:08:56.066408 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:56.066373    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mblp4_f1f31d79-4f75-4116-ace5-592dfda94493/istio-proxy/0.log"
Jul 21 21:08:56.093003 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:56.092919    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mblp4_f1f31d79-4f75-4116-ace5-592dfda94493/istio-proxy/1.log"
Jul 21 21:08:56.164497 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:56.164468    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b5b675cf6-8dh6k_736f340d-c51f-430c-927b-313fffbe0f68/router/0.log"
Jul 21 21:08:59.173095 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:59.173049    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fq5td"]
Jul 21 21:08:59.174188 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:59.174159    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c66d874-eb52-451c-91a8-206bd5201d1e" containerName="istio-proxy"
Jul 21 21:08:59.183191 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:59.183164    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fq5td"
Jul 21 21:08:59.183346 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:59.183192    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fq5td"]
Jul 21 21:08:59.227902 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:59.227868    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zpcp\" (UniqueName: \"kubernetes.io/projected/454358b6-dbf4-4c19-924f-c83678e9b270-kube-api-access-7zpcp\") pod \"kuadrant-operator-catalog-fq5td\" (UID: \"454358b6-dbf4-4c19-924f-c83678e9b270\") " pod="kuadrant-system/kuadrant-operator-catalog-fq5td"
Jul 21 21:08:59.329203 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:59.329158    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zpcp\" (UniqueName: \"kubernetes.io/projected/454358b6-dbf4-4c19-924f-c83678e9b270-kube-api-access-7zpcp\") pod \"kuadrant-operator-catalog-fq5td\" (UID: \"454358b6-dbf4-4c19-924f-c83678e9b270\") " pod="kuadrant-system/kuadrant-operator-catalog-fq5td"
Jul 21 21:08:59.338650 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:59.338622    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zpcp\" (UniqueName: \"kubernetes.io/projected/454358b6-dbf4-4c19-924f-c83678e9b270-kube-api-access-7zpcp\") pod \"kuadrant-operator-catalog-fq5td\" (UID: \"454358b6-dbf4-4c19-924f-c83678e9b270\") " pod="kuadrant-system/kuadrant-operator-catalog-fq5td"
Jul 21 21:08:59.493591 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:59.493499    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fq5td"
Jul 21 21:08:59.648572 ip-10-0-128-201 kubenswrapper[2576]: W0721 21:08:59.648546    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod454358b6_dbf4_4c19_924f_c83678e9b270.slice/crio-d0ac3b86e73575b6d9d6d51c81c645f197ae3def3a2947d90079183771573f8a WatchSource:0}: Error finding container d0ac3b86e73575b6d9d6d51c81c645f197ae3def3a2947d90079183771573f8a: Status 404 returned error can't find the container with id d0ac3b86e73575b6d9d6d51c81c645f197ae3def3a2947d90079183771573f8a
Jul 21 21:08:59.653497 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:08:59.653475    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fq5td"]
Jul 21 21:09:00.466169 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:09:00.466129    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fq5td" event={"ID":"454358b6-dbf4-4c19-924f-c83678e9b270","Type":"ContainerStarted","Data":"56f93958203e1a899ada1dbe6c61fdc06e4c12652c5c83203479ae0a449e49b0"}
Jul 21 21:09:00.466623 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:09:00.466191    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fq5td" event={"ID":"454358b6-dbf4-4c19-924f-c83678e9b270","Type":"ContainerStarted","Data":"d0ac3b86e73575b6d9d6d51c81c645f197ae3def3a2947d90079183771573f8a"}
Jul 21 21:09:00.485450 ip-10-0-128-201 kubenswrapper[2576]: I0721 21:09:00.485399    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-fq5td" podStartSLOduration=1.153688598 podStartE2EDuration="1.485382142s" totalImagesPullingTime="331.693544ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:08:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:09:00.483224826 +0000 UTC m=+3291.415622973" watchObservedRunningTime="2026-07-21 21:09:00.485382142 +0000 UTC m=+3291.417780310"