Jul 07 17:51:41.854323 ip-10-0-128-53 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 07 17:51:41.854336 ip-10-0-128-53 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 07 17:51:41.854344 ip-10-0-128-53 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 07 17:51:41.854641 ip-10-0-128-53 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 07 17:51:52.103513 ip-10-0-128-53 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 07 17:51:52.103528 ip-10-0-128-53 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 0ba54d131f4042789cdc837620148d81 --
Jul 07 17:53:29.131151 ip-10-0-128-53 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 17:53:29.564952 ip-10-0-128-53 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 17:53:29.564952 ip-10-0-128-53 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 17:53:29.564952 ip-10-0-128-53 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 17:53:29.564952 ip-10-0-128-53 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 17:53:29.564952 ip-10-0-128-53 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 17:53:29.566868 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.566704    2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 17:53:29.575165 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575134    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:53:29.575165 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575158    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:53:29.575165 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575163    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:53:29.575165 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575169    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:53:29.575165 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575173    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:53:29.575462 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575178    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:53:29.575462 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575182    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:53:29.575462 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575186    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:53:29.575462 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575197    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:53:29.575462 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575202    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:53:29.575462 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575207    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:53:29.575462 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575211    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:53:29.575462 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575215    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:53:29.575462 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575219    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:53:29.575462 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575224    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:53:29.575462 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575229    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:53:29.575462 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575233    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:53:29.575462 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575237    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:53:29.575462 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575241    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:53:29.575462 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575245    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:53:29.575462 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575254    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:53:29.575462 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575258    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:53:29.575462 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575262    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:53:29.575462 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575266    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:53:29.576273 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575270    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:53:29.576273 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575274    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:53:29.576273 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575278    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:53:29.576273 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575282    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:53:29.576273 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575286    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:53:29.576273 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575291    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:53:29.576273 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575295    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:53:29.576273 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575304    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:53:29.576273 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575316    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:53:29.576273 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575321    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:53:29.576273 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575326    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:53:29.576273 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575331    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:53:29.576273 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575336    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:53:29.576273 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575342    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:53:29.576273 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575347    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:53:29.576273 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575352    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:53:29.576273 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575357    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:53:29.576273 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575361    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:53:29.576273 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575366    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:53:29.576273 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575371    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:53:29.577119 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575379    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:53:29.577119 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575384    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:53:29.577119 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575389    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:53:29.577119 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575399    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:53:29.577119 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575405    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:53:29.577119 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575409    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:53:29.577119 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575414    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:53:29.577119 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575418    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:53:29.577119 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575422    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:53:29.577119 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575427    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:53:29.577119 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575431    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:53:29.577119 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575440    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:53:29.577119 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575444    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:53:29.577119 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575448    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:53:29.577119 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575453    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:53:29.577119 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575457    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:53:29.577119 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575461    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:53:29.577119 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575466    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:53:29.577119 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575471    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:53:29.577119 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575475    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:53:29.577668 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575480    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:53:29.577668 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575484    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:53:29.577668 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575489    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:53:29.577668 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575493    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:53:29.577668 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575502    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:53:29.577668 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575509    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:53:29.577668 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575514    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:53:29.577668 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575518    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:53:29.577668 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575523    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:53:29.577668 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575527    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:53:29.577668 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575532    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:53:29.577668 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575552    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:53:29.577668 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575557    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:53:29.577668 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575561    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:53:29.577668 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575565    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:53:29.577668 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575570    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:53:29.577668 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575576    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:53:29.577668 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575585    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:53:29.577668 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575589    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:53:29.578200 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575593    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:53:29.578200 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575598    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:53:29.578200 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575603    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:53:29.578200 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575607    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:53:29.578200 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575611    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:53:29.578200 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575615    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:53:29.578200 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575620    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:53:29.578200 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575624    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:53:29.578200 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575628    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:53:29.578200 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575633    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:53:29.578200 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575642    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:53:29.578200 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575646    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:53:29.578200 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575650    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:53:29.578200 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575655    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:53:29.578200 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575659    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:53:29.578200 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.575664    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:53:29.578867 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578617    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:53:29.578867 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578629    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:53:29.578867 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578636    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:53:29.578867 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578642    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:53:29.578867 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578649    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:53:29.578867 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578653    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:53:29.578867 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578658    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:53:29.578867 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578662    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:53:29.578867 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578667    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:53:29.578867 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578671    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:53:29.578867 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578675    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:53:29.578867 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578679    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:53:29.578867 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578683    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:53:29.578867 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578687    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:53:29.578867 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578692    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:53:29.578867 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578696    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:53:29.578867 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578701    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:53:29.578867 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578705    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:53:29.578867 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578709    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:53:29.578867 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578713    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:53:29.579766 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578717    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:53:29.579766 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578721    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:53:29.579766 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578725    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:53:29.579766 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578729    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:53:29.579766 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578733    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:53:29.579766 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578737    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:53:29.579766 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578742    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:53:29.579766 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578746    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:53:29.579766 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578750    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:53:29.579766 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578754    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:53:29.579766 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578758    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:53:29.579766 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578763    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:53:29.579766 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578767    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:53:29.579766 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578772    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:53:29.579766 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578776    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:53:29.579766 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578781    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:53:29.579766 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578785    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:53:29.579766 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578789    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:53:29.579766 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578794    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:53:29.579766 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578798    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:53:29.580652 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578802    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:53:29.580652 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578806    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:53:29.580652 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578814    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:53:29.580652 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578840    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:53:29.580652 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578845    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:53:29.580652 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578849    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:53:29.580652 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578854    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:53:29.580652 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578858    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:53:29.580652 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578862    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:53:29.580652 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578866    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:53:29.580652 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578871    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:53:29.580652 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578875    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:53:29.580652 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578879    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:53:29.580652 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578884    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:53:29.580652 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578888    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:53:29.580652 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578892    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:53:29.580652 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578896    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:53:29.580652 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578900    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:53:29.580652 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578904    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:53:29.581509 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578908    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:53:29.581509 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578913    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:53:29.581509 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578917    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:53:29.581509 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578922    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:53:29.581509 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578926    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:53:29.581509 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578930    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:53:29.581509 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578934    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:53:29.581509 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578938    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:53:29.581509 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578943    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:53:29.581509 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578947    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:53:29.581509 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578951    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:53:29.581509 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578955    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:53:29.581509 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578959    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:53:29.581509 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578963    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:53:29.581509 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578967    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:53:29.581509 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578971    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:53:29.581509 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578975    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:53:29.581509 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578980    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:53:29.581509 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578985    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:53:29.581509 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578993    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:53:29.582510 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.578997    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:53:29.582510 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579002    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:53:29.582510 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579007    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:53:29.582510 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579011    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:53:29.582510 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579044    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:53:29.582510 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579052    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:53:29.582510 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579058    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:53:29.582510 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579063    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:53:29.582510 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579068    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:53:29.582510 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579072    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:53:29.582510 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579077    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:53:29.582510 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579082    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:53:29.582510 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579086    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:53:29.582510 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579092    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:53:29.582510 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579096    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:53:29.582510 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579100    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:53:29.582510 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579105    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:53:29.582510 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579109    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:53:29.582510 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579115    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:53:29.583231 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579119    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:53:29.583231 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579756    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:53:29.583231 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579766    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:53:29.583231 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579771    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:53:29.583231 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579775    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:53:29.583231 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579779    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:53:29.583231 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579783    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:53:29.583231 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579787    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:53:29.583231 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579791    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:53:29.583231 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579795    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:53:29.583231 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579799    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:53:29.583231 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579803    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:53:29.583231 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579807    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:53:29.583231 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579812    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:53:29.583231 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579816    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:53:29.583231 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579841    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:53:29.583231 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579846    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:53:29.583231 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579851    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:53:29.583231 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579855    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:53:29.583728 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579859    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:53:29.583728 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579863    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:53:29.583728 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579867    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:53:29.583728 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579872    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:53:29.583728 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579876    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:53:29.583728 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579880    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:53:29.583728 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579885    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:53:29.583728 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579889    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:53:29.583728 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579893    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:53:29.583728 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579898    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:53:29.583728 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579916    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:53:29.583728 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579946    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:53:29.583728 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579954    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:53:29.583728 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579960    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:53:29.583728 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579965    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:53:29.583728 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579970    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:53:29.583728 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579974    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:53:29.583728 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579978    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:53:29.583728 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579982    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:53:29.584203 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579986    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:53:29.584203 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579992    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:53:29.584203 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.579996    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:53:29.584203 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580000    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:53:29.584203 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580004    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:53:29.584203 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580009    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:53:29.584203 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580013    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:53:29.584203 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580017    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:53:29.584203 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580021    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:53:29.584203 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580026    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:53:29.584203 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580030    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:53:29.584203 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580035    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:53:29.584203 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580040    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:53:29.584203 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580044    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:53:29.584203 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580049    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:53:29.584203 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580053    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:53:29.584203 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580057    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:53:29.584203 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580061    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:53:29.584203 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580065    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:53:29.584203 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580069    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:53:29.584794 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580073    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:53:29.584794 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580077    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:53:29.584794 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580082    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:53:29.584794 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580086    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:53:29.584794 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580090    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:53:29.584794 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580094    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:53:29.584794 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580098    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:53:29.584794 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580102    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:53:29.584794 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580107    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:53:29.584794 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580111    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:53:29.584794 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580115    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:53:29.584794 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580119    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:53:29.584794 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580123    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:53:29.584794 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580127    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:53:29.584794 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580131    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:53:29.584794 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580138    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:53:29.584794 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580142    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:53:29.584794 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580146    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:53:29.584794 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580150    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:53:29.584794 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580154    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:53:29.585306 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580159    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:53:29.585306 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580165    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:53:29.585306 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580171    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:53:29.585306 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580175    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:53:29.585306 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580179    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:53:29.585306 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580184    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:53:29.585306 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580188    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:53:29.585306 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580192    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:53:29.585306 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580197    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:53:29.585306 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580201    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:53:29.585306 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580205    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:53:29.585306 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580209    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:53:29.585306 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580213    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:53:29.585306 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580217    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:53:29.585306 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580222    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:53:29.585306 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580226    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:53:29.585306 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580230    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:53:29.585306 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580233    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:53:29.585306 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580237    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:53:29.585853 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580241    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:53:29.585853 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580246    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:53:29.585853 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.580250    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:53:29.585853 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580343    2566 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 17:53:29.585853 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580355    2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 17:53:29.585853 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580371    2566 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 17:53:29.585853 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580379    2566 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 17:53:29.585853 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580386    2566 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 17:53:29.585853 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580391    2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 17:53:29.585853 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580397    2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 17:53:29.585853 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580404    2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 17:53:29.585853 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580409    2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 17:53:29.585853 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580414    2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 17:53:29.585853 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580422    2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 17:53:29.585853 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580428    2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 17:53:29.585853 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580433    2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 17:53:29.585853 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580438    2566 flags.go:64] FLAG: --cgroup-root=""
Jul 07 17:53:29.585853 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580442    2566 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 17:53:29.585853 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580447    2566 flags.go:64] FLAG: --client-ca-file=""
Jul 07 17:53:29.585853 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580452    2566 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 17:53:29.585853 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580457    2566 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 17:53:29.585853 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580464    2566 flags.go:64] FLAG: --cluster-domain=""
Jul 07 17:53:29.585853 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580472    2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 17:53:29.586519 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580477    2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 17:53:29.586519 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580482    2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 17:53:29.586519 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580487    2566 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 17:53:29.586519 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580493    2566 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 17:53:29.586519 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580498    2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 17:53:29.586519 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580503    2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 17:53:29.586519 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580508    2566 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 17:53:29.586519 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580513    2566 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 17:53:29.586519 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580518    2566 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 17:53:29.586519 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580522    2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 17:53:29.586519 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580527    2566 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 17:53:29.586519 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580531    2566 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 17:53:29.586519 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580538    2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 17:53:29.586519 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580543    2566 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 17:53:29.586519 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580548    2566 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 17:53:29.586519 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580552    2566 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 17:53:29.586519 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580557    2566 flags.go:64] FLAG: --enable-server="true"
Jul 07 17:53:29.586519 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580562    2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 17:53:29.586519 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580569    2566 flags.go:64] FLAG: --event-burst="100"
Jul 07 17:53:29.586519 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580574    2566 flags.go:64] FLAG: --event-qps="50"
Jul 07 17:53:29.586519 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580579    2566 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 17:53:29.586519 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580584    2566 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 17:53:29.586519 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580590    2566 flags.go:64] FLAG: --eviction-hard=""
Jul 07 17:53:29.586519 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580597    2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 17:53:29.587138 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580602    2566 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 17:53:29.587138 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580606    2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 17:53:29.587138 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580611    2566 flags.go:64] FLAG: --eviction-soft=""
Jul 07 17:53:29.587138 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580616    2566 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 17:53:29.587138 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580620    2566 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 17:53:29.587138 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580626    2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 17:53:29.587138 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580630    2566 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 17:53:29.587138 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580637    2566 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 17:53:29.587138 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580641    2566 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 17:53:29.587138 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580646    2566 flags.go:64] FLAG: --feature-gates=""
Jul 07 17:53:29.587138 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580652    2566 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 17:53:29.587138 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580656    2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 17:53:29.587138 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580661    2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 17:53:29.587138 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580665    2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 17:53:29.587138 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580670    2566 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 17:53:29.587138 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580675    2566 flags.go:64] FLAG: --help="false"
Jul 07 17:53:29.587138 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580679    2566 flags.go:64] FLAG: --hostname-override="ip-10-0-128-53.ec2.internal"
Jul 07 17:53:29.587138 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580685    2566 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 17:53:29.587138 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580690    2566 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 17:53:29.587138 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580695    2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 17:53:29.587138 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580701    2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 17:53:29.587138 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580706    2566 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 17:53:29.587138 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580711    2566 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 17:53:29.587138 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580715    2566 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 17:53:29.587743 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580720    2566 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 17:53:29.587743 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580725    2566 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 17:53:29.587743 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580729    2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 17:53:29.587743 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580734    2566 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 17:53:29.587743 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580739    2566 flags.go:64] FLAG: --kube-reserved=""
Jul 07 17:53:29.587743 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580744    2566 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 17:53:29.587743 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580750    2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 17:53:29.587743 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580755    2566 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 17:53:29.587743 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580760    2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 17:53:29.587743 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580765    2566 flags.go:64] FLAG: --lock-file=""
Jul 07 17:53:29.587743 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580769    2566 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 17:53:29.587743 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580774    2566 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 17:53:29.587743 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580779    2566 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 17:53:29.587743 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580788    2566 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 17:53:29.587743 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580793    2566 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 17:53:29.587743 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580800    2566 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 17:53:29.587743 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580804    2566 flags.go:64] FLAG: --logging-format="text"
Jul 07 17:53:29.587743 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580809    2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 17:53:29.587743 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580815    2566 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 17:53:29.587743 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580838    2566 flags.go:64] FLAG: --manifest-url=""
Jul 07 17:53:29.587743 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580844    2566 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 17:53:29.587743 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580851    2566 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 17:53:29.587743 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580856    2566 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 17:53:29.587743 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580863    2566 flags.go:64] FLAG: --max-pods="110"
Jul 07 17:53:29.587743 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580867    2566 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 17:53:29.588438 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580872    2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 17:53:29.588438 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580876    2566 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 17:53:29.588438 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580881    2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 17:53:29.588438 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580886    2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 17:53:29.588438 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580891    2566 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 17:53:29.588438 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580895    2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 17:53:29.588438 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580908    2566 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 17:53:29.588438 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580912    2566 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 17:53:29.588438 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580917    2566 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 17:53:29.588438 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580922    2566 flags.go:64] FLAG: --pod-cidr=""
Jul 07 17:53:29.588438 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580926    2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 17:53:29.588438 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580936    2566 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 17:53:29.588438 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580940    2566 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 17:53:29.588438 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580945    2566 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 17:53:29.588438 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580951    2566 flags.go:64] FLAG: --port="10250"
Jul 07 17:53:29.588438 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580955    2566 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 17:53:29.588438 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580959    2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0edb18002b56cab6b"
Jul 07 17:53:29.588438 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580965    2566 flags.go:64] FLAG: --qos-reserved=""
Jul 07 17:53:29.588438 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580970    2566 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 17:53:29.588438 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580975    2566 flags.go:64] FLAG: --register-node="true"
Jul 07 17:53:29.588438 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580979    2566 flags.go:64] FLAG: --register-with-taints=""
Jul 07 17:53:29.588438 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580985    2566 flags.go:64] FLAG: --registry-burst="10"
Jul 07 17:53:29.588438 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580992    2566 flags.go:64] FLAG: --registry-qps="5"
Jul 07 17:53:29.588438 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.580996    2566 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 17:53:29.589054 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581001    2566 flags.go:64] FLAG: --reserved-memory=""
Jul 07 17:53:29.589054 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581007    2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 17:53:29.589054 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581012    2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 17:53:29.589054 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581017    2566 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 17:53:29.589054 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581021    2566 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 17:53:29.589054 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581026    2566 flags.go:64] FLAG: --runonce="false"
Jul 07 17:53:29.589054 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581030    2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 17:53:29.589054 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581035    2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 17:53:29.589054 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581040    2566 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 17:53:29.589054 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581044    2566 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 17:53:29.589054 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581049    2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 17:53:29.589054 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581054    2566 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 17:53:29.589054 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581059    2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 17:53:29.589054 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581063    2566 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 17:53:29.589054 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581068    2566 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 17:53:29.589054 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581073    2566 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 17:53:29.589054 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581077    2566 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 17:53:29.589054 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581082    2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 17:53:29.589054 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581087    2566 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 17:53:29.589054 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581092    2566 flags.go:64] FLAG: --system-cgroups=""
Jul 07 17:53:29.589054 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581097    2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 17:53:29.589054 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581106    2566 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 17:53:29.589054 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581112    2566 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 17:53:29.589054 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581117    2566 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 17:53:29.589054 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581123    2566 flags.go:64] FLAG: --tls-min-version=""
Jul 07 17:53:29.589720 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581128    2566 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 17:53:29.589720 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581132    2566 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 17:53:29.589720 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581136    2566 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 17:53:29.589720 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581141    2566 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 17:53:29.589720 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581146    2566 flags.go:64] FLAG: --v="2"
Jul 07 17:53:29.589720 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581154    2566 flags.go:64] FLAG: --version="false"
Jul 07 17:53:29.589720 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581162    2566 flags.go:64] FLAG: --vmodule=""
Jul 07 17:53:29.589720 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581168    2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 17:53:29.589720 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581174    2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 17:53:29.589720 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581357    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:53:29.589720 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581364    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:53:29.589720 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581369    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:53:29.589720 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581373    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:53:29.589720 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581380    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:53:29.589720 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581385    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:53:29.589720 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581390    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:53:29.589720 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581394    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:53:29.589720 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581398    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:53:29.589720 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581402    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:53:29.589720 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581406    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:53:29.589720 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581410    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:53:29.590279 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581415    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:53:29.590279 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581419    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:53:29.590279 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581423    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:53:29.590279 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581427    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:53:29.590279 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581431    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:53:29.590279 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581436    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:53:29.590279 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581440    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:53:29.590279 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581444    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:53:29.590279 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581449    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:53:29.590279 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581453    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:53:29.590279 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581458    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:53:29.590279 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581462    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:53:29.590279 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581466    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:53:29.590279 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581470    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:53:29.590279 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581474    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:53:29.590279 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581478    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:53:29.590279 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581485    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:53:29.590279 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581488    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:53:29.590279 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581494    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:53:29.590279 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581498    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:53:29.590782 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581502    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:53:29.590782 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581506    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:53:29.590782 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581510    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:53:29.590782 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581514    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:53:29.590782 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581517    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:53:29.590782 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581521    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:53:29.590782 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581525    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:53:29.590782 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581529    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:53:29.590782 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581533    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:53:29.590782 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581537    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:53:29.590782 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581541    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:53:29.590782 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581546    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:53:29.590782 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581550    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:53:29.590782 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581554    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:53:29.590782 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581558    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:53:29.590782 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581562    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:53:29.590782 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581566    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:53:29.590782 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581570    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:53:29.590782 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581574    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:53:29.590782 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581578    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:53:29.591371 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581584    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:53:29.591371 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581588    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:53:29.591371 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581592    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:53:29.591371 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581597    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:53:29.591371 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581601    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:53:29.591371 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581605    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:53:29.591371 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581609    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:53:29.591371 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581615    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:53:29.591371 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581621    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:53:29.591371 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581626    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:53:29.591371 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581630    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:53:29.591371 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581635    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:53:29.591371 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581639    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:53:29.591371 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581644    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:53:29.591371 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581648    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:53:29.591371 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581652    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:53:29.591371 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581656    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:53:29.591371 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581660    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:53:29.591371 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581663    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:53:29.591371 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581668    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:53:29.591884 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581672    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:53:29.591884 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581676    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:53:29.591884 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581680    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:53:29.591884 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581684    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:53:29.591884 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581688    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:53:29.591884 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581695    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:53:29.591884 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581700    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:53:29.591884 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581705    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:53:29.591884 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581709    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:53:29.591884 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581713    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:53:29.591884 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581717    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:53:29.591884 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581722    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:53:29.591884 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581728    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:53:29.591884 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581732    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:53:29.591884 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581737    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:53:29.591884 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581741    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:53:29.591884 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581745    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:53:29.591884 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581749    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:53:29.591884 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581753    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:53:29.591884 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581758    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:53:29.592383 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581762    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:53:29.592383 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581767    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:53:29.592383 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581770    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:53:29.592383 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581774    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:53:29.592383 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581779    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:53:29.592383 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581783    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:53:29.592383 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.581788    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:53:29.592383 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.581796    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 17:53:29.592383 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.589484    2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 17:53:29.592383 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.589499    2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 17:53:29.592383 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.589520    2566 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 17:53:29.592383 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.589526    2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 17:53:29.592383 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589585    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:53:29.592383 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589590    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:53:29.592730 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589593    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:53:29.592730 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589596    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:53:29.592730 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589599    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:53:29.592730 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589602    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:53:29.592730 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589604    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:53:29.592730 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589607    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:53:29.592730 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589610    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:53:29.592730 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589612    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:53:29.592730 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589614    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:53:29.592730 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589617    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:53:29.592730 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589620    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:53:29.592730 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589622    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:53:29.592730 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589625    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:53:29.592730 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589628    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:53:29.592730 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589630    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:53:29.592730 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589633    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:53:29.592730 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589635    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:53:29.592730 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589638    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:53:29.592730 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589640    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:53:29.592730 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589643    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:53:29.593236 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589645    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:53:29.593236 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589648    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:53:29.593236 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589650    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:53:29.593236 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589653    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:53:29.593236 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589655    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:53:29.593236 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589658    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:53:29.593236 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589661    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:53:29.593236 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589664    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:53:29.593236 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589669    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:53:29.593236 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589672    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:53:29.593236 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589675    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:53:29.593236 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589677    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:53:29.593236 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589680    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:53:29.593236 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589684    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:53:29.593236 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589686    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:53:29.593236 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589689    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:53:29.593236 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589692    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:53:29.593236 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589694    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:53:29.593236 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589697    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:53:29.593236 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589699    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:53:29.593731 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589702    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:53:29.593731 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589704    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:53:29.593731 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589707    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:53:29.593731 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589709    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:53:29.593731 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589711    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:53:29.593731 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589714    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:53:29.593731 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589716    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:53:29.593731 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589720    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:53:29.593731 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589724    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:53:29.593731 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589728    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:53:29.593731 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589730    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:53:29.593731 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589733    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:53:29.593731 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589736    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:53:29.593731 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589738    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:53:29.593731 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589741    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:53:29.593731 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589744    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:53:29.593731 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589748    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:53:29.593731 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589751    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:53:29.593731 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589754    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:53:29.594229 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589757    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:53:29.594229 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589760    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:53:29.594229 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589763    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:53:29.594229 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589765    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:53:29.594229 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589768    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:53:29.594229 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589770    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:53:29.594229 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589773    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:53:29.594229 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589775    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:53:29.594229 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589778    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:53:29.594229 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589780    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:53:29.594229 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589783    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:53:29.594229 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589785    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:53:29.594229 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589788    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:53:29.594229 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589790    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:53:29.594229 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589793    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:53:29.594229 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589795    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:53:29.594229 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589798    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:53:29.594229 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589800    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:53:29.594229 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589803    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:53:29.594706 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589806    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:53:29.594706 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589808    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:53:29.594706 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589810    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:53:29.594706 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589813    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:53:29.594706 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589815    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:53:29.594706 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589818    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:53:29.594706 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589834    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:53:29.594706 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589836    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:53:29.594706 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589839    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:53:29.594706 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589842    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:53:29.594706 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589844    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:53:29.594706 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589846    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:53:29.594706 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589849    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:53:29.594706 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589852    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:53:29.594706 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589855    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:53:29.594706 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589858    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:53:29.594706 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589860    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:53:29.594706 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589863    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:53:29.594706 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589865    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:53:29.595182 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.589870    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 17:53:29.595182 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589986    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:53:29.595182 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589991    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:53:29.595182 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589994    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:53:29.595182 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589996    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:53:29.595182 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.589999    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:53:29.595182 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590003    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:53:29.595182 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590005    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:53:29.595182 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590008    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:53:29.595182 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590010    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:53:29.595182 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590013    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:53:29.595182 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590015    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:53:29.595182 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590017    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:53:29.595182 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590020    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:53:29.595182 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590022    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:53:29.595546 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590025    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:53:29.595546 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590027    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:53:29.595546 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590030    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:53:29.595546 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590032    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:53:29.595546 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590034    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:53:29.595546 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590038    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:53:29.595546 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590041    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:53:29.595546 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590044    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:53:29.595546 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590046    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:53:29.595546 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590049    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:53:29.595546 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590052    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:53:29.595546 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590055    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:53:29.595546 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590058    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:53:29.595546 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590060    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:53:29.595546 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590063    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:53:29.595546 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590066    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:53:29.595546 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590068    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:53:29.595546 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590070    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:53:29.595546 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590073    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:53:29.596019 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590075    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:53:29.596019 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590077    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:53:29.596019 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590080    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:53:29.596019 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590083    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:53:29.596019 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590086    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:53:29.596019 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590089    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:53:29.596019 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590092    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:53:29.596019 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590094    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:53:29.596019 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590097    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:53:29.596019 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590099    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:53:29.596019 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590101    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:53:29.596019 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590104    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:53:29.596019 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590106    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:53:29.596019 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590109    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:53:29.596019 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590111    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:53:29.596019 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590114    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:53:29.596019 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590116    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:53:29.596019 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590119    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:53:29.596019 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590121    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:53:29.596019 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590124    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:53:29.596508 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590126    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:53:29.596508 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590128    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:53:29.596508 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590131    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:53:29.596508 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590134    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:53:29.596508 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590136    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:53:29.596508 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590140    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:53:29.596508 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590143    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:53:29.596508 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590146    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:53:29.596508 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590157    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:53:29.596508 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590161    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:53:29.596508 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590164    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:53:29.596508 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590167    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:53:29.596508 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590169    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:53:29.596508 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590172    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:53:29.596508 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590175    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:53:29.596508 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590177    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:53:29.596508 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590179    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:53:29.596508 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590181    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:53:29.596508 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590184    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:53:29.596508 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590186    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:53:29.597004 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590189    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:53:29.597004 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590191    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:53:29.597004 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590194    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:53:29.597004 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590196    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:53:29.597004 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590199    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:53:29.597004 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590201    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:53:29.597004 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590204    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:53:29.597004 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590206    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:53:29.597004 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590209    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:53:29.597004 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590212    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:53:29.597004 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590214    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:53:29.597004 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590217    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:53:29.597004 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590219    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:53:29.597004 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590221    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:53:29.597004 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590224    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:53:29.597004 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590226    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:53:29.597004 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590229    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:53:29.597004 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590231    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:53:29.597004 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590234    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:53:29.597004 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590236    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:53:29.597489 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590239    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:53:29.597489 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590242    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:53:29.597489 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590244    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:53:29.597489 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590247    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:53:29.597489 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590249    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:53:29.597489 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:29.590251    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:53:29.597489 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.590257    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 17:53:29.597489 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.590380    2566 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 17:53:29.597489 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.592765    2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 17:53:29.597489 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.594408    2566 server.go:1019] "Starting client certificate rotation"
Jul 07 17:53:29.597489 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.594502    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 17:53:29.597489 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.594532    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 17:53:29.597489 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.597334    2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 17:53:29.598510 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.598488    2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 17:53:29.609942 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.609838    2566 log.go:25] "Validated CRI v1 runtime API"
Jul 07 17:53:29.613085 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.613066    2566 log.go:25] "Validated CRI v1 image API"
Jul 07 17:53:29.613907 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.613887    2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 17:53:29.616515 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.616490    2566 fs.go:135] Filesystem UUIDs: map[16d750cb-315c-4224-98c1-3a30548716a6:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9fa46b53-3f24-4c14-850f-ff8102f6e5a4:/dev/nvme0n1p4]
Jul 07 17:53:29.616596 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.616513    2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 17:53:29.621706 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.621590    2566 manager.go:216] Machine: {Timestamp:2026-07-07 17:53:29.620187785 +0000 UTC m=+0.377748659 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100408 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ce98e4bfb399c7b90acdc2d64739f SystemUUID:ec2ce98e-4bfb-399c-7b90-acdc2d64739f BootID:0ba54d13-1f40-4278-9cdc-837620148d81 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d0:3e:cd:35:c5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d0:3e:cd:35:c5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:6b:05:00:92:70 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 17:53:29.621706 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.621696    2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 17:53:29.621898 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.621814    2566 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 17:53:29.625212 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.625180    2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 17:53:29.625280 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.625265    2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 17:53:29.625403 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.625219    2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-53.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 17:53:29.626110 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.626100    2566 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 17:53:29.626142 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.626113    2566 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 17:53:29.626142 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.626121    2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 17:53:29.626937 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.626926    2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 17:53:29.628854 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.628841    2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 17:53:29.633461 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.633449    2566 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 17:53:29.633599 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.633589    2566 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 17:53:29.633644 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.633628    2566 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 17:53:29.633674 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.633645    2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 17:53:29.633674 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.633660    2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 17:53:29.633674 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.633669    2566 kubelet.go:398] "Adding apiserver pod source"
Jul 07 17:53:29.633842 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.633678    2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 17:53:29.634090 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.634077    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 17:53:29.634139 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.634106    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 17:53:29.636571 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.636548    2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 17:53:29.638933 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.638917    2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 17:53:29.638986 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.638957    2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 17:53:29.640379 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.640368    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 17:53:29.640417 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.640384    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 17:53:29.640417 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.640391    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 17:53:29.640417 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.640396    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 17:53:29.640417 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.640404    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 17:53:29.640417 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.640410    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 17:53:29.640417 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.640418    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 17:53:29.640573 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.640424    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 17:53:29.640573 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.640431    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 17:53:29.640573 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.640436    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 17:53:29.640573 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.640446    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 17:53:29.640573 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.640451    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 17:53:29.641374 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.641363    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 17:53:29.641407 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.641375    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 17:53:29.644983 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.644971    2566 server.go:1268] "Started kubelet"
Jul 07 17:53:29.645214 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.645177    2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 17:53:29.645314 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.645083    2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 17:53:29.645365 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.645316    2566 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 17:53:29.645886 ip-10-0-128-53 systemd[1]: Started Kubernetes Kubelet.
Jul 07 17:53:29.646071 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.646057    2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-53.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 17:53:29.646862 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.646737    2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 17:53:29.646862 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:29.646816    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-53.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 17:53:29.646862 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:29.646814    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 17:53:29.647474 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.647458    2566 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 17:53:29.651076 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:29.651054    2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 17:53:29.654129 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:29.652989    2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-53.ec2.internal.18c0136c9cb0cec3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-53.ec2.internal,UID:ip-10-0-128-53.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-53.ec2.internal,},FirstTimestamp:2026-07-07 17:53:29.644945091 +0000 UTC m=+0.402505953,LastTimestamp:2026-07-07 17:53:29.644945091 +0000 UTC m=+0.402505953,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-53.ec2.internal,}"
Jul 07 17:53:29.654400 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.654380    2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 17:53:29.654400 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.654391    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 17:53:29.654581 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:29.654475    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-53.ec2.internal\" not found"
Jul 07 17:53:29.655183 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.655151    2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 17:53:29.655531 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.655352    2566 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 17:53:29.655642 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.655632    2566 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 17:53:29.655944 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.655923    2566 factory.go:55] Registering systemd factory
Jul 07 17:53:29.656022 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.655948    2566 factory.go:223] Registration of the systemd container factory successfully
Jul 07 17:53:29.657377 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.657359    2566 factory.go:153] Registering CRI-O factory
Jul 07 17:53:29.657464 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.657380    2566 factory.go:223] Registration of the crio container factory successfully
Jul 07 17:53:29.657464 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.657439    2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 17:53:29.657464 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.657461    2566 factory.go:103] Registering Raw factory
Jul 07 17:53:29.657610 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.657478    2566 manager.go:1196] Started watching for new ooms in manager
Jul 07 17:53:29.658091 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.658077    2566 manager.go:349] Starting recovery of all containers
Jul 07 17:53:29.658529 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.658513    2566 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 17:53:29.658529 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.658529    2566 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 17:53:29.661251 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.661228    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-596cg"
Jul 07 17:53:29.665676 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.665478    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 17:53:29.667915 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:29.667881    2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-53.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 17:53:29.667989 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:29.667941    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 17:53:29.669935 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.669917    2566 manager.go:354] Recovery completed
Jul 07 17:53:29.670890 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.670814    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-596cg"
Jul 07 17:53:29.674108 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.674095    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:53:29.676020 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.676003    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:53:29.676107 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.676037    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:53:29.676107 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.676052    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:53:29.676549 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.676533    2566 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 17:53:29.676549 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.676546    2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 17:53:29.676674 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.676553    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:53:29.676674 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.676562    2566 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 17:53:29.677247 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.677232    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:53:29.677359 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.677262    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:53:29.677359 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.677275    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:53:29.678599 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.678586    2566 policy_none.go:49] "None policy: Start"
Jul 07 17:53:29.678660 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.678602    2566 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 17:53:29.678660 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.678613    2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 17:53:29.680592 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.680581    2566 policy_none.go:47] "Start"
Jul 07 17:53:29.726483 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.726457    2566 manager.go:337] "Starting Device Plugin manager"
Jul 07 17:53:29.737550 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:29.726509    2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 17:53:29.737550 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.726522    2566 server.go:87] "Starting device plugin registration server"
Jul 07 17:53:29.737550 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.726765    2566 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 17:53:29.737550 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.726779    2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 17:53:29.737550 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.726915    2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 17:53:29.737550 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.726992    2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 17:53:29.737550 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.727002    2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 17:53:29.737550 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:29.727521    2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 17:53:29.737550 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:29.727562    2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-53.ec2.internal\" not found"
Jul 07 17:53:29.794473 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.794446    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 17:53:29.794597 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.794488    2566 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 17:53:29.794597 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.794511    2566 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 17:53:29.794597 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:29.794542    2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 17:53:29.797750 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.797729    2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:53:29.827212 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.827138    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:53:29.828109 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.828094    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:53:29.828174 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.828127    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:53:29.828174 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.828145    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:53:29.828174 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.828169    2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-53.ec2.internal"
Jul 07 17:53:29.841284 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.841265    2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-53.ec2.internal"
Jul 07 17:53:29.841376 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:29.841291    2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-53.ec2.internal\": node \"ip-10-0-128-53.ec2.internal\" not found"
Jul 07 17:53:29.878058 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:29.878028    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-53.ec2.internal\" not found"
Jul 07 17:53:29.895332 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.894599    2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-53.ec2.internal"]
Jul 07 17:53:29.895484 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.895397    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:53:29.896608 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.896583    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:53:29.896690 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.896614    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:53:29.896690 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.896625    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:53:29.899077 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.899064    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:53:29.899241 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.899223    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal"
Jul 07 17:53:29.899302 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.899265    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:53:29.899815 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.899797    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:53:29.899929 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.899839    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:53:29.899929 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.899863    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:53:29.899929 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.899863    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:53:29.899929 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.899871    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:53:29.899929 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.899880    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:53:29.902262 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.902245    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-53.ec2.internal"
Jul 07 17:53:29.902365 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.902279    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:53:29.903023 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.903000    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:53:29.903157 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.903029    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:53:29.903157 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.903038    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:53:29.925776 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:29.925744    2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-53.ec2.internal\" not found" node="ip-10-0-128-53.ec2.internal"
Jul 07 17:53:29.930209 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:29.930189    2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-53.ec2.internal\" not found" node="ip-10-0-128-53.ec2.internal"
Jul 07 17:53:29.960458 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.960422    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/11bce2051af4a6b9f223b5c48fe134dc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal\" (UID: \"11bce2051af4a6b9f223b5c48fe134dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal"
Jul 07 17:53:29.960458 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.960458    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11bce2051af4a6b9f223b5c48fe134dc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal\" (UID: \"11bce2051af4a6b9f223b5c48fe134dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal"
Jul 07 17:53:29.960605 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:29.960478    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6da60c6aa145a773b0c59de51f12d9f6-config\") pod \"kube-apiserver-proxy-ip-10-0-128-53.ec2.internal\" (UID: \"6da60c6aa145a773b0c59de51f12d9f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-53.ec2.internal"
Jul 07 17:53:29.978785 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:29.978739    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-53.ec2.internal\" not found"
Jul 07 17:53:30.060998 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.060967    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/11bce2051af4a6b9f223b5c48fe134dc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal\" (UID: \"11bce2051af4a6b9f223b5c48fe134dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal"
Jul 07 17:53:30.061083 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.060999    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11bce2051af4a6b9f223b5c48fe134dc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal\" (UID: \"11bce2051af4a6b9f223b5c48fe134dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal"
Jul 07 17:53:30.061083 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.061019    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6da60c6aa145a773b0c59de51f12d9f6-config\") pod \"kube-apiserver-proxy-ip-10-0-128-53.ec2.internal\" (UID: \"6da60c6aa145a773b0c59de51f12d9f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-53.ec2.internal"
Jul 07 17:53:30.061083 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.061063    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6da60c6aa145a773b0c59de51f12d9f6-config\") pod \"kube-apiserver-proxy-ip-10-0-128-53.ec2.internal\" (UID: \"6da60c6aa145a773b0c59de51f12d9f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-53.ec2.internal"
Jul 07 17:53:30.061083 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.061073    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/11bce2051af4a6b9f223b5c48fe134dc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal\" (UID: \"11bce2051af4a6b9f223b5c48fe134dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal"
Jul 07 17:53:30.061209 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.061078    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11bce2051af4a6b9f223b5c48fe134dc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal\" (UID: \"11bce2051af4a6b9f223b5c48fe134dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal"
Jul 07 17:53:30.079927 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:30.079864    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-53.ec2.internal\" not found"
Jul 07 17:53:30.180831 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:30.180785    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-53.ec2.internal\" not found"
Jul 07 17:53:30.228987 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.228958    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal"
Jul 07 17:53:30.233038 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.233002    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-53.ec2.internal"
Jul 07 17:53:30.281904 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:30.281869    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-53.ec2.internal\" not found"
Jul 07 17:53:30.382614 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:30.382513    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-53.ec2.internal\" not found"
Jul 07 17:53:30.483213 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:30.483175    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-53.ec2.internal\" not found"
Jul 07 17:53:30.520268 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.520236    2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:53:30.554574 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.554546    2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal"
Jul 07 17:53:30.571964 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.571936    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 17:53:30.573647 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.573630    2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-53.ec2.internal"
Jul 07 17:53:30.584645 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.584614    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 17:53:30.593912 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.593870    2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 17:53:30.594085 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.594040    2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 17:53:30.594141 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.594088    2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 17:53:30.634252 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.634182    2566 apiserver.go:52] "Watching apiserver"
Jul 07 17:53:30.651151 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.651106    2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 17:53:30.651501 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.651480    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq","openshift-dns/node-resolver-pxsv8","openshift-image-registry/node-ca-t7czl","openshift-network-operator/iptables-alerter-j6n6r","openshift-ovn-kubernetes/ovnkube-node-76kvc","kube-system/konnectivity-agent-txjw6","kube-system/kube-apiserver-proxy-ip-10-0-128-53.ec2.internal","openshift-cluster-node-tuning-operator/tuned-28d9s","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal","openshift-multus/multus-additional-cni-plugins-kr84f","openshift-multus/multus-vh62r","openshift-multus/network-metrics-daemon-7v8v2","openshift-network-diagnostics/network-check-target-hhrd5","kube-system/global-pull-secret-syncer-9qmtf"]
Jul 07 17:53:30.654070 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.654040    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq"
Jul 07 17:53:30.655572 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.655547    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 17:53:30.656627 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.656605    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pxsv8"
Jul 07 17:53:30.656805 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.656786    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 17:53:30.656901 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.656847    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 17:53:30.656958 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.656912    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 17:53:30.657251 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.657230    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wr82l\""
Jul 07 17:53:30.658886 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.658867    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-w9xtm\""
Jul 07 17:53:30.659227 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.659209    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t7czl"
Jul 07 17:53:30.659317 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.659260    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 17:53:30.659556 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.659541    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 17:53:30.660111 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.660096    2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:53:30.661839 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.661811    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 17:53:30.661961 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.661936    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 17:53:30.662078 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.661940    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 17:53:30.662078 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.661985    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j6n6r"
Jul 07 17:53:30.662078 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.662036    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mqnbb\""
Jul 07 17:53:30.663350 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.663331    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-llnwq\" (UID: \"317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq"
Jul 07 17:53:30.663462 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.663355    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ca7075b-0176-4929-809b-3efa67cb7d5d-tmp-dir\") pod \"node-resolver-pxsv8\" (UID: \"1ca7075b-0176-4929-809b-3efa67cb7d5d\") " pod="openshift-dns/node-resolver-pxsv8"
Jul 07 17:53:30.663462 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.663372    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-llnwq\" (UID: \"317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq"
Jul 07 17:53:30.663462 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.663399    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1-sys-fs\") pod \"aws-ebs-csi-driver-node-llnwq\" (UID: \"317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq"
Jul 07 17:53:30.663462 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.663424    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqj5j\" (UniqueName: \"kubernetes.io/projected/317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1-kube-api-access-jqj5j\") pod \"aws-ebs-csi-driver-node-llnwq\" (UID: \"317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq"
Jul 07 17:53:30.663462 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.663447    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1ca7075b-0176-4929-809b-3efa67cb7d5d-hosts-file\") pod \"node-resolver-pxsv8\" (UID: \"1ca7075b-0176-4929-809b-3efa67cb7d5d\") " pod="openshift-dns/node-resolver-pxsv8"
Jul 07 17:53:30.663462 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.663464    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z9mk\" (UniqueName: \"kubernetes.io/projected/1ca7075b-0176-4929-809b-3efa67cb7d5d-kube-api-access-5z9mk\") pod \"node-resolver-pxsv8\" (UID: \"1ca7075b-0176-4929-809b-3efa67cb7d5d\") " pod="openshift-dns/node-resolver-pxsv8"
Jul 07 17:53:30.663671 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.663487    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1-socket-dir\") pod \"aws-ebs-csi-driver-node-llnwq\" (UID: \"317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq"
Jul 07 17:53:30.663671 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.663525    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1-registration-dir\") pod \"aws-ebs-csi-driver-node-llnwq\" (UID: \"317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq"
Jul 07 17:53:30.663671 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.663546    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1-device-dir\") pod \"aws-ebs-csi-driver-node-llnwq\" (UID: \"317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq"
Jul 07 17:53:30.664869 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.664840    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 17:53:30.664963 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.664845    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 17:53:30.665428 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.665409    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:53:30.665701 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.665470    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2h5cl\""
Jul 07 17:53:30.666227 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.666211    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.669027 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.669006    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 17:53:30.669137 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.669081    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s4nws\""
Jul 07 17:53:30.669287 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.669268    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-txjw6"
Jul 07 17:53:30.669287 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.669281    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 17:53:30.669699 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.669685    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 17:53:30.669928 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.669908    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 17:53:30.670000 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.669934    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 17:53:30.670669 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.670654    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 17:53:30.671974 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.671957    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.673649 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.673631    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fc7vc\""
Jul 07 17:53:30.673761 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.673746    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 17:53:30.674514 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.674499    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 17:53:30.674707 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.674690    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kr84f"
Jul 07 17:53:30.674788 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.674756    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:53:30.675038 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.675022    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6n48n\""
Jul 07 17:53:30.675115 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.675052    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 17:53:30.677225 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.677189    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 17:48:29 +0000 UTC" deadline="2027-12-04 14:43:09.1309686 +0000 UTC"
Jul 07 17:53:30.677225 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.677224    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12356h49m38.453746503s"
Jul 07 17:53:30.677345 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.677300    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.677793 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.677760    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 17:53:30.677947 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.677920    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 17:53:30.678024 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.677995    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g5gd2\""
Jul 07 17:53:30.678105 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.678071    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 17:53:30.678176 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.678114    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 17:53:30.678232 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.678191    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 17:53:30.678380 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.678366    2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 17:53:30.679745 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.679731    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xzw7f\""
Jul 07 17:53:30.680027 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.680009    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 17:53:30.680169 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.680154    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:53:30.680275 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:30.680252    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v8v2" podUID="0bf127e3-735b-4304-9269-551261b5a0cc"
Jul 07 17:53:30.682740 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.682721    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:53:30.682862 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:30.682788    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hhrd5" podUID="649e0a8c-d3b7-4169-9bc3-65736133a6b3"
Jul 07 17:53:30.685288 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.685259    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:53:30.685404 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:30.685367    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qmtf" podUID="5ca929e8-fe5f-4713-ae87-fcfdd2816546"
Jul 07 17:53:30.726662 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.726623    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kzgz6"
Jul 07 17:53:30.735439 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.735413    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kzgz6"
Jul 07 17:53:30.757111 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.757085    2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 17:53:30.763756 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.763730    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/470edfe9-5ba7-47dd-9814-80597c3c794e-host-slash\") pod \"iptables-alerter-j6n6r\" (UID: \"470edfe9-5ba7-47dd-9814-80597c3c794e\") " pod="openshift-network-operator/iptables-alerter-j6n6r"
Jul 07 17:53:30.763888 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.763772    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-host-run-netns\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.763888 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.763806    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-etc-tuned\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.763888 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.763852    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ee8c5a4-4788-4665-9331-232aa363342d-system-cni-dir\") pod \"multus-additional-cni-plugins-kr84f\" (UID: \"9ee8c5a4-4788-4665-9331-232aa363342d\") " pod="openshift-multus/multus-additional-cni-plugins-kr84f"
Jul 07 17:53:30.763888 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.763876    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d69a68be-0a86-46c6-b598-0e6bbc0d3b4d-konnectivity-ca\") pod \"konnectivity-agent-txjw6\" (UID: \"d69a68be-0a86-46c6-b598-0e6bbc0d3b4d\") " pod="kube-system/konnectivity-agent-txjw6"
Jul 07 17:53:30.764069 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.763906    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1-device-dir\") pod \"aws-ebs-csi-driver-node-llnwq\" (UID: \"317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq"
Jul 07 17:53:30.764069 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.763930    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-os-release\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.764069 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.763998    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1-device-dir\") pod \"aws-ebs-csi-driver-node-llnwq\" (UID: \"317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq"
Jul 07 17:53:30.764069 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764039    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-etc-sysctl-d\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.764207 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764073    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-host\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.764207 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764100    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmx2n\" (UniqueName: \"kubernetes.io/projected/9ee8c5a4-4788-4665-9331-232aa363342d-kube-api-access-pmx2n\") pod \"multus-additional-cni-plugins-kr84f\" (UID: \"9ee8c5a4-4788-4665-9331-232aa363342d\") " pod="openshift-multus/multus-additional-cni-plugins-kr84f"
Jul 07 17:53:30.764207 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764127    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-host-run-k8s-cni-cncf-io\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.764207 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764150    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-multus-conf-dir\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.764207 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764173    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-run\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.764207 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764196    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9ee8c5a4-4788-4665-9331-232aa363342d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kr84f\" (UID: \"9ee8c5a4-4788-4665-9331-232aa363342d\") " pod="openshift-multus/multus-additional-cni-plugins-kr84f"
Jul 07 17:53:30.764432 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764244    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad3b117b-52a4-49fa-8b26-e225f8cb3837-host\") pod \"node-ca-t7czl\" (UID: \"ad3b117b-52a4-49fa-8b26-e225f8cb3837\") " pod="openshift-image-registry/node-ca-t7czl"
Jul 07 17:53:30.764432 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764280    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1-socket-dir\") pod \"aws-ebs-csi-driver-node-llnwq\" (UID: \"317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq"
Jul 07 17:53:30.764432 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764328    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eefd6e0b-db36-4bd1-910f-17f549aa754d-cni-binary-copy\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.764432 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764348    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-host-var-lib-cni-multus\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.764432 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764365    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-tmp\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.764432 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764380    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ca929e8-fe5f-4713-ae87-fcfdd2816546-kubelet-config\") pod \"global-pull-secret-syncer-9qmtf\" (UID: \"5ca929e8-fe5f-4713-ae87-fcfdd2816546\") " pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:53:30.764432 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764409    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1-socket-dir\") pod \"aws-ebs-csi-driver-node-llnwq\" (UID: \"317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq"
Jul 07 17:53:30.764432 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764415    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-run-openvswitch\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.764783 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764451    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2cf80a27-5be9-4f63-a32d-d2d8e157a955-ovn-node-metrics-cert\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.764783 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764493    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1ca7075b-0176-4929-809b-3efa67cb7d5d-hosts-file\") pod \"node-resolver-pxsv8\" (UID: \"1ca7075b-0176-4929-809b-3efa67cb7d5d\") " pod="openshift-dns/node-resolver-pxsv8"
Jul 07 17:53:30.764783 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764521    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z9mk\" (UniqueName: \"kubernetes.io/projected/1ca7075b-0176-4929-809b-3efa67cb7d5d-kube-api-access-5z9mk\") pod \"node-resolver-pxsv8\" (UID: \"1ca7075b-0176-4929-809b-3efa67cb7d5d\") " pod="openshift-dns/node-resolver-pxsv8"
Jul 07 17:53:30.764783 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764553    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-lib-modules\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.764783 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764578    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9ee8c5a4-4788-4665-9331-232aa363342d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kr84f\" (UID: \"9ee8c5a4-4788-4665-9331-232aa363342d\") " pod="openshift-multus/multus-additional-cni-plugins-kr84f"
Jul 07 17:53:30.764783 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764578    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1ca7075b-0176-4929-809b-3efa67cb7d5d-hosts-file\") pod \"node-resolver-pxsv8\" (UID: \"1ca7075b-0176-4929-809b-3efa67cb7d5d\") " pod="openshift-dns/node-resolver-pxsv8"
Jul 07 17:53:30.764783 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764606    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p247g\" (UniqueName: \"kubernetes.io/projected/ad3b117b-52a4-49fa-8b26-e225f8cb3837-kube-api-access-p247g\") pod \"node-ca-t7czl\" (UID: \"ad3b117b-52a4-49fa-8b26-e225f8cb3837\") " pod="openshift-image-registry/node-ca-t7czl"
Jul 07 17:53:30.764783 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764640    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ca7075b-0176-4929-809b-3efa67cb7d5d-tmp-dir\") pod \"node-resolver-pxsv8\" (UID: \"1ca7075b-0176-4929-809b-3efa67cb7d5d\") " pod="openshift-dns/node-resolver-pxsv8"
Jul 07 17:53:30.764783 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764672    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-cnibin\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.764783 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764688    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ee8c5a4-4788-4665-9331-232aa363342d-cnibin\") pod \"multus-additional-cni-plugins-kr84f\" (UID: \"9ee8c5a4-4788-4665-9331-232aa363342d\") " pod="openshift-multus/multus-additional-cni-plugins-kr84f"
Jul 07 17:53:30.764783 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764712    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-host-run-netns\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.764783 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764740    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsk46\" (UniqueName: \"kubernetes.io/projected/2cf80a27-5be9-4f63-a32d-d2d8e157a955-kube-api-access-hsk46\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.764783 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764764    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-llnwq\" (UID: \"317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq"
Jul 07 17:53:30.764783 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764790    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-system-cni-dir\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.765383 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764850    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-llnwq\" (UID: \"317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq"
Jul 07 17:53:30.765383 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764854    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ee8c5a4-4788-4665-9331-232aa363342d-os-release\") pod \"multus-additional-cni-plugins-kr84f\" (UID: \"9ee8c5a4-4788-4665-9331-232aa363342d\") " pod="openshift-multus/multus-additional-cni-plugins-kr84f"
Jul 07 17:53:30.765383 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764890    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-log-socket\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.765383 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764912    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-host-run-multus-certs\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.765383 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764934    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-etc-kubernetes\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.765383 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764956    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn8xt\" (UniqueName: \"kubernetes.io/projected/eefd6e0b-db36-4bd1-910f-17f549aa754d-kube-api-access-xn8xt\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.765383 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764983    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-etc-modprobe-d\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.765383 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.764990    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ca7075b-0176-4929-809b-3efa67cb7d5d-tmp-dir\") pod \"node-resolver-pxsv8\" (UID: \"1ca7075b-0176-4929-809b-3efa67cb7d5d\") " pod="openshift-dns/node-resolver-pxsv8"
Jul 07 17:53:30.765383 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.765010    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-var-lib-openvswitch\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.765383 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.765035    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-multus-cni-dir\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.765383 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.765054    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-sys\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.765383 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.765068    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shl57\" (UniqueName: \"kubernetes.io/projected/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-kube-api-access-shl57\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.765383 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.765083    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5zmk\" (UniqueName: \"kubernetes.io/projected/649e0a8c-d3b7-4169-9bc3-65736133a6b3-kube-api-access-m5zmk\") pod \"network-check-target-hhrd5\" (UID: \"649e0a8c-d3b7-4169-9bc3-65736133a6b3\") " pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:53:30.765383 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.765135    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-run-ovn\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.765383 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.765160    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ca929e8-fe5f-4713-ae87-fcfdd2816546-original-pull-secret\") pod \"global-pull-secret-syncer-9qmtf\" (UID: \"5ca929e8-fe5f-4713-ae87-fcfdd2816546\") " pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:53:30.765383 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.765174    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ad3b117b-52a4-49fa-8b26-e225f8cb3837-serviceca\") pod \"node-ca-t7czl\" (UID: \"ad3b117b-52a4-49fa-8b26-e225f8cb3837\") " pod="openshift-image-registry/node-ca-t7czl"
Jul 07 17:53:30.765383 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.765208    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/470edfe9-5ba7-47dd-9814-80597c3c794e-iptables-alerter-script\") pod \"iptables-alerter-j6n6r\" (UID: \"470edfe9-5ba7-47dd-9814-80597c3c794e\") " pod="openshift-network-operator/iptables-alerter-j6n6r"
Jul 07 17:53:30.766041 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.765256    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-host-slash\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.766041 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.765281    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-etc-openvswitch\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.766041 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.765303    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-node-log\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.766041 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.765329    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-host-run-ovn-kubernetes\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.766041 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.765368    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-multus-socket-dir-parent\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.766041 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.765409    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ca929e8-fe5f-4713-ae87-fcfdd2816546-dbus\") pod \"global-pull-secret-syncer-9qmtf\" (UID: \"5ca929e8-fe5f-4713-ae87-fcfdd2816546\") " pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:53:30.766041 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.765437    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-host-kubelet\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.766041 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.765475    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-host-cni-bin\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.766041 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.765507    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-host-cni-netd\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.766041 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.765530    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2cf80a27-5be9-4f63-a32d-d2d8e157a955-env-overrides\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.766041 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.765551    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2cf80a27-5be9-4f63-a32d-d2d8e157a955-ovnkube-script-lib\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.766041 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.765583    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1-registration-dir\") pod \"aws-ebs-csi-driver-node-llnwq\" (UID: \"317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq"
Jul 07 17:53:30.766041 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.765605    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-host-var-lib-cni-bin\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.766041 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.765897    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-hostroot\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.766041 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.765968    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eefd6e0b-db36-4bd1-910f-17f549aa754d-multus-daemon-config\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.766041 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.766007    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1-registration-dir\") pod \"aws-ebs-csi-driver-node-llnwq\" (UID: \"317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq"
Jul 07 17:53:30.766041 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.766006    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-etc-kubernetes\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.766800 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.766086    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d69a68be-0a86-46c6-b598-0e6bbc0d3b4d-agent-certs\") pod \"konnectivity-agent-txjw6\" (UID: \"d69a68be-0a86-46c6-b598-0e6bbc0d3b4d\") " pod="kube-system/konnectivity-agent-txjw6"
Jul 07 17:53:30.766800 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.766148    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-host-var-lib-kubelet\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.766800 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.766191    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-etc-sysconfig\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.766800 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.766223    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-etc-sysctl-conf\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.766800 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.766259    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ee8c5a4-4788-4665-9331-232aa363342d-cni-binary-copy\") pod \"multus-additional-cni-plugins-kr84f\" (UID: \"9ee8c5a4-4788-4665-9331-232aa363342d\") " pod="openshift-multus/multus-additional-cni-plugins-kr84f"
Jul 07 17:53:30.766800 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.766353    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrsjj\" (UniqueName: \"kubernetes.io/projected/470edfe9-5ba7-47dd-9814-80597c3c794e-kube-api-access-hrsjj\") pod \"iptables-alerter-j6n6r\" (UID: \"470edfe9-5ba7-47dd-9814-80597c3c794e\") " pod="openshift-network-operator/iptables-alerter-j6n6r"
Jul 07 17:53:30.766800 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.766395    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-llnwq\" (UID: \"317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq"
Jul 07 17:53:30.766800 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.766429    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-var-lib-kubelet\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.766800 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.766483    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-systemd-units\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.766800 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.766513    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-run-systemd\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.766800 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.766542    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.766800 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.766577    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2cf80a27-5be9-4f63-a32d-d2d8e157a955-ovnkube-config\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.766800 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.766639    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1-sys-fs\") pod \"aws-ebs-csi-driver-node-llnwq\" (UID: \"317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq"
Jul 07 17:53:30.766800 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.766668    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqj5j\" (UniqueName: \"kubernetes.io/projected/317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1-kube-api-access-jqj5j\") pod \"aws-ebs-csi-driver-node-llnwq\" (UID: \"317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq"
Jul 07 17:53:30.766800 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.766699    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bf127e3-735b-4304-9269-551261b5a0cc-metrics-certs\") pod \"network-metrics-daemon-7v8v2\" (UID: \"0bf127e3-735b-4304-9269-551261b5a0cc\") " pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:53:30.766800 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.766729    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntc4k\" (UniqueName: \"kubernetes.io/projected/0bf127e3-735b-4304-9269-551261b5a0cc-kube-api-access-ntc4k\") pod \"network-metrics-daemon-7v8v2\" (UID: \"0bf127e3-735b-4304-9269-551261b5a0cc\") " pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:53:30.767513 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.766767    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-etc-systemd\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.767513 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.766796    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ee8c5a4-4788-4665-9331-232aa363342d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kr84f\" (UID: \"9ee8c5a4-4788-4665-9331-232aa363342d\") " pod="openshift-multus/multus-additional-cni-plugins-kr84f"
Jul 07 17:53:30.767513 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.767018    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-llnwq\" (UID: \"317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq"
Jul 07 17:53:30.767513 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.767119    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1-sys-fs\") pod \"aws-ebs-csi-driver-node-llnwq\" (UID: \"317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq"
Jul 07 17:53:30.773277 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.773248    2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 17:53:30.776666 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.776646    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z9mk\" (UniqueName: \"kubernetes.io/projected/1ca7075b-0176-4929-809b-3efa67cb7d5d-kube-api-access-5z9mk\") pod \"node-resolver-pxsv8\" (UID: \"1ca7075b-0176-4929-809b-3efa67cb7d5d\") " pod="openshift-dns/node-resolver-pxsv8"
Jul 07 17:53:30.781083 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.781057    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqj5j\" (UniqueName: \"kubernetes.io/projected/317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1-kube-api-access-jqj5j\") pod \"aws-ebs-csi-driver-node-llnwq\" (UID: \"317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq"
Jul 07 17:53:30.819504 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:30.819460    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6da60c6aa145a773b0c59de51f12d9f6.slice/crio-952470c0ff4e27cbfb7f1513a80f3349d56d37baab6c5e323ea7bf78a4312eb2 WatchSource:0}: Error finding container 952470c0ff4e27cbfb7f1513a80f3349d56d37baab6c5e323ea7bf78a4312eb2: Status 404 returned error can't find the container with id 952470c0ff4e27cbfb7f1513a80f3349d56d37baab6c5e323ea7bf78a4312eb2
Jul 07 17:53:30.825652 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.825632    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 17:53:30.867841 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.867795    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-tmp\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.868004 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.867860    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ca929e8-fe5f-4713-ae87-fcfdd2816546-kubelet-config\") pod \"global-pull-secret-syncer-9qmtf\" (UID: \"5ca929e8-fe5f-4713-ae87-fcfdd2816546\") " pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:53:30.868004 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.867880    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-run-openvswitch\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.868004 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.867896    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2cf80a27-5be9-4f63-a32d-d2d8e157a955-ovn-node-metrics-cert\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.868004 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.867914    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-lib-modules\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.868004 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.867939    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9ee8c5a4-4788-4665-9331-232aa363342d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kr84f\" (UID: \"9ee8c5a4-4788-4665-9331-232aa363342d\") " pod="openshift-multus/multus-additional-cni-plugins-kr84f"
Jul 07 17:53:30.868004 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.867958    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p247g\" (UniqueName: \"kubernetes.io/projected/ad3b117b-52a4-49fa-8b26-e225f8cb3837-kube-api-access-p247g\") pod \"node-ca-t7czl\" (UID: \"ad3b117b-52a4-49fa-8b26-e225f8cb3837\") " pod="openshift-image-registry/node-ca-t7czl"
Jul 07 17:53:30.868289 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868014    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ca929e8-fe5f-4713-ae87-fcfdd2816546-kubelet-config\") pod \"global-pull-secret-syncer-9qmtf\" (UID: \"5ca929e8-fe5f-4713-ae87-fcfdd2816546\") " pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:53:30.868289 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868059    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-cnibin\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.868289 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868072    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-run-openvswitch\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.868289 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868092    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-lib-modules\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.868289 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868099    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ee8c5a4-4788-4665-9331-232aa363342d-cnibin\") pod \"multus-additional-cni-plugins-kr84f\" (UID: \"9ee8c5a4-4788-4665-9331-232aa363342d\") " pod="openshift-multus/multus-additional-cni-plugins-kr84f"
Jul 07 17:53:30.868289 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868135    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-host-run-netns\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.868289 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868139    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ee8c5a4-4788-4665-9331-232aa363342d-cnibin\") pod \"multus-additional-cni-plugins-kr84f\" (UID: \"9ee8c5a4-4788-4665-9331-232aa363342d\") " pod="openshift-multus/multus-additional-cni-plugins-kr84f"
Jul 07 17:53:30.868289 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868158    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-cnibin\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.868289 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868162    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsk46\" (UniqueName: \"kubernetes.io/projected/2cf80a27-5be9-4f63-a32d-d2d8e157a955-kube-api-access-hsk46\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.868289 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868180    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-host-run-netns\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.868289 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868209    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-system-cni-dir\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.868289 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868234    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ee8c5a4-4788-4665-9331-232aa363342d-os-release\") pod \"multus-additional-cni-plugins-kr84f\" (UID: \"9ee8c5a4-4788-4665-9331-232aa363342d\") " pod="openshift-multus/multus-additional-cni-plugins-kr84f"
Jul 07 17:53:30.868289 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868255    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-log-socket\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.868289 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868262    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-system-cni-dir\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.868289 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868280    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-host-run-multus-certs\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.868967 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868310    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-etc-kubernetes\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.868967 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868318    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-log-socket\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.868967 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868325    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ee8c5a4-4788-4665-9331-232aa363342d-os-release\") pod \"multus-additional-cni-plugins-kr84f\" (UID: \"9ee8c5a4-4788-4665-9331-232aa363342d\") " pod="openshift-multus/multus-additional-cni-plugins-kr84f"
Jul 07 17:53:30.868967 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868334    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn8xt\" (UniqueName: \"kubernetes.io/projected/eefd6e0b-db36-4bd1-910f-17f549aa754d-kube-api-access-xn8xt\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.868967 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868356    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-host-run-multus-certs\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.868967 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868377    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-etc-kubernetes\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.868967 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868470    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-etc-modprobe-d\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.868967 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868502    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-var-lib-openvswitch\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.868967 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868525    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-multus-cni-dir\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.868967 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868545    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-sys\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.868967 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868569    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shl57\" (UniqueName: \"kubernetes.io/projected/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-kube-api-access-shl57\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.868967 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868573    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-etc-modprobe-d\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.868967 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868590    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-var-lib-openvswitch\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.868967 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868594    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5zmk\" (UniqueName: \"kubernetes.io/projected/649e0a8c-d3b7-4169-9bc3-65736133a6b3-kube-api-access-m5zmk\") pod \"network-check-target-hhrd5\" (UID: \"649e0a8c-d3b7-4169-9bc3-65736133a6b3\") " pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:53:30.868967 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868613    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-multus-cni-dir\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.868967 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868633    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-sys\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.868967 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868651    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-run-ovn\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.868967 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868683    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-run-ovn\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.869768 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868681    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ca929e8-fe5f-4713-ae87-fcfdd2816546-original-pull-secret\") pod \"global-pull-secret-syncer-9qmtf\" (UID: \"5ca929e8-fe5f-4713-ae87-fcfdd2816546\") " pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:53:30.869768 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868608    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9ee8c5a4-4788-4665-9331-232aa363342d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kr84f\" (UID: \"9ee8c5a4-4788-4665-9331-232aa363342d\") " pod="openshift-multus/multus-additional-cni-plugins-kr84f"
Jul 07 17:53:30.869768 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868738    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ad3b117b-52a4-49fa-8b26-e225f8cb3837-serviceca\") pod \"node-ca-t7czl\" (UID: \"ad3b117b-52a4-49fa-8b26-e225f8cb3837\") " pod="openshift-image-registry/node-ca-t7czl"
Jul 07 17:53:30.869768 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868758    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/470edfe9-5ba7-47dd-9814-80597c3c794e-iptables-alerter-script\") pod \"iptables-alerter-j6n6r\" (UID: \"470edfe9-5ba7-47dd-9814-80597c3c794e\") " pod="openshift-network-operator/iptables-alerter-j6n6r"
Jul 07 17:53:30.869768 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:30.868760    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:53:30.869768 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868778    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-host-slash\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.869768 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868814    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-etc-openvswitch\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.869768 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868867    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-etc-openvswitch\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.869768 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:30.868870    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ca929e8-fe5f-4713-ae87-fcfdd2816546-original-pull-secret podName:5ca929e8-fe5f-4713-ae87-fcfdd2816546 nodeName:}" failed. No retries permitted until 2026-07-07 17:53:31.368812546 +0000 UTC m=+2.126373400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ca929e8-fe5f-4713-ae87-fcfdd2816546-original-pull-secret") pod "global-pull-secret-syncer-9qmtf" (UID: "5ca929e8-fe5f-4713-ae87-fcfdd2816546") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:53:30.869768 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868899    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-host-slash\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.869768 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868918    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-node-log\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.869768 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868940    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-host-run-ovn-kubernetes\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.869768 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868981    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-node-log\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.869768 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.868991    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-multus-socket-dir-parent\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.869768 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869036    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-host-run-ovn-kubernetes\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.869768 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869055    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ca929e8-fe5f-4713-ae87-fcfdd2816546-dbus\") pod \"global-pull-secret-syncer-9qmtf\" (UID: \"5ca929e8-fe5f-4713-ae87-fcfdd2816546\") " pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:53:30.869768 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869076    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-host-kubelet\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.870675 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869114    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-host-kubelet\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.870675 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869123    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-multus-socket-dir-parent\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.870675 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869149    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-host-cni-bin\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.870675 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869165    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-host-cni-netd\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.870675 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869183    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2cf80a27-5be9-4f63-a32d-d2d8e157a955-env-overrides\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.870675 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869210    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2cf80a27-5be9-4f63-a32d-d2d8e157a955-ovnkube-script-lib\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.870675 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869215    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-host-cni-bin\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.870675 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869230    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ca929e8-fe5f-4713-ae87-fcfdd2816546-dbus\") pod \"global-pull-secret-syncer-9qmtf\" (UID: \"5ca929e8-fe5f-4713-ae87-fcfdd2816546\") " pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:53:30.870675 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869237    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-host-var-lib-cni-bin\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.870675 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869261    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-host-cni-netd\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.870675 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869275    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-hostroot\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.870675 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869278    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-host-var-lib-cni-bin\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.870675 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869332    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-hostroot\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.870675 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869386    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eefd6e0b-db36-4bd1-910f-17f549aa754d-multus-daemon-config\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.870675 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869404    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ad3b117b-52a4-49fa-8b26-e225f8cb3837-serviceca\") pod \"node-ca-t7czl\" (UID: \"ad3b117b-52a4-49fa-8b26-e225f8cb3837\") " pod="openshift-image-registry/node-ca-t7czl"
Jul 07 17:53:30.870675 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869411    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-etc-kubernetes\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.870675 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869465    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d69a68be-0a86-46c6-b598-0e6bbc0d3b4d-agent-certs\") pod \"konnectivity-agent-txjw6\" (UID: \"d69a68be-0a86-46c6-b598-0e6bbc0d3b4d\") " pod="kube-system/konnectivity-agent-txjw6"
Jul 07 17:53:30.870675 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869466    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-etc-kubernetes\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.871492 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869621    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/470edfe9-5ba7-47dd-9814-80597c3c794e-iptables-alerter-script\") pod \"iptables-alerter-j6n6r\" (UID: \"470edfe9-5ba7-47dd-9814-80597c3c794e\") " pod="openshift-network-operator/iptables-alerter-j6n6r"
Jul 07 17:53:30.871492 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869671    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-host-var-lib-kubelet\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.871492 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869702    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-etc-sysconfig\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.871492 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869725    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-etc-sysctl-conf\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.871492 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869731    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2cf80a27-5be9-4f63-a32d-d2d8e157a955-env-overrides\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.871492 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869750    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ee8c5a4-4788-4665-9331-232aa363342d-cni-binary-copy\") pod \"multus-additional-cni-plugins-kr84f\" (UID: \"9ee8c5a4-4788-4665-9331-232aa363342d\") " pod="openshift-multus/multus-additional-cni-plugins-kr84f"
Jul 07 17:53:30.871492 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869774    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrsjj\" (UniqueName: \"kubernetes.io/projected/470edfe9-5ba7-47dd-9814-80597c3c794e-kube-api-access-hrsjj\") pod \"iptables-alerter-j6n6r\" (UID: \"470edfe9-5ba7-47dd-9814-80597c3c794e\") " pod="openshift-network-operator/iptables-alerter-j6n6r"
Jul 07 17:53:30.871492 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869794    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-etc-sysconfig\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.871492 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869801    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-var-lib-kubelet\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.871492 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869868    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-host-var-lib-kubelet\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.871492 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869884    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-var-lib-kubelet\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.871492 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869905    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-systemd-units\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.871492 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869931    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-run-systemd\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.871492 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869954    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-etc-sysctl-conf\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.871492 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869950    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2cf80a27-5be9-4f63-a32d-d2d8e157a955-ovnkube-script-lib\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.871492 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869955    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.871492 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870000    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2cf80a27-5be9-4f63-a32d-d2d8e157a955-ovnkube-config\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.872081 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.869992    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-systemd-units\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.872081 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870016    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-run-systemd\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.872081 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870030    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bf127e3-735b-4304-9269-551261b5a0cc-metrics-certs\") pod \"network-metrics-daemon-7v8v2\" (UID: \"0bf127e3-735b-4304-9269-551261b5a0cc\") " pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:53:30.872081 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870039    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eefd6e0b-db36-4bd1-910f-17f549aa754d-multus-daemon-config\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.872081 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870057    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntc4k\" (UniqueName: \"kubernetes.io/projected/0bf127e3-735b-4304-9269-551261b5a0cc-kube-api-access-ntc4k\") pod \"network-metrics-daemon-7v8v2\" (UID: \"0bf127e3-735b-4304-9269-551261b5a0cc\") " pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:53:30.872081 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870049    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cf80a27-5be9-4f63-a32d-d2d8e157a955-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.872081 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:30.870137    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:53:30.872081 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870180    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-etc-systemd\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.872081 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:30.870204    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bf127e3-735b-4304-9269-551261b5a0cc-metrics-certs podName:0bf127e3-735b-4304-9269-551261b5a0cc nodeName:}" failed. No retries permitted until 2026-07-07 17:53:31.370188129 +0000 UTC m=+2.127748993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bf127e3-735b-4304-9269-551261b5a0cc-metrics-certs") pod "network-metrics-daemon-7v8v2" (UID: "0bf127e3-735b-4304-9269-551261b5a0cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:53:30.872081 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870233    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ee8c5a4-4788-4665-9331-232aa363342d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kr84f\" (UID: \"9ee8c5a4-4788-4665-9331-232aa363342d\") " pod="openshift-multus/multus-additional-cni-plugins-kr84f"
Jul 07 17:53:30.872081 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870249    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-etc-systemd\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.872081 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870261    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/470edfe9-5ba7-47dd-9814-80597c3c794e-host-slash\") pod \"iptables-alerter-j6n6r\" (UID: \"470edfe9-5ba7-47dd-9814-80597c3c794e\") " pod="openshift-network-operator/iptables-alerter-j6n6r"
Jul 07 17:53:30.872081 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870285    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-host-run-netns\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.872081 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870312    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-etc-tuned\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.872081 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870336    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ee8c5a4-4788-4665-9331-232aa363342d-system-cni-dir\") pod \"multus-additional-cni-plugins-kr84f\" (UID: \"9ee8c5a4-4788-4665-9331-232aa363342d\") " pod="openshift-multus/multus-additional-cni-plugins-kr84f"
Jul 07 17:53:30.872081 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870342    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/470edfe9-5ba7-47dd-9814-80597c3c794e-host-slash\") pod \"iptables-alerter-j6n6r\" (UID: \"470edfe9-5ba7-47dd-9814-80597c3c794e\") " pod="openshift-network-operator/iptables-alerter-j6n6r"
Jul 07 17:53:30.872081 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870363    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d69a68be-0a86-46c6-b598-0e6bbc0d3b4d-konnectivity-ca\") pod \"konnectivity-agent-txjw6\" (UID: \"d69a68be-0a86-46c6-b598-0e6bbc0d3b4d\") " pod="kube-system/konnectivity-agent-txjw6"
Jul 07 17:53:30.872611 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870390    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-os-release\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.872611 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870412    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-etc-sysctl-d\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.872611 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870442    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-host\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.872611 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870466    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmx2n\" (UniqueName: \"kubernetes.io/projected/9ee8c5a4-4788-4665-9331-232aa363342d-kube-api-access-pmx2n\") pod \"multus-additional-cni-plugins-kr84f\" (UID: \"9ee8c5a4-4788-4665-9331-232aa363342d\") " pod="openshift-multus/multus-additional-cni-plugins-kr84f"
Jul 07 17:53:30.872611 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870471    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ee8c5a4-4788-4665-9331-232aa363342d-system-cni-dir\") pod \"multus-additional-cni-plugins-kr84f\" (UID: \"9ee8c5a4-4788-4665-9331-232aa363342d\") " pod="openshift-multus/multus-additional-cni-plugins-kr84f"
Jul 07 17:53:30.872611 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870490    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-host-run-k8s-cni-cncf-io\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.872611 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870498    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ee8c5a4-4788-4665-9331-232aa363342d-cni-binary-copy\") pod \"multus-additional-cni-plugins-kr84f\" (UID: \"9ee8c5a4-4788-4665-9331-232aa363342d\") " pod="openshift-multus/multus-additional-cni-plugins-kr84f"
Jul 07 17:53:30.872611 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870518    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-multus-conf-dir\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.872611 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870542    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-run\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.872611 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870542    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ee8c5a4-4788-4665-9331-232aa363342d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kr84f\" (UID: \"9ee8c5a4-4788-4665-9331-232aa363342d\") " pod="openshift-multus/multus-additional-cni-plugins-kr84f"
Jul 07 17:53:30.872611 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870567    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2cf80a27-5be9-4f63-a32d-d2d8e157a955-ovnkube-config\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.872611 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870579    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9ee8c5a4-4788-4665-9331-232aa363342d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kr84f\" (UID: \"9ee8c5a4-4788-4665-9331-232aa363342d\") " pod="openshift-multus/multus-additional-cni-plugins-kr84f"
Jul 07 17:53:30.872611 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870618    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-etc-sysctl-d\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.872611 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870622    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-host-run-k8s-cni-cncf-io\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.872611 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870628    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad3b117b-52a4-49fa-8b26-e225f8cb3837-host\") pod \"node-ca-t7czl\" (UID: \"ad3b117b-52a4-49fa-8b26-e225f8cb3837\") " pod="openshift-image-registry/node-ca-t7czl"
Jul 07 17:53:30.872611 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870622    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-host\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.872611 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870661    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eefd6e0b-db36-4bd1-910f-17f549aa754d-cni-binary-copy\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.872611 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870680    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-multus-conf-dir\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.873155 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870584    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-run\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.873155 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870690    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-host-var-lib-cni-multus\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.873155 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870520    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-host-run-netns\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.873155 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870694    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-os-release\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.873155 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870662    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad3b117b-52a4-49fa-8b26-e225f8cb3837-host\") pod \"node-ca-t7czl\" (UID: \"ad3b117b-52a4-49fa-8b26-e225f8cb3837\") " pod="openshift-image-registry/node-ca-t7czl"
Jul 07 17:53:30.873155 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.870748    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eefd6e0b-db36-4bd1-910f-17f549aa754d-host-var-lib-cni-multus\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.873155 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.871056    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-tmp\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.873155 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.871199    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d69a68be-0a86-46c6-b598-0e6bbc0d3b4d-konnectivity-ca\") pod \"konnectivity-agent-txjw6\" (UID: \"d69a68be-0a86-46c6-b598-0e6bbc0d3b4d\") " pod="kube-system/konnectivity-agent-txjw6"
Jul 07 17:53:30.873155 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.871370    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2cf80a27-5be9-4f63-a32d-d2d8e157a955-ovn-node-metrics-cert\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.873155 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.871756    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eefd6e0b-db36-4bd1-910f-17f549aa754d-cni-binary-copy\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.873155 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.871937    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9ee8c5a4-4788-4665-9331-232aa363342d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kr84f\" (UID: \"9ee8c5a4-4788-4665-9331-232aa363342d\") " pod="openshift-multus/multus-additional-cni-plugins-kr84f"
Jul 07 17:53:30.873155 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.872616    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d69a68be-0a86-46c6-b598-0e6bbc0d3b4d-agent-certs\") pod \"konnectivity-agent-txjw6\" (UID: \"d69a68be-0a86-46c6-b598-0e6bbc0d3b4d\") " pod="kube-system/konnectivity-agent-txjw6"
Jul 07 17:53:30.873155 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.872849    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-etc-tuned\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.901184 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.901116    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn8xt\" (UniqueName: \"kubernetes.io/projected/eefd6e0b-db36-4bd1-910f-17f549aa754d-kube-api-access-xn8xt\") pod \"multus-vh62r\" (UID: \"eefd6e0b-db36-4bd1-910f-17f549aa754d\") " pod="openshift-multus/multus-vh62r"
Jul 07 17:53:30.906165 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.906130    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsk46\" (UniqueName: \"kubernetes.io/projected/2cf80a27-5be9-4f63-a32d-d2d8e157a955-kube-api-access-hsk46\") pod \"ovnkube-node-76kvc\" (UID: \"2cf80a27-5be9-4f63-a32d-d2d8e157a955\") " pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:30.909213 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.909191    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p247g\" (UniqueName: \"kubernetes.io/projected/ad3b117b-52a4-49fa-8b26-e225f8cb3837-kube-api-access-p247g\") pod \"node-ca-t7czl\" (UID: \"ad3b117b-52a4-49fa-8b26-e225f8cb3837\") " pod="openshift-image-registry/node-ca-t7czl"
Jul 07 17:53:30.909562 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:30.909544    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:53:30.909608 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:30.909568    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:53:30.909608 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:30.909578    2566 projected.go:196] Error preparing data for projected volume kube-api-access-m5zmk for pod openshift-network-diagnostics/network-check-target-hhrd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:53:30.909674 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:30.909650    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/649e0a8c-d3b7-4169-9bc3-65736133a6b3-kube-api-access-m5zmk podName:649e0a8c-d3b7-4169-9bc3-65736133a6b3 nodeName:}" failed. No retries permitted until 2026-07-07 17:53:31.409633261 +0000 UTC m=+2.167194127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-m5zmk" (UniqueName: "kubernetes.io/projected/649e0a8c-d3b7-4169-9bc3-65736133a6b3-kube-api-access-m5zmk") pod "network-check-target-hhrd5" (UID: "649e0a8c-d3b7-4169-9bc3-65736133a6b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:53:30.910816 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.910794    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrsjj\" (UniqueName: \"kubernetes.io/projected/470edfe9-5ba7-47dd-9814-80597c3c794e-kube-api-access-hrsjj\") pod \"iptables-alerter-j6n6r\" (UID: \"470edfe9-5ba7-47dd-9814-80597c3c794e\") " pod="openshift-network-operator/iptables-alerter-j6n6r"
Jul 07 17:53:30.911073 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.911058    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntc4k\" (UniqueName: \"kubernetes.io/projected/0bf127e3-735b-4304-9269-551261b5a0cc-kube-api-access-ntc4k\") pod \"network-metrics-daemon-7v8v2\" (UID: \"0bf127e3-735b-4304-9269-551261b5a0cc\") " pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:53:30.913171 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.913146    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shl57\" (UniqueName: \"kubernetes.io/projected/cbaa3b99-6faf-49fb-8fe1-641f8c0518de-kube-api-access-shl57\") pod \"tuned-28d9s\" (UID: \"cbaa3b99-6faf-49fb-8fe1-641f8c0518de\") " pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:30.913609 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.913590    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmx2n\" (UniqueName: \"kubernetes.io/projected/9ee8c5a4-4788-4665-9331-232aa363342d-kube-api-access-pmx2n\") pod \"multus-additional-cni-plugins-kr84f\" (UID: \"9ee8c5a4-4788-4665-9331-232aa363342d\") " pod="openshift-multus/multus-additional-cni-plugins-kr84f"
Jul 07 17:53:30.941305 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:30.941269    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11bce2051af4a6b9f223b5c48fe134dc.slice/crio-d2a8f32857c69a52ac2d0bde73aa0ebe2bfac46d1049ba257de6a53b3f5d1b4e WatchSource:0}: Error finding container d2a8f32857c69a52ac2d0bde73aa0ebe2bfac46d1049ba257de6a53b3f5d1b4e: Status 404 returned error can't find the container with id d2a8f32857c69a52ac2d0bde73aa0ebe2bfac46d1049ba257de6a53b3f5d1b4e
Jul 07 17:53:30.979425 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.979387    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq"
Jul 07 17:53:30.989397 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:30.989362    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod317de4ec_2cfb_42ac_8b7f_2e332a7bb2f1.slice/crio-f1331ded771d6e84e002f87551e9a85ddc8fd65e493605f145fc6e766eaa9641 WatchSource:0}: Error finding container f1331ded771d6e84e002f87551e9a85ddc8fd65e493605f145fc6e766eaa9641: Status 404 returned error can't find the container with id f1331ded771d6e84e002f87551e9a85ddc8fd65e493605f145fc6e766eaa9641
Jul 07 17:53:30.997257 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:30.996096    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-txjw6"
Jul 07 17:53:31.002748 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:31.002710    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pxsv8"
Jul 07 17:53:31.006406 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:31.006378    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd69a68be_0a86_46c6_b598_0e6bbc0d3b4d.slice/crio-9913e77850b95100882502203a036ff7ba5d92881eeca0a1b5c26b3e3f0ac1e6 WatchSource:0}: Error finding container 9913e77850b95100882502203a036ff7ba5d92881eeca0a1b5c26b3e3f0ac1e6: Status 404 returned error can't find the container with id 9913e77850b95100882502203a036ff7ba5d92881eeca0a1b5c26b3e3f0ac1e6
Jul 07 17:53:31.012717 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:31.012680    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ca7075b_0176_4929_809b_3efa67cb7d5d.slice/crio-f13133efce77d819ca7f55996089aae39093e0280047dae41470fce3c7a6e6d8 WatchSource:0}: Error finding container f13133efce77d819ca7f55996089aae39093e0280047dae41470fce3c7a6e6d8: Status 404 returned error can't find the container with id f13133efce77d819ca7f55996089aae39093e0280047dae41470fce3c7a6e6d8
Jul 07 17:53:31.023042 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:31.023019    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t7czl"
Jul 07 17:53:31.028893 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:31.028860    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j6n6r"
Jul 07 17:53:31.035093 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:31.035061    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad3b117b_52a4_49fa_8b26_e225f8cb3837.slice/crio-e3e5fbbaf789d043b31a440b7fb0f87dd409e28bdf2a686c26bd275039389198 WatchSource:0}: Error finding container e3e5fbbaf789d043b31a440b7fb0f87dd409e28bdf2a686c26bd275039389198: Status 404 returned error can't find the container with id e3e5fbbaf789d043b31a440b7fb0f87dd409e28bdf2a686c26bd275039389198
Jul 07 17:53:31.038220 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:31.038191    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod470edfe9_5ba7_47dd_9814_80597c3c794e.slice/crio-0d9309cfbfd23e1f9ecd56e139ffb3e1342301fad19eeb7446d0212be09742ed WatchSource:0}: Error finding container 0d9309cfbfd23e1f9ecd56e139ffb3e1342301fad19eeb7446d0212be09742ed: Status 404 returned error can't find the container with id 0d9309cfbfd23e1f9ecd56e139ffb3e1342301fad19eeb7446d0212be09742ed
Jul 07 17:53:31.047258 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:31.047233    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:31.057201 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:31.057166    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cf80a27_5be9_4f63_a32d_d2d8e157a955.slice/crio-81fb497740dd3116913cf5e5ff982369952f18c06c7495c6c41c25456a746bf4 WatchSource:0}: Error finding container 81fb497740dd3116913cf5e5ff982369952f18c06c7495c6c41c25456a746bf4: Status 404 returned error can't find the container with id 81fb497740dd3116913cf5e5ff982369952f18c06c7495c6c41c25456a746bf4
Jul 07 17:53:31.065504 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:31.065482    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-28d9s"
Jul 07 17:53:31.074004 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:31.073982    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbaa3b99_6faf_49fb_8fe1_641f8c0518de.slice/crio-08cfccf395a71c20ac53784ddbe0e791009b0cb0abbc2e1b63524d78a2d57268 WatchSource:0}: Error finding container 08cfccf395a71c20ac53784ddbe0e791009b0cb0abbc2e1b63524d78a2d57268: Status 404 returned error can't find the container with id 08cfccf395a71c20ac53784ddbe0e791009b0cb0abbc2e1b63524d78a2d57268
Jul 07 17:53:31.088129 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:31.088103    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kr84f"
Jul 07 17:53:31.091864 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:31.091836    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vh62r"
Jul 07 17:53:31.098501 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:31.098475    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ee8c5a4_4788_4665_9331_232aa363342d.slice/crio-3efc15a88f859bc2062181bceaa73c53e3522fdda2e7cc7a26f0e1fc335c5e0d WatchSource:0}: Error finding container 3efc15a88f859bc2062181bceaa73c53e3522fdda2e7cc7a26f0e1fc335c5e0d: Status 404 returned error can't find the container with id 3efc15a88f859bc2062181bceaa73c53e3522fdda2e7cc7a26f0e1fc335c5e0d
Jul 07 17:53:31.100545 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:53:31.100520    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeefd6e0b_db36_4bd1_910f_17f549aa754d.slice/crio-08e092b9fcb6f7a1f0f26afdb5b3f8cdab7be3dc601819effe6314891ed8ad76 WatchSource:0}: Error finding container 08e092b9fcb6f7a1f0f26afdb5b3f8cdab7be3dc601819effe6314891ed8ad76: Status 404 returned error can't find the container with id 08e092b9fcb6f7a1f0f26afdb5b3f8cdab7be3dc601819effe6314891ed8ad76
Jul 07 17:53:31.190677 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:31.190594    2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:53:31.375467 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:31.375427    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ca929e8-fe5f-4713-ae87-fcfdd2816546-original-pull-secret\") pod \"global-pull-secret-syncer-9qmtf\" (UID: \"5ca929e8-fe5f-4713-ae87-fcfdd2816546\") " pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:53:31.375677 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:31.375503    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bf127e3-735b-4304-9269-551261b5a0cc-metrics-certs\") pod \"network-metrics-daemon-7v8v2\" (UID: \"0bf127e3-735b-4304-9269-551261b5a0cc\") " pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:53:31.375677 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:31.375612    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:53:31.375677 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:31.375640    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:53:31.375874 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:31.375699    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ca929e8-fe5f-4713-ae87-fcfdd2816546-original-pull-secret podName:5ca929e8-fe5f-4713-ae87-fcfdd2816546 nodeName:}" failed. No retries permitted until 2026-07-07 17:53:32.375678224 +0000 UTC m=+3.133239076 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ca929e8-fe5f-4713-ae87-fcfdd2816546-original-pull-secret") pod "global-pull-secret-syncer-9qmtf" (UID: "5ca929e8-fe5f-4713-ae87-fcfdd2816546") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:53:31.375874 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:31.375722    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bf127e3-735b-4304-9269-551261b5a0cc-metrics-certs podName:0bf127e3-735b-4304-9269-551261b5a0cc nodeName:}" failed. No retries permitted until 2026-07-07 17:53:32.375711159 +0000 UTC m=+3.133272010 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bf127e3-735b-4304-9269-551261b5a0cc-metrics-certs") pod "network-metrics-daemon-7v8v2" (UID: "0bf127e3-735b-4304-9269-551261b5a0cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:53:31.475988 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:31.475890    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5zmk\" (UniqueName: \"kubernetes.io/projected/649e0a8c-d3b7-4169-9bc3-65736133a6b3-kube-api-access-m5zmk\") pod \"network-check-target-hhrd5\" (UID: \"649e0a8c-d3b7-4169-9bc3-65736133a6b3\") " pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:53:31.476153 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:31.476090    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:53:31.476153 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:31.476116    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:53:31.476153 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:31.476128    2566 projected.go:196] Error preparing data for projected volume kube-api-access-m5zmk for pod openshift-network-diagnostics/network-check-target-hhrd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:53:31.476322 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:31.476190    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/649e0a8c-d3b7-4169-9bc3-65736133a6b3-kube-api-access-m5zmk podName:649e0a8c-d3b7-4169-9bc3-65736133a6b3 nodeName:}" failed. No retries permitted until 2026-07-07 17:53:32.476171565 +0000 UTC m=+3.233732438 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-m5zmk" (UniqueName: "kubernetes.io/projected/649e0a8c-d3b7-4169-9bc3-65736133a6b3-kube-api-access-m5zmk") pod "network-check-target-hhrd5" (UID: "649e0a8c-d3b7-4169-9bc3-65736133a6b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:53:31.519011 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:31.518954    2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:53:31.739563 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:31.739420    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 17:48:30 +0000 UTC" deadline="2028-03-24 07:09:18.465604342 +0000 UTC"
Jul 07 17:53:31.739563 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:31.739491    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15013h15m46.726117522s"
Jul 07 17:53:31.806167 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:31.806135    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:53:31.806360 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:31.806278    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v8v2" podUID="0bf127e3-735b-4304-9269-551261b5a0cc"
Jul 07 17:53:31.806430 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:31.806369    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:53:31.806483 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:31.806440    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hhrd5" podUID="649e0a8c-d3b7-4169-9bc3-65736133a6b3"
Jul 07 17:53:31.822641 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:31.822566    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-53.ec2.internal" event={"ID":"6da60c6aa145a773b0c59de51f12d9f6","Type":"ContainerStarted","Data":"952470c0ff4e27cbfb7f1513a80f3349d56d37baab6c5e323ea7bf78a4312eb2"}
Jul 07 17:53:31.829106 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:31.829067    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-28d9s" event={"ID":"cbaa3b99-6faf-49fb-8fe1-641f8c0518de","Type":"ContainerStarted","Data":"08cfccf395a71c20ac53784ddbe0e791009b0cb0abbc2e1b63524d78a2d57268"}
Jul 07 17:53:31.836323 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:31.835734    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76kvc" event={"ID":"2cf80a27-5be9-4f63-a32d-d2d8e157a955","Type":"ContainerStarted","Data":"81fb497740dd3116913cf5e5ff982369952f18c06c7495c6c41c25456a746bf4"}
Jul 07 17:53:31.841129 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:31.840637    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j6n6r" event={"ID":"470edfe9-5ba7-47dd-9814-80597c3c794e","Type":"ContainerStarted","Data":"0d9309cfbfd23e1f9ecd56e139ffb3e1342301fad19eeb7446d0212be09742ed"}
Jul 07 17:53:31.851469 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:31.851372    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-txjw6" event={"ID":"d69a68be-0a86-46c6-b598-0e6bbc0d3b4d","Type":"ContainerStarted","Data":"9913e77850b95100882502203a036ff7ba5d92881eeca0a1b5c26b3e3f0ac1e6"}
Jul 07 17:53:31.854609 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:31.854461    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal" event={"ID":"11bce2051af4a6b9f223b5c48fe134dc","Type":"ContainerStarted","Data":"d2a8f32857c69a52ac2d0bde73aa0ebe2bfac46d1049ba257de6a53b3f5d1b4e"}
Jul 07 17:53:31.860290 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:31.860253    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vh62r" event={"ID":"eefd6e0b-db36-4bd1-910f-17f549aa754d","Type":"ContainerStarted","Data":"08e092b9fcb6f7a1f0f26afdb5b3f8cdab7be3dc601819effe6314891ed8ad76"}
Jul 07 17:53:31.868461 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:31.868412    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kr84f" event={"ID":"9ee8c5a4-4788-4665-9331-232aa363342d","Type":"ContainerStarted","Data":"3efc15a88f859bc2062181bceaa73c53e3522fdda2e7cc7a26f0e1fc335c5e0d"}
Jul 07 17:53:31.878269 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:31.878184    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t7czl" event={"ID":"ad3b117b-52a4-49fa-8b26-e225f8cb3837","Type":"ContainerStarted","Data":"e3e5fbbaf789d043b31a440b7fb0f87dd409e28bdf2a686c26bd275039389198"}
Jul 07 17:53:31.888761 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:31.888719    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pxsv8" event={"ID":"1ca7075b-0176-4929-809b-3efa67cb7d5d","Type":"ContainerStarted","Data":"f13133efce77d819ca7f55996089aae39093e0280047dae41470fce3c7a6e6d8"}
Jul 07 17:53:31.897321 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:31.897138    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq" event={"ID":"317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1","Type":"ContainerStarted","Data":"f1331ded771d6e84e002f87551e9a85ddc8fd65e493605f145fc6e766eaa9641"}
Jul 07 17:53:32.383495 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:32.383452    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ca929e8-fe5f-4713-ae87-fcfdd2816546-original-pull-secret\") pod \"global-pull-secret-syncer-9qmtf\" (UID: \"5ca929e8-fe5f-4713-ae87-fcfdd2816546\") " pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:53:32.383707 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:32.383530    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bf127e3-735b-4304-9269-551261b5a0cc-metrics-certs\") pod \"network-metrics-daemon-7v8v2\" (UID: \"0bf127e3-735b-4304-9269-551261b5a0cc\") " pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:53:32.383707 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:32.383631    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:53:32.383707 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:32.383664    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:53:32.383707 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:32.383708    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ca929e8-fe5f-4713-ae87-fcfdd2816546-original-pull-secret podName:5ca929e8-fe5f-4713-ae87-fcfdd2816546 nodeName:}" failed. No retries permitted until 2026-07-07 17:53:34.383687892 +0000 UTC m=+5.141248757 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ca929e8-fe5f-4713-ae87-fcfdd2816546-original-pull-secret") pod "global-pull-secret-syncer-9qmtf" (UID: "5ca929e8-fe5f-4713-ae87-fcfdd2816546") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:53:32.383973 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:32.383730    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bf127e3-735b-4304-9269-551261b5a0cc-metrics-certs podName:0bf127e3-735b-4304-9269-551261b5a0cc nodeName:}" failed. No retries permitted until 2026-07-07 17:53:34.383720271 +0000 UTC m=+5.141281129 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bf127e3-735b-4304-9269-551261b5a0cc-metrics-certs") pod "network-metrics-daemon-7v8v2" (UID: "0bf127e3-735b-4304-9269-551261b5a0cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:53:32.484944 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:32.484901    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5zmk\" (UniqueName: \"kubernetes.io/projected/649e0a8c-d3b7-4169-9bc3-65736133a6b3-kube-api-access-m5zmk\") pod \"network-check-target-hhrd5\" (UID: \"649e0a8c-d3b7-4169-9bc3-65736133a6b3\") " pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:53:32.485132 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:32.485112    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:53:32.485197 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:32.485140    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:53:32.485197 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:32.485154    2566 projected.go:196] Error preparing data for projected volume kube-api-access-m5zmk for pod openshift-network-diagnostics/network-check-target-hhrd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:53:32.485317 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:32.485223    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/649e0a8c-d3b7-4169-9bc3-65736133a6b3-kube-api-access-m5zmk podName:649e0a8c-d3b7-4169-9bc3-65736133a6b3 nodeName:}" failed. No retries permitted until 2026-07-07 17:53:34.485201202 +0000 UTC m=+5.242762054 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-m5zmk" (UniqueName: "kubernetes.io/projected/649e0a8c-d3b7-4169-9bc3-65736133a6b3-kube-api-access-m5zmk") pod "network-check-target-hhrd5" (UID: "649e0a8c-d3b7-4169-9bc3-65736133a6b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:53:32.740122 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:32.740011    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 17:48:30 +0000 UTC" deadline="2027-12-14 19:06:52.060738769 +0000 UTC"
Jul 07 17:53:32.740122 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:32.740064    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12601h13m19.320679621s"
Jul 07 17:53:32.795240 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:32.795205    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:53:32.795453 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:32.795352    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qmtf" podUID="5ca929e8-fe5f-4713-ae87-fcfdd2816546"
Jul 07 17:53:33.072994 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:33.072878    2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:53:33.801796 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:33.801716    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:53:33.802305 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:33.801853    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hhrd5" podUID="649e0a8c-d3b7-4169-9bc3-65736133a6b3"
Jul 07 17:53:33.802305 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:33.802271    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:53:33.802444 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:33.802379    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v8v2" podUID="0bf127e3-735b-4304-9269-551261b5a0cc"
Jul 07 17:53:34.401077 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:34.400242    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ca929e8-fe5f-4713-ae87-fcfdd2816546-original-pull-secret\") pod \"global-pull-secret-syncer-9qmtf\" (UID: \"5ca929e8-fe5f-4713-ae87-fcfdd2816546\") " pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:53:34.401077 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:34.400304    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bf127e3-735b-4304-9269-551261b5a0cc-metrics-certs\") pod \"network-metrics-daemon-7v8v2\" (UID: \"0bf127e3-735b-4304-9269-551261b5a0cc\") " pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:53:34.401077 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:34.400463    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:53:34.401077 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:34.400519    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bf127e3-735b-4304-9269-551261b5a0cc-metrics-certs podName:0bf127e3-735b-4304-9269-551261b5a0cc nodeName:}" failed. No retries permitted until 2026-07-07 17:53:38.400503364 +0000 UTC m=+9.158064215 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bf127e3-735b-4304-9269-551261b5a0cc-metrics-certs") pod "network-metrics-daemon-7v8v2" (UID: "0bf127e3-735b-4304-9269-551261b5a0cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:53:34.401077 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:34.401000    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:53:34.401077 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:34.401041    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ca929e8-fe5f-4713-ae87-fcfdd2816546-original-pull-secret podName:5ca929e8-fe5f-4713-ae87-fcfdd2816546 nodeName:}" failed. No retries permitted until 2026-07-07 17:53:38.401029352 +0000 UTC m=+9.158590203 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ca929e8-fe5f-4713-ae87-fcfdd2816546-original-pull-secret") pod "global-pull-secret-syncer-9qmtf" (UID: "5ca929e8-fe5f-4713-ae87-fcfdd2816546") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:53:34.501869 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:34.501158    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5zmk\" (UniqueName: \"kubernetes.io/projected/649e0a8c-d3b7-4169-9bc3-65736133a6b3-kube-api-access-m5zmk\") pod \"network-check-target-hhrd5\" (UID: \"649e0a8c-d3b7-4169-9bc3-65736133a6b3\") " pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:53:34.501869 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:34.501385    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:53:34.501869 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:34.501404    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:53:34.501869 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:34.501416    2566 projected.go:196] Error preparing data for projected volume kube-api-access-m5zmk for pod openshift-network-diagnostics/network-check-target-hhrd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:53:34.501869 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:34.501474    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/649e0a8c-d3b7-4169-9bc3-65736133a6b3-kube-api-access-m5zmk podName:649e0a8c-d3b7-4169-9bc3-65736133a6b3 nodeName:}" failed. No retries permitted until 2026-07-07 17:53:38.501455839 +0000 UTC m=+9.259016690 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-m5zmk" (UniqueName: "kubernetes.io/projected/649e0a8c-d3b7-4169-9bc3-65736133a6b3-kube-api-access-m5zmk") pod "network-check-target-hhrd5" (UID: "649e0a8c-d3b7-4169-9bc3-65736133a6b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:53:34.795369 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:34.795292    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:53:34.795642 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:34.795423    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qmtf" podUID="5ca929e8-fe5f-4713-ae87-fcfdd2816546"
Jul 07 17:53:35.795529 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:35.795496    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:53:35.795973 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:35.795637    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hhrd5" podUID="649e0a8c-d3b7-4169-9bc3-65736133a6b3"
Jul 07 17:53:35.796046 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:35.796017    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:53:35.796165 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:35.796126    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v8v2" podUID="0bf127e3-735b-4304-9269-551261b5a0cc"
Jul 07 17:53:36.795262 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:36.795223    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:53:36.795458 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:36.795363    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qmtf" podUID="5ca929e8-fe5f-4713-ae87-fcfdd2816546"
Jul 07 17:53:37.797548 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:37.796965    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:53:37.797548 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:37.797018    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:53:37.797548 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:37.797115    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v8v2" podUID="0bf127e3-735b-4304-9269-551261b5a0cc"
Jul 07 17:53:37.797548 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:37.797502    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hhrd5" podUID="649e0a8c-d3b7-4169-9bc3-65736133a6b3"
Jul 07 17:53:38.433491 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:38.433461    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ca929e8-fe5f-4713-ae87-fcfdd2816546-original-pull-secret\") pod \"global-pull-secret-syncer-9qmtf\" (UID: \"5ca929e8-fe5f-4713-ae87-fcfdd2816546\") " pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:53:38.433639 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:38.433509    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bf127e3-735b-4304-9269-551261b5a0cc-metrics-certs\") pod \"network-metrics-daemon-7v8v2\" (UID: \"0bf127e3-735b-4304-9269-551261b5a0cc\") " pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:53:38.433639 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:38.433621    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:53:38.433841 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:38.433687    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ca929e8-fe5f-4713-ae87-fcfdd2816546-original-pull-secret podName:5ca929e8-fe5f-4713-ae87-fcfdd2816546 nodeName:}" failed. No retries permitted until 2026-07-07 17:53:46.433669485 +0000 UTC m=+17.191230335 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ca929e8-fe5f-4713-ae87-fcfdd2816546-original-pull-secret") pod "global-pull-secret-syncer-9qmtf" (UID: "5ca929e8-fe5f-4713-ae87-fcfdd2816546") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:53:38.433841 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:38.433621    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:53:38.433841 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:38.433742    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bf127e3-735b-4304-9269-551261b5a0cc-metrics-certs podName:0bf127e3-735b-4304-9269-551261b5a0cc nodeName:}" failed. No retries permitted until 2026-07-07 17:53:46.433730353 +0000 UTC m=+17.191291203 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bf127e3-735b-4304-9269-551261b5a0cc-metrics-certs") pod "network-metrics-daemon-7v8v2" (UID: "0bf127e3-735b-4304-9269-551261b5a0cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:53:38.534901 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:38.534853    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5zmk\" (UniqueName: \"kubernetes.io/projected/649e0a8c-d3b7-4169-9bc3-65736133a6b3-kube-api-access-m5zmk\") pod \"network-check-target-hhrd5\" (UID: \"649e0a8c-d3b7-4169-9bc3-65736133a6b3\") " pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:53:38.535076 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:38.535055    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:53:38.535076 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:38.535076    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:53:38.535178 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:38.535089    2566 projected.go:196] Error preparing data for projected volume kube-api-access-m5zmk for pod openshift-network-diagnostics/network-check-target-hhrd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:53:38.535178 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:38.535149    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/649e0a8c-d3b7-4169-9bc3-65736133a6b3-kube-api-access-m5zmk podName:649e0a8c-d3b7-4169-9bc3-65736133a6b3 nodeName:}" failed. No retries permitted until 2026-07-07 17:53:46.535128572 +0000 UTC m=+17.292689427 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-m5zmk" (UniqueName: "kubernetes.io/projected/649e0a8c-d3b7-4169-9bc3-65736133a6b3-kube-api-access-m5zmk") pod "network-check-target-hhrd5" (UID: "649e0a8c-d3b7-4169-9bc3-65736133a6b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:53:38.795375 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:38.794850    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:53:38.795375 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:38.794982    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qmtf" podUID="5ca929e8-fe5f-4713-ae87-fcfdd2816546"
Jul 07 17:53:39.796287 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:39.795792    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:53:39.796287 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:39.795922    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hhrd5" podUID="649e0a8c-d3b7-4169-9bc3-65736133a6b3"
Jul 07 17:53:39.796287 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:39.795980    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:53:39.796287 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:39.796133    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v8v2" podUID="0bf127e3-735b-4304-9269-551261b5a0cc"
Jul 07 17:53:40.795593 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:40.795144    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:53:40.795593 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:40.795255    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qmtf" podUID="5ca929e8-fe5f-4713-ae87-fcfdd2816546"
Jul 07 17:53:41.795568 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:41.795538    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:53:41.796037 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:41.795585    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:53:41.796037 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:41.795676    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v8v2" podUID="0bf127e3-735b-4304-9269-551261b5a0cc"
Jul 07 17:53:41.796037 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:41.795812    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hhrd5" podUID="649e0a8c-d3b7-4169-9bc3-65736133a6b3"
Jul 07 17:53:42.795467 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:42.795438    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:53:42.795613 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:42.795541    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qmtf" podUID="5ca929e8-fe5f-4713-ae87-fcfdd2816546"
Jul 07 17:53:43.795248 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:43.795213    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:53:43.795248 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:43.795257    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:53:43.795507 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:43.795342    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hhrd5" podUID="649e0a8c-d3b7-4169-9bc3-65736133a6b3"
Jul 07 17:53:43.795507 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:43.795417    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v8v2" podUID="0bf127e3-735b-4304-9269-551261b5a0cc"
Jul 07 17:53:44.794769 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:44.794727    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:53:44.795237 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:44.794889    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qmtf" podUID="5ca929e8-fe5f-4713-ae87-fcfdd2816546"
Jul 07 17:53:45.797588 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:45.797559    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:53:45.798049 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:45.797707    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v8v2" podUID="0bf127e3-735b-4304-9269-551261b5a0cc"
Jul 07 17:53:45.798049 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:45.797768    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:53:45.798049 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:45.797907    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hhrd5" podUID="649e0a8c-d3b7-4169-9bc3-65736133a6b3"
Jul 07 17:53:46.491546 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:46.491501    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bf127e3-735b-4304-9269-551261b5a0cc-metrics-certs\") pod \"network-metrics-daemon-7v8v2\" (UID: \"0bf127e3-735b-4304-9269-551261b5a0cc\") " pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:53:46.491808 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:46.491604    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ca929e8-fe5f-4713-ae87-fcfdd2816546-original-pull-secret\") pod \"global-pull-secret-syncer-9qmtf\" (UID: \"5ca929e8-fe5f-4713-ae87-fcfdd2816546\") " pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:53:46.491808 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:46.491670    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:53:46.491808 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:46.491721    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:53:46.491808 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:46.491739    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bf127e3-735b-4304-9269-551261b5a0cc-metrics-certs podName:0bf127e3-735b-4304-9269-551261b5a0cc nodeName:}" failed. No retries permitted until 2026-07-07 17:54:02.491717379 +0000 UTC m=+33.249278244 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bf127e3-735b-4304-9269-551261b5a0cc-metrics-certs") pod "network-metrics-daemon-7v8v2" (UID: "0bf127e3-735b-4304-9269-551261b5a0cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:53:46.491808 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:46.491777    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ca929e8-fe5f-4713-ae87-fcfdd2816546-original-pull-secret podName:5ca929e8-fe5f-4713-ae87-fcfdd2816546 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:02.491761338 +0000 UTC m=+33.249322191 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ca929e8-fe5f-4713-ae87-fcfdd2816546-original-pull-secret") pod "global-pull-secret-syncer-9qmtf" (UID: "5ca929e8-fe5f-4713-ae87-fcfdd2816546") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:53:46.593080 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:46.593039    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5zmk\" (UniqueName: \"kubernetes.io/projected/649e0a8c-d3b7-4169-9bc3-65736133a6b3-kube-api-access-m5zmk\") pod \"network-check-target-hhrd5\" (UID: \"649e0a8c-d3b7-4169-9bc3-65736133a6b3\") " pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:53:46.593264 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:46.593201    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:53:46.593264 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:46.593219    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:53:46.593264 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:46.593234    2566 projected.go:196] Error preparing data for projected volume kube-api-access-m5zmk for pod openshift-network-diagnostics/network-check-target-hhrd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:53:46.593412 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:46.593297    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/649e0a8c-d3b7-4169-9bc3-65736133a6b3-kube-api-access-m5zmk podName:649e0a8c-d3b7-4169-9bc3-65736133a6b3 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:02.593281161 +0000 UTC m=+33.350842015 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-m5zmk" (UniqueName: "kubernetes.io/projected/649e0a8c-d3b7-4169-9bc3-65736133a6b3-kube-api-access-m5zmk") pod "network-check-target-hhrd5" (UID: "649e0a8c-d3b7-4169-9bc3-65736133a6b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:53:46.794911 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:46.794833    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:53:46.795114 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:46.794956    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qmtf" podUID="5ca929e8-fe5f-4713-ae87-fcfdd2816546"
Jul 07 17:53:47.795606 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:47.795563    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:53:47.796131 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:47.795619    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:53:47.796131 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:47.795717    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v8v2" podUID="0bf127e3-735b-4304-9269-551261b5a0cc"
Jul 07 17:53:47.796250 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:47.796200    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hhrd5" podUID="649e0a8c-d3b7-4169-9bc3-65736133a6b3"
Jul 07 17:53:48.794989 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:48.794954    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:53:48.795179 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:48.795088    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qmtf" podUID="5ca929e8-fe5f-4713-ae87-fcfdd2816546"
Jul 07 17:53:49.795711 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:49.795678    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:53:49.796133 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:49.795771    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v8v2" podUID="0bf127e3-735b-4304-9269-551261b5a0cc"
Jul 07 17:53:49.796133 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:49.795878    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:53:49.796133 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:49.795979    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hhrd5" podUID="649e0a8c-d3b7-4169-9bc3-65736133a6b3"
Jul 07 17:53:50.795344 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:50.795309    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:53:50.795540 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:50.795432    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qmtf" podUID="5ca929e8-fe5f-4713-ae87-fcfdd2816546"
Jul 07 17:53:51.795407 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:51.795375    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:53:51.795407 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:51.795395    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:53:51.796016 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:51.795519    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v8v2" podUID="0bf127e3-735b-4304-9269-551261b5a0cc"
Jul 07 17:53:51.796016 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:51.795608    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hhrd5" podUID="649e0a8c-d3b7-4169-9bc3-65736133a6b3"
Jul 07 17:53:51.950778 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:51.950716    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vh62r" event={"ID":"eefd6e0b-db36-4bd1-910f-17f549aa754d","Type":"ContainerStarted","Data":"27e9d40593e7a18194c3d2c904e45177ab5d0c7e46ae98332d92e74e80df1fee"}
Jul 07 17:53:51.952407 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:51.952381    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-53.ec2.internal" event={"ID":"6da60c6aa145a773b0c59de51f12d9f6","Type":"ContainerStarted","Data":"53d2907907b201185e5abc6970f5c5b0294c79e7006cb5680ad7b070bcf8405a"}
Jul 07 17:53:51.953926 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:51.953904    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-28d9s" event={"ID":"cbaa3b99-6faf-49fb-8fe1-641f8c0518de","Type":"ContainerStarted","Data":"45ff4598c3eadbc450592a2e2fa8b083dd02c9adbd52a24207dfdd1b2fdd7a5e"}
Jul 07 17:53:51.956259 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:51.956203    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76kvc" event={"ID":"2cf80a27-5be9-4f63-a32d-d2d8e157a955","Type":"ContainerStarted","Data":"cbb46e4ecd4125e1b7bf5864e60f5791ca116d0c00a1e0177e80d607075e0dd8"}
Jul 07 17:53:51.956307 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:51.956263    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76kvc" event={"ID":"2cf80a27-5be9-4f63-a32d-d2d8e157a955","Type":"ContainerStarted","Data":"1ff4682c1a4602d8af3b446084f65608befd3fbae58e919305c6129246db5336"}
Jul 07 17:53:51.970276 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:51.970232    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vh62r" podStartSLOduration=1.462166564 podStartE2EDuration="21.970215587s" totalImagesPullingTime="20.508049023s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:53:51.969721193 +0000 UTC m=+22.727282084" watchObservedRunningTime="2026-07-07 17:53:51.970215587 +0000 UTC m=+22.727776458"
Jul 07 17:53:51.988537 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:51.988490    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-28d9s" podStartSLOduration=1.500985679 podStartE2EDuration="21.988471229s" totalImagesPullingTime="20.48748555s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:53:51.988364573 +0000 UTC m=+22.745925445" watchObservedRunningTime="2026-07-07 17:53:51.988471229 +0000 UTC m=+22.746032101"
Jul 07 17:53:52.003733 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:52.003686    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-53.ec2.internal" podStartSLOduration=22.003669118 podStartE2EDuration="22.003669118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:53:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:53:52.003094094 +0000 UTC m=+22.760654991" watchObservedRunningTime="2026-07-07 17:53:52.003669118 +0000 UTC m=+22.761230047"
Jul 07 17:53:52.795771 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:52.795577    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:53:52.796527 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:52.795866    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qmtf" podUID="5ca929e8-fe5f-4713-ae87-fcfdd2816546"
Jul 07 17:53:52.960901 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:52.960868    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76kvc" event={"ID":"2cf80a27-5be9-4f63-a32d-d2d8e157a955","Type":"ContainerStarted","Data":"d7286cfefdc529cf3e62a6a0d003b07c0bd33f78b17349afcadc96a4dc187520"}
Jul 07 17:53:52.961100 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:52.960950    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76kvc" event={"ID":"2cf80a27-5be9-4f63-a32d-d2d8e157a955","Type":"ContainerStarted","Data":"c97d7f6e21593a90faaf7b184a639da76ac69c0d552915361e5d4eaee8cc103a"}
Jul 07 17:53:52.961100 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:52.961001    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76kvc" event={"ID":"2cf80a27-5be9-4f63-a32d-d2d8e157a955","Type":"ContainerStarted","Data":"888d78a1a3b71b6f7f31422673694268f9ca7c96da6c282794e5a3f711a28789"}
Jul 07 17:53:52.961100 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:52.961039    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76kvc" event={"ID":"2cf80a27-5be9-4f63-a32d-d2d8e157a955","Type":"ContainerStarted","Data":"3074d8c96777d935f64c06cdd9e7b71a6ef686528b0f641ca22bb1d556bfcaaa"}
Jul 07 17:53:52.962167 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:52.962135    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-txjw6" event={"ID":"d69a68be-0a86-46c6-b598-0e6bbc0d3b4d","Type":"ContainerStarted","Data":"14a5d4611df9225b0a9ea7da9f49410cf8c93c4204eb315c84966fb6ddd85b04"}
Jul 07 17:53:52.963684 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:52.963662    2566 generic.go:356] "Generic (PLEG): container finished" podID="11bce2051af4a6b9f223b5c48fe134dc" containerID="6d1210136a2e1c33d01c1ba52f3128496b94d6659d194123eb8ba38f07dd990e" exitCode=0
Jul 07 17:53:52.963799 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:52.963729    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal" event={"ID":"11bce2051af4a6b9f223b5c48fe134dc","Type":"ContainerDied","Data":"6d1210136a2e1c33d01c1ba52f3128496b94d6659d194123eb8ba38f07dd990e"}
Jul 07 17:53:52.965238 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:52.965215    2566 generic.go:356] "Generic (PLEG): container finished" podID="9ee8c5a4-4788-4665-9331-232aa363342d" containerID="fa9a43e0d4663ab6851102ca3c4306eb3db90e216312d29efd792c9b0eb0510f" exitCode=0
Jul 07 17:53:52.965306 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:52.965286    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kr84f" event={"ID":"9ee8c5a4-4788-4665-9331-232aa363342d","Type":"ContainerDied","Data":"fa9a43e0d4663ab6851102ca3c4306eb3db90e216312d29efd792c9b0eb0510f"}
Jul 07 17:53:52.966914 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:52.966888    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t7czl" event={"ID":"ad3b117b-52a4-49fa-8b26-e225f8cb3837","Type":"ContainerStarted","Data":"08ad03abb0db1da6cf1ab1b98ae0773ba7807e4855cd094fbc2f70386930b20d"}
Jul 07 17:53:52.968355 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:52.968325    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pxsv8" event={"ID":"1ca7075b-0176-4929-809b-3efa67cb7d5d","Type":"ContainerStarted","Data":"ef71258fa23307336c7cd7d118cfbf8508d9f8eb39258f4543b7851d31f79e3e"}
Jul 07 17:53:52.969728 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:52.969707    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq" event={"ID":"317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1","Type":"ContainerStarted","Data":"d62f7cabc9ed759852891c4111b47fca2326f6648ea9f60e119cc7ced0d61c48"}
Jul 07 17:53:52.984690 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:52.984650    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-txjw6" podStartSLOduration=2.429733483 podStartE2EDuration="22.984636639s" totalImagesPullingTime="20.554903156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:53:52.984460773 +0000 UTC m=+23.742021645" watchObservedRunningTime="2026-07-07 17:53:52.984636639 +0000 UTC m=+23.742197508"
Jul 07 17:53:53.018557 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:53.018480    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-t7czl" podStartSLOduration=2.486884384 podStartE2EDuration="23.018460383s" totalImagesPullingTime="20.531575999s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:53:53.018067234 +0000 UTC m=+23.775628105" watchObservedRunningTime="2026-07-07 17:53:53.018460383 +0000 UTC m=+23.776021255"
Jul 07 17:53:53.060225 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:53.060176    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pxsv8" podStartSLOduration=2.496405892 podStartE2EDuration="23.060153872s" totalImagesPullingTime="20.56374798s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:53:53.059676153 +0000 UTC m=+23.817237027" watchObservedRunningTime="2026-07-07 17:53:53.060153872 +0000 UTC m=+23.817714746"
Jul 07 17:53:53.795313 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:53.795279    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:53:53.795626 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:53.795386    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hhrd5" podUID="649e0a8c-d3b7-4169-9bc3-65736133a6b3"
Jul 07 17:53:53.795626 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:53.795447    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:53:53.795626 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:53.795545    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v8v2" podUID="0bf127e3-735b-4304-9269-551261b5a0cc"
Jul 07 17:53:53.955241 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:53.955197    2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 17:53:53.973748 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:53.973702    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j6n6r" event={"ID":"470edfe9-5ba7-47dd-9814-80597c3c794e","Type":"ContainerStarted","Data":"955fd4dbbcb366fa527933ba50d60703a585b6bc8c7f921d922addb6acc7c5a7"}
Jul 07 17:53:53.975790 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:53.975736    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal" event={"ID":"11bce2051af4a6b9f223b5c48fe134dc","Type":"ContainerStarted","Data":"8127abc5a198691b199e4dcbf95c8d71c0a4f05088c4974a3195e04bd92e0f26"}
Jul 07 17:53:53.977993 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:53.977965    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq" event={"ID":"317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1","Type":"ContainerStarted","Data":"9a8a819e3d656e2af81c8b854f2f24561a5094d68d251c4c955268b1de4b0992"}
Jul 07 17:53:53.992761 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:53.992701    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-j6n6r" podStartSLOduration=3.468894707 podStartE2EDuration="23.992682087s" totalImagesPullingTime="20.52378738s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:53:53.992649139 +0000 UTC m=+24.750210010" watchObservedRunningTime="2026-07-07 17:53:53.992682087 +0000 UTC m=+24.750242957"
Jul 07 17:53:54.009189 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:54.009133    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-53.ec2.internal" podStartSLOduration=24.009117125 podStartE2EDuration="24.009117125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:53:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:53:54.008779767 +0000 UTC m=+24.766340638" watchObservedRunningTime="2026-07-07 17:53:54.009117125 +0000 UTC m=+24.766677996"
Jul 07 17:53:54.741430 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:54.741295    2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T17:53:53.955222193Z","UUID":"19c2f80b-73c1-4122-b95b-0fe035b543f2","Handler":null,"Name":"","Endpoint":""}
Jul 07 17:53:54.743289 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:54.743262    2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 17:53:54.743450 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:54.743310    2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 17:53:54.795205 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:54.795167    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:53:54.795394 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:54.795311    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qmtf" podUID="5ca929e8-fe5f-4713-ae87-fcfdd2816546"
Jul 07 17:53:54.984125 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:54.984086    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76kvc" event={"ID":"2cf80a27-5be9-4f63-a32d-d2d8e157a955","Type":"ContainerStarted","Data":"33da19867ac0825d2d741842c95a5960acbb64f06a8eae982337ba4659907336"}
Jul 07 17:53:55.795139 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:55.795103    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:53:55.795329 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:55.795247    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v8v2" podUID="0bf127e3-735b-4304-9269-551261b5a0cc"
Jul 07 17:53:55.795329 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:55.795102    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:53:55.795457 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:55.795350    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hhrd5" podUID="649e0a8c-d3b7-4169-9bc3-65736133a6b3"
Jul 07 17:53:55.989004 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:55.988960    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq" event={"ID":"317de4ec-2cfb-42ac-8b7f-2e332a7bb2f1","Type":"ContainerStarted","Data":"44ac7b699fe68e699dd4fd9650e225798dd872912a43abbaacfc88d8af2addcb"}
Jul 07 17:53:56.011841 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:56.011778    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-llnwq" podStartSLOduration=2.704021591 podStartE2EDuration="26.011762043s" totalImagesPullingTime="23.307740452s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:53:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:53:56.010479198 +0000 UTC m=+26.768040069" watchObservedRunningTime="2026-07-07 17:53:56.011762043 +0000 UTC m=+26.769322913"
Jul 07 17:53:56.213764 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:56.213730    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-txjw6"
Jul 07 17:53:56.214323 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:56.214301    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-txjw6"
Jul 07 17:53:56.794794 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:56.794764    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:53:56.795002 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:56.794907    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qmtf" podUID="5ca929e8-fe5f-4713-ae87-fcfdd2816546"
Jul 07 17:53:56.992298 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:56.992057    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-txjw6"
Jul 07 17:53:56.992738 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:56.992624    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-txjw6"
Jul 07 17:53:57.795160 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:57.795108    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:53:57.795351 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:57.795254    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hhrd5" podUID="649e0a8c-d3b7-4169-9bc3-65736133a6b3"
Jul 07 17:53:57.795351 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:57.795311    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:53:57.795454 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:57.795429    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v8v2" podUID="0bf127e3-735b-4304-9269-551261b5a0cc"
Jul 07 17:53:58.795873 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:58.795668    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:53:58.796582 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:58.795949    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qmtf" podUID="5ca929e8-fe5f-4713-ae87-fcfdd2816546"
Jul 07 17:53:58.998016 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:58.997972    2566 generic.go:356] "Generic (PLEG): container finished" podID="9ee8c5a4-4788-4665-9331-232aa363342d" containerID="a59ec9e15b227fc4502a789a3bccdd014dad85ffafd3d63820090c1dbc1108b5" exitCode=0
Jul 07 17:53:58.998206 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:58.998057    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kr84f" event={"ID":"9ee8c5a4-4788-4665-9331-232aa363342d","Type":"ContainerDied","Data":"a59ec9e15b227fc4502a789a3bccdd014dad85ffafd3d63820090c1dbc1108b5"}
Jul 07 17:53:59.001522 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:59.001492    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76kvc" event={"ID":"2cf80a27-5be9-4f63-a32d-d2d8e157a955","Type":"ContainerStarted","Data":"a4b29cafb1bbb09a3f6633a61c6429c01832980a5d39a53291f9e910f1668125"}
Jul 07 17:53:59.001725 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:59.001661    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:59.001792 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:59.001760    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:59.001932 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:59.001904    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:59.017480 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:59.017461    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:59.017607 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:59.017553    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:53:59.796099 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:59.796068    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:53:59.796599 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:59.796177    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v8v2" podUID="0bf127e3-735b-4304-9269-551261b5a0cc"
Jul 07 17:53:59.796599 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:53:59.796224    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:53:59.796599 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:53:59.796301    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hhrd5" podUID="649e0a8c-d3b7-4169-9bc3-65736133a6b3"
Jul 07 17:54:00.279568 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:00.279393    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-76kvc" podStartSLOduration=9.673713895 podStartE2EDuration="30.279371684s" totalImagesPullingTime="20.605657789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:53:59.052285072 +0000 UTC m=+29.809845933" watchObservedRunningTime="2026-07-07 17:54:00.279371684 +0000 UTC m=+31.036932556"
Jul 07 17:54:00.280066 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:00.280046    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hhrd5"]
Jul 07 17:54:00.280166 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:00.280148    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:54:00.280259 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:00.280234    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hhrd5" podUID="649e0a8c-d3b7-4169-9bc3-65736133a6b3"
Jul 07 17:54:00.282903 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:00.282878    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9qmtf"]
Jul 07 17:54:00.283061 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:00.282999    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:54:00.283129 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:00.283105    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qmtf" podUID="5ca929e8-fe5f-4713-ae87-fcfdd2816546"
Jul 07 17:54:00.283934 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:00.283905    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7v8v2"]
Jul 07 17:54:00.284037 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:00.283992    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:54:00.284095 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:00.284079    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v8v2" podUID="0bf127e3-735b-4304-9269-551261b5a0cc"
Jul 07 17:54:01.010899 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:01.010865    2566 generic.go:356] "Generic (PLEG): container finished" podID="9ee8c5a4-4788-4665-9331-232aa363342d" containerID="9e346dc3336323fe54d7190e03f5f7221a7f3115cf0caf2430f030c3ed682653" exitCode=0
Jul 07 17:54:01.011421 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:01.010942    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kr84f" event={"ID":"9ee8c5a4-4788-4665-9331-232aa363342d","Type":"ContainerDied","Data":"9e346dc3336323fe54d7190e03f5f7221a7f3115cf0caf2430f030c3ed682653"}
Jul 07 17:54:01.794890 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:01.794850    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:54:01.795061 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:01.794901    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:54:01.795061 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:01.794850    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:54:01.795061 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:01.794991    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hhrd5" podUID="649e0a8c-d3b7-4169-9bc3-65736133a6b3"
Jul 07 17:54:01.795061 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:01.795051    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qmtf" podUID="5ca929e8-fe5f-4713-ae87-fcfdd2816546"
Jul 07 17:54:01.795252 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:01.795170    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v8v2" podUID="0bf127e3-735b-4304-9269-551261b5a0cc"
Jul 07 17:54:02.505982 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:02.505939    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ca929e8-fe5f-4713-ae87-fcfdd2816546-original-pull-secret\") pod \"global-pull-secret-syncer-9qmtf\" (UID: \"5ca929e8-fe5f-4713-ae87-fcfdd2816546\") " pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:54:02.506411 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:02.505997    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bf127e3-735b-4304-9269-551261b5a0cc-metrics-certs\") pod \"network-metrics-daemon-7v8v2\" (UID: \"0bf127e3-735b-4304-9269-551261b5a0cc\") " pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:54:02.506411 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:02.506088    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:54:02.506411 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:02.506127    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:54:02.506411 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:02.506153    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ca929e8-fe5f-4713-ae87-fcfdd2816546-original-pull-secret podName:5ca929e8-fe5f-4713-ae87-fcfdd2816546 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:34.506139996 +0000 UTC m=+65.263700845 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ca929e8-fe5f-4713-ae87-fcfdd2816546-original-pull-secret") pod "global-pull-secret-syncer-9qmtf" (UID: "5ca929e8-fe5f-4713-ae87-fcfdd2816546") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:54:02.506411 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:02.506178    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bf127e3-735b-4304-9269-551261b5a0cc-metrics-certs podName:0bf127e3-735b-4304-9269-551261b5a0cc nodeName:}" failed. No retries permitted until 2026-07-07 17:54:34.506163991 +0000 UTC m=+65.263724839 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bf127e3-735b-4304-9269-551261b5a0cc-metrics-certs") pod "network-metrics-daemon-7v8v2" (UID: "0bf127e3-735b-4304-9269-551261b5a0cc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:54:02.607334 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:02.607299    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5zmk\" (UniqueName: \"kubernetes.io/projected/649e0a8c-d3b7-4169-9bc3-65736133a6b3-kube-api-access-m5zmk\") pod \"network-check-target-hhrd5\" (UID: \"649e0a8c-d3b7-4169-9bc3-65736133a6b3\") " pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:54:02.607499 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:02.607440    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:54:02.607499 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:02.607453    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:54:02.607499 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:02.607463    2566 projected.go:196] Error preparing data for projected volume kube-api-access-m5zmk for pod openshift-network-diagnostics/network-check-target-hhrd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:54:02.607612 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:02.607513    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/649e0a8c-d3b7-4169-9bc3-65736133a6b3-kube-api-access-m5zmk podName:649e0a8c-d3b7-4169-9bc3-65736133a6b3 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:34.607500776 +0000 UTC m=+65.365061624 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-m5zmk" (UniqueName: "kubernetes.io/projected/649e0a8c-d3b7-4169-9bc3-65736133a6b3-kube-api-access-m5zmk") pod "network-check-target-hhrd5" (UID: "649e0a8c-d3b7-4169-9bc3-65736133a6b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:54:03.017488 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:03.017441    2566 generic.go:356] "Generic (PLEG): container finished" podID="9ee8c5a4-4788-4665-9331-232aa363342d" containerID="18595aceae67822efaeb1b9b6c11139a56b595da380707b39c093624c0382344" exitCode=0
Jul 07 17:54:03.017488 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:03.017491    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kr84f" event={"ID":"9ee8c5a4-4788-4665-9331-232aa363342d","Type":"ContainerDied","Data":"18595aceae67822efaeb1b9b6c11139a56b595da380707b39c093624c0382344"}
Jul 07 17:54:03.795192 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:03.795153    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:54:03.795662 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:03.795195    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:54:03.795662 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:03.795160    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:54:03.795662 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:03.795255    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hhrd5" podUID="649e0a8c-d3b7-4169-9bc3-65736133a6b3"
Jul 07 17:54:03.795662 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:03.795377    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v8v2" podUID="0bf127e3-735b-4304-9269-551261b5a0cc"
Jul 07 17:54:03.795662 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:03.795436    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9qmtf" podUID="5ca929e8-fe5f-4713-ae87-fcfdd2816546"
Jul 07 17:54:04.541719 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.541691    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-53.ec2.internal" event="NodeReady"
Jul 07 17:54:04.541932 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.541849    2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 17:54:04.589952 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.589912    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vsbcs"]
Jul 07 17:54:04.593022 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.592996    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vsbcs"
Jul 07 17:54:04.593350 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.593326    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-c6ss5"]
Jul 07 17:54:04.595558 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.595522    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 17:54:04.595707 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.595677    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 17:54:04.595818 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.595677    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q4bnp\""
Jul 07 17:54:04.595903 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.595888    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c6ss5"
Jul 07 17:54:04.598562 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.598355    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kjzch\""
Jul 07 17:54:04.598562 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.598466    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 17:54:04.598744 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.598599    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 17:54:04.598997 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.598982    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 17:54:04.606651 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.606623    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vsbcs"]
Jul 07 17:54:04.611364 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.611335    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c6ss5"]
Jul 07 17:54:04.722691 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.722656    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c59bceb7-2ee5-4f47-b279-31b1ff19937a-cert\") pod \"ingress-canary-c6ss5\" (UID: \"c59bceb7-2ee5-4f47-b279-31b1ff19937a\") " pod="openshift-ingress-canary/ingress-canary-c6ss5"
Jul 07 17:54:04.722894 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.722696    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3adf617f-d40a-4d88-bfb2-4409d1298149-config-volume\") pod \"dns-default-vsbcs\" (UID: \"3adf617f-d40a-4d88-bfb2-4409d1298149\") " pod="openshift-dns/dns-default-vsbcs"
Jul 07 17:54:04.722894 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.722727    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3adf617f-d40a-4d88-bfb2-4409d1298149-metrics-tls\") pod \"dns-default-vsbcs\" (UID: \"3adf617f-d40a-4d88-bfb2-4409d1298149\") " pod="openshift-dns/dns-default-vsbcs"
Jul 07 17:54:04.722894 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.722790    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjvm6\" (UniqueName: \"kubernetes.io/projected/c59bceb7-2ee5-4f47-b279-31b1ff19937a-kube-api-access-xjvm6\") pod \"ingress-canary-c6ss5\" (UID: \"c59bceb7-2ee5-4f47-b279-31b1ff19937a\") " pod="openshift-ingress-canary/ingress-canary-c6ss5"
Jul 07 17:54:04.722894 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.722818    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3adf617f-d40a-4d88-bfb2-4409d1298149-tmp-dir\") pod \"dns-default-vsbcs\" (UID: \"3adf617f-d40a-4d88-bfb2-4409d1298149\") " pod="openshift-dns/dns-default-vsbcs"
Jul 07 17:54:04.722894 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.722864    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv6kj\" (UniqueName: \"kubernetes.io/projected/3adf617f-d40a-4d88-bfb2-4409d1298149-kube-api-access-cv6kj\") pod \"dns-default-vsbcs\" (UID: \"3adf617f-d40a-4d88-bfb2-4409d1298149\") " pod="openshift-dns/dns-default-vsbcs"
Jul 07 17:54:04.824168 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.824072    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjvm6\" (UniqueName: \"kubernetes.io/projected/c59bceb7-2ee5-4f47-b279-31b1ff19937a-kube-api-access-xjvm6\") pod \"ingress-canary-c6ss5\" (UID: \"c59bceb7-2ee5-4f47-b279-31b1ff19937a\") " pod="openshift-ingress-canary/ingress-canary-c6ss5"
Jul 07 17:54:04.824168 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.824116    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3adf617f-d40a-4d88-bfb2-4409d1298149-tmp-dir\") pod \"dns-default-vsbcs\" (UID: \"3adf617f-d40a-4d88-bfb2-4409d1298149\") " pod="openshift-dns/dns-default-vsbcs"
Jul 07 17:54:04.824168 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.824143    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv6kj\" (UniqueName: \"kubernetes.io/projected/3adf617f-d40a-4d88-bfb2-4409d1298149-kube-api-access-cv6kj\") pod \"dns-default-vsbcs\" (UID: \"3adf617f-d40a-4d88-bfb2-4409d1298149\") " pod="openshift-dns/dns-default-vsbcs"
Jul 07 17:54:04.824718 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.824219    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c59bceb7-2ee5-4f47-b279-31b1ff19937a-cert\") pod \"ingress-canary-c6ss5\" (UID: \"c59bceb7-2ee5-4f47-b279-31b1ff19937a\") " pod="openshift-ingress-canary/ingress-canary-c6ss5"
Jul 07 17:54:04.824718 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.824243    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3adf617f-d40a-4d88-bfb2-4409d1298149-config-volume\") pod \"dns-default-vsbcs\" (UID: \"3adf617f-d40a-4d88-bfb2-4409d1298149\") " pod="openshift-dns/dns-default-vsbcs"
Jul 07 17:54:04.824718 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.824281    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3adf617f-d40a-4d88-bfb2-4409d1298149-metrics-tls\") pod \"dns-default-vsbcs\" (UID: \"3adf617f-d40a-4d88-bfb2-4409d1298149\") " pod="openshift-dns/dns-default-vsbcs"
Jul 07 17:54:04.824718 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:04.824376    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:54:04.824718 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:04.824435    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3adf617f-d40a-4d88-bfb2-4409d1298149-metrics-tls podName:3adf617f-d40a-4d88-bfb2-4409d1298149 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:05.32441865 +0000 UTC m=+36.081979499 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3adf617f-d40a-4d88-bfb2-4409d1298149-metrics-tls") pod "dns-default-vsbcs" (UID: "3adf617f-d40a-4d88-bfb2-4409d1298149") : secret "dns-default-metrics-tls" not found
Jul 07 17:54:04.824718 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.824486    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3adf617f-d40a-4d88-bfb2-4409d1298149-tmp-dir\") pod \"dns-default-vsbcs\" (UID: \"3adf617f-d40a-4d88-bfb2-4409d1298149\") " pod="openshift-dns/dns-default-vsbcs"
Jul 07 17:54:04.825007 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.824861    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3adf617f-d40a-4d88-bfb2-4409d1298149-config-volume\") pod \"dns-default-vsbcs\" (UID: \"3adf617f-d40a-4d88-bfb2-4409d1298149\") " pod="openshift-dns/dns-default-vsbcs"
Jul 07 17:54:04.828814 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.828789    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c59bceb7-2ee5-4f47-b279-31b1ff19937a-cert\") pod \"ingress-canary-c6ss5\" (UID: \"c59bceb7-2ee5-4f47-b279-31b1ff19937a\") " pod="openshift-ingress-canary/ingress-canary-c6ss5"
Jul 07 17:54:04.835385 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.835350    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv6kj\" (UniqueName: \"kubernetes.io/projected/3adf617f-d40a-4d88-bfb2-4409d1298149-kube-api-access-cv6kj\") pod \"dns-default-vsbcs\" (UID: \"3adf617f-d40a-4d88-bfb2-4409d1298149\") " pod="openshift-dns/dns-default-vsbcs"
Jul 07 17:54:04.835515 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.835428    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjvm6\" (UniqueName: \"kubernetes.io/projected/c59bceb7-2ee5-4f47-b279-31b1ff19937a-kube-api-access-xjvm6\") pod \"ingress-canary-c6ss5\" (UID: \"c59bceb7-2ee5-4f47-b279-31b1ff19937a\") " pod="openshift-ingress-canary/ingress-canary-c6ss5"
Jul 07 17:54:04.915492 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:04.915458    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c6ss5"
Jul 07 17:54:05.075869 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:05.075770    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c6ss5"]
Jul 07 17:54:05.079469 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:54:05.079440    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc59bceb7_2ee5_4f47_b279_31b1ff19937a.slice/crio-a433fee8489058b25cd281d5dfb18575517e75e67c4735deb4b300da871c8cdc WatchSource:0}: Error finding container a433fee8489058b25cd281d5dfb18575517e75e67c4735deb4b300da871c8cdc: Status 404 returned error can't find the container with id a433fee8489058b25cd281d5dfb18575517e75e67c4735deb4b300da871c8cdc
Jul 07 17:54:05.328633 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:05.328529    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3adf617f-d40a-4d88-bfb2-4409d1298149-metrics-tls\") pod \"dns-default-vsbcs\" (UID: \"3adf617f-d40a-4d88-bfb2-4409d1298149\") " pod="openshift-dns/dns-default-vsbcs"
Jul 07 17:54:05.328783 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:05.328686    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:54:05.328783 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:05.328758    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3adf617f-d40a-4d88-bfb2-4409d1298149-metrics-tls podName:3adf617f-d40a-4d88-bfb2-4409d1298149 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:06.328742686 +0000 UTC m=+37.086303535 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3adf617f-d40a-4d88-bfb2-4409d1298149-metrics-tls") pod "dns-default-vsbcs" (UID: "3adf617f-d40a-4d88-bfb2-4409d1298149") : secret "dns-default-metrics-tls" not found
Jul 07 17:54:05.794944 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:05.794910    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:54:05.795100 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:05.794953    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:54:05.795100 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:05.794910    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:54:05.798299 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:05.798278    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 17:54:05.799478 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:05.799456    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 17:54:05.799478 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:05.799467    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2d4ht\""
Jul 07 17:54:05.799653 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:05.799486    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lgh52\""
Jul 07 17:54:05.799653 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:05.799499    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 17:54:05.799653 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:05.799499    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 17:54:06.029109 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:06.029065    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c6ss5" event={"ID":"c59bceb7-2ee5-4f47-b279-31b1ff19937a","Type":"ContainerStarted","Data":"a433fee8489058b25cd281d5dfb18575517e75e67c4735deb4b300da871c8cdc"}
Jul 07 17:54:06.337670 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:06.336982    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3adf617f-d40a-4d88-bfb2-4409d1298149-metrics-tls\") pod \"dns-default-vsbcs\" (UID: \"3adf617f-d40a-4d88-bfb2-4409d1298149\") " pod="openshift-dns/dns-default-vsbcs"
Jul 07 17:54:06.337670 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:06.337172    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:54:06.337670 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:06.337320    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3adf617f-d40a-4d88-bfb2-4409d1298149-metrics-tls podName:3adf617f-d40a-4d88-bfb2-4409d1298149 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:08.337296676 +0000 UTC m=+39.094857537 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3adf617f-d40a-4d88-bfb2-4409d1298149-metrics-tls") pod "dns-default-vsbcs" (UID: "3adf617f-d40a-4d88-bfb2-4409d1298149") : secret "dns-default-metrics-tls" not found
Jul 07 17:54:08.354496 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:08.354456    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3adf617f-d40a-4d88-bfb2-4409d1298149-metrics-tls\") pod \"dns-default-vsbcs\" (UID: \"3adf617f-d40a-4d88-bfb2-4409d1298149\") " pod="openshift-dns/dns-default-vsbcs"
Jul 07 17:54:08.355013 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:08.354605    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:54:08.355013 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:08.354678    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3adf617f-d40a-4d88-bfb2-4409d1298149-metrics-tls podName:3adf617f-d40a-4d88-bfb2-4409d1298149 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:12.354658854 +0000 UTC m=+43.112219707 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3adf617f-d40a-4d88-bfb2-4409d1298149-metrics-tls") pod "dns-default-vsbcs" (UID: "3adf617f-d40a-4d88-bfb2-4409d1298149") : secret "dns-default-metrics-tls" not found
Jul 07 17:54:09.039634 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:09.039592    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kr84f" event={"ID":"9ee8c5a4-4788-4665-9331-232aa363342d","Type":"ContainerStarted","Data":"df542a7e1a32ac6c5a128d9e91ba668cf0ac53c19d3baccb1a006c98ebe37cb3"}
Jul 07 17:54:09.041065 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:09.041039    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c6ss5" event={"ID":"c59bceb7-2ee5-4f47-b279-31b1ff19937a","Type":"ContainerStarted","Data":"77c28f71d1e9b8691716b89a972a2807e511a41fe4698b6292a0000aadb1f62b"}
Jul 07 17:54:09.087370 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:09.087317    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-c6ss5" podStartSLOduration=1.29422696 podStartE2EDuration="5.087298158s" totalImagesPullingTime="3.793071198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:54:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:54:09.086198319 +0000 UTC m=+39.843759189" watchObservedRunningTime="2026-07-07 17:54:09.087298158 +0000 UTC m=+39.844859028"
Jul 07 17:54:10.045719 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:10.045677    2566 generic.go:356] "Generic (PLEG): container finished" podID="9ee8c5a4-4788-4665-9331-232aa363342d" containerID="df542a7e1a32ac6c5a128d9e91ba668cf0ac53c19d3baccb1a006c98ebe37cb3" exitCode=0
Jul 07 17:54:10.046201 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:10.045765    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kr84f" event={"ID":"9ee8c5a4-4788-4665-9331-232aa363342d","Type":"ContainerDied","Data":"df542a7e1a32ac6c5a128d9e91ba668cf0ac53c19d3baccb1a006c98ebe37cb3"}
Jul 07 17:54:11.051411 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:11.051379    2566 generic.go:356] "Generic (PLEG): container finished" podID="9ee8c5a4-4788-4665-9331-232aa363342d" containerID="b7ff38e8c5e240b78bde8805409383c9079e46d574e5a99d71168d9cbcbe1966" exitCode=0
Jul 07 17:54:11.051780 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:11.051439    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kr84f" event={"ID":"9ee8c5a4-4788-4665-9331-232aa363342d","Type":"ContainerDied","Data":"b7ff38e8c5e240b78bde8805409383c9079e46d574e5a99d71168d9cbcbe1966"}
Jul 07 17:54:12.057041 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:12.057007    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kr84f" event={"ID":"9ee8c5a4-4788-4665-9331-232aa363342d","Type":"ContainerStarted","Data":"4cab1c94222bd332f2bd6d2e8f9043fb90e16cad668534eeb55ecb473dec46d4"}
Jul 07 17:54:12.082755 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:12.082664    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kr84f" podStartSLOduration=8.265605577 podStartE2EDuration="42.082642723s" totalImagesPullingTime="33.817037146s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:53:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:54:12.081085426 +0000 UTC m=+42.838646317" watchObservedRunningTime="2026-07-07 17:54:12.082642723 +0000 UTC m=+42.840203601"
Jul 07 17:54:12.383943 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:12.383853    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3adf617f-d40a-4d88-bfb2-4409d1298149-metrics-tls\") pod \"dns-default-vsbcs\" (UID: \"3adf617f-d40a-4d88-bfb2-4409d1298149\") " pod="openshift-dns/dns-default-vsbcs"
Jul 07 17:54:12.384079 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:12.383986    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:54:12.384079 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:12.384043    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3adf617f-d40a-4d88-bfb2-4409d1298149-metrics-tls podName:3adf617f-d40a-4d88-bfb2-4409d1298149 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:20.384026705 +0000 UTC m=+51.141587574 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3adf617f-d40a-4d88-bfb2-4409d1298149-metrics-tls") pod "dns-default-vsbcs" (UID: "3adf617f-d40a-4d88-bfb2-4409d1298149") : secret "dns-default-metrics-tls" not found
Jul 07 17:54:20.438478 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:20.438436    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3adf617f-d40a-4d88-bfb2-4409d1298149-metrics-tls\") pod \"dns-default-vsbcs\" (UID: \"3adf617f-d40a-4d88-bfb2-4409d1298149\") " pod="openshift-dns/dns-default-vsbcs"
Jul 07 17:54:20.438963 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:20.438544    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:54:20.438963 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:20.438607    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3adf617f-d40a-4d88-bfb2-4409d1298149-metrics-tls podName:3adf617f-d40a-4d88-bfb2-4409d1298149 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:36.438592768 +0000 UTC m=+67.196153617 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3adf617f-d40a-4d88-bfb2-4409d1298149-metrics-tls") pod "dns-default-vsbcs" (UID: "3adf617f-d40a-4d88-bfb2-4409d1298149") : secret "dns-default-metrics-tls" not found
Jul 07 17:54:31.025207 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:31.025178    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-76kvc"
Jul 07 17:54:34.531716 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:34.531665    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ca929e8-fe5f-4713-ae87-fcfdd2816546-original-pull-secret\") pod \"global-pull-secret-syncer-9qmtf\" (UID: \"5ca929e8-fe5f-4713-ae87-fcfdd2816546\") " pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:54:34.532138 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:34.531734    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bf127e3-735b-4304-9269-551261b5a0cc-metrics-certs\") pod \"network-metrics-daemon-7v8v2\" (UID: \"0bf127e3-735b-4304-9269-551261b5a0cc\") " pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:54:34.535156 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:34.535140    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 17:54:34.536328 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:34.536314    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 17:54:34.542065 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:34.542044    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 17:54:34.542135 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:34.542124    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bf127e3-735b-4304-9269-551261b5a0cc-metrics-certs podName:0bf127e3-735b-4304-9269-551261b5a0cc nodeName:}" failed. No retries permitted until 2026-07-07 17:55:38.542099744 +0000 UTC m=+129.299660596 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bf127e3-735b-4304-9269-551261b5a0cc-metrics-certs") pod "network-metrics-daemon-7v8v2" (UID: "0bf127e3-735b-4304-9269-551261b5a0cc") : secret "metrics-daemon-secret" not found
Jul 07 17:54:34.545399 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:34.545368    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ca929e8-fe5f-4713-ae87-fcfdd2816546-original-pull-secret\") pod \"global-pull-secret-syncer-9qmtf\" (UID: \"5ca929e8-fe5f-4713-ae87-fcfdd2816546\") " pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:54:34.613221 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:34.613185    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9qmtf"
Jul 07 17:54:34.632995 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:34.632952    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5zmk\" (UniqueName: \"kubernetes.io/projected/649e0a8c-d3b7-4169-9bc3-65736133a6b3-kube-api-access-m5zmk\") pod \"network-check-target-hhrd5\" (UID: \"649e0a8c-d3b7-4169-9bc3-65736133a6b3\") " pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:54:34.636233 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:34.636207    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 17:54:34.647494 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:34.647464    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 17:54:34.657321 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:34.657291    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5zmk\" (UniqueName: \"kubernetes.io/projected/649e0a8c-d3b7-4169-9bc3-65736133a6b3-kube-api-access-m5zmk\") pod \"network-check-target-hhrd5\" (UID: \"649e0a8c-d3b7-4169-9bc3-65736133a6b3\") " pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:54:34.750127 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:34.750094    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9qmtf"]
Jul 07 17:54:34.753559 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:54:34.753531    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ca929e8_fe5f_4713_ae87_fcfdd2816546.slice/crio-bf8fa8ba5da87ec41cbe743e4edb5ffe63acc01195fe80ada705b6314941712c WatchSource:0}: Error finding container bf8fa8ba5da87ec41cbe743e4edb5ffe63acc01195fe80ada705b6314941712c: Status 404 returned error can't find the container with id bf8fa8ba5da87ec41cbe743e4edb5ffe63acc01195fe80ada705b6314941712c
Jul 07 17:54:34.909238 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:34.909147    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2d4ht\""
Jul 07 17:54:34.916736 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:34.916717    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:54:35.041999 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:35.041969    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hhrd5"]
Jul 07 17:54:35.045033 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:54:35.045007    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod649e0a8c_d3b7_4169_9bc3_65736133a6b3.slice/crio-f64ab1911b055d178ba9764944f655952a8f9f7a54339e961df2bb1f6d955d56 WatchSource:0}: Error finding container f64ab1911b055d178ba9764944f655952a8f9f7a54339e961df2bb1f6d955d56: Status 404 returned error can't find the container with id f64ab1911b055d178ba9764944f655952a8f9f7a54339e961df2bb1f6d955d56
Jul 07 17:54:35.109982 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:35.109949    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9qmtf" event={"ID":"5ca929e8-fe5f-4713-ae87-fcfdd2816546","Type":"ContainerStarted","Data":"bf8fa8ba5da87ec41cbe743e4edb5ffe63acc01195fe80ada705b6314941712c"}
Jul 07 17:54:35.110964 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:35.110935    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hhrd5" event={"ID":"649e0a8c-d3b7-4169-9bc3-65736133a6b3","Type":"ContainerStarted","Data":"f64ab1911b055d178ba9764944f655952a8f9f7a54339e961df2bb1f6d955d56"}
Jul 07 17:54:36.448254 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:36.448222    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3adf617f-d40a-4d88-bfb2-4409d1298149-metrics-tls\") pod \"dns-default-vsbcs\" (UID: \"3adf617f-d40a-4d88-bfb2-4409d1298149\") " pod="openshift-dns/dns-default-vsbcs"
Jul 07 17:54:36.448673 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:36.448342    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:54:36.448673 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:36.448406    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3adf617f-d40a-4d88-bfb2-4409d1298149-metrics-tls podName:3adf617f-d40a-4d88-bfb2-4409d1298149 nodeName:}" failed. No retries permitted until 2026-07-07 17:55:08.448386821 +0000 UTC m=+99.205947688 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3adf617f-d40a-4d88-bfb2-4409d1298149-metrics-tls") pod "dns-default-vsbcs" (UID: "3adf617f-d40a-4d88-bfb2-4409d1298149") : secret "dns-default-metrics-tls" not found
Jul 07 17:54:39.650864 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.650808    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-t7nj9"]
Jul 07 17:54:39.674795 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.674748    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-lcfnl"]
Jul 07 17:54:39.674997 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.674903    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-t7nj9"
Jul 07 17:54:39.678588 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.678529    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 17:54:39.679462 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.679436    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 07 17:54:39.679605 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.679449    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 17:54:39.679868 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.679846    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 07 17:54:39.680671 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.680650    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-bh5cz\""
Jul 07 17:54:39.686011 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.685992    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 07 17:54:39.695253 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.695233    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-f68b6fb67-nhtkt"]
Jul 07 17:54:39.695356 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.695342    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-lcfnl"
Jul 07 17:54:39.698566 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.698548    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:54:39.698806 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.698776    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 07 17:54:39.699047 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.699034    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 07 17:54:39.699047 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.699042    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 07 17:54:39.699505 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.699492    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-q9x5d\""
Jul 07 17:54:39.705698 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.705680    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 07 17:54:39.725373 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.725348    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-t7nj9"]
Jul 07 17:54:39.725373 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.725382    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-lcfnl"]
Jul 07 17:54:39.725549 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.725397    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-f68b6fb67-nhtkt"]
Jul 07 17:54:39.725549 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.725491    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:54:39.728408 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.728380    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 07 17:54:39.728977 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.728940    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 07 17:54:39.729096 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.729074    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-klgn9\""
Jul 07 17:54:39.729369 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.729351    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 07 17:54:39.729715 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.729683    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 07 17:54:39.730049 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.730033    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 17:54:39.730137 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.730095    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 17:54:39.774832 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.774798    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca3d9186-62d8-45f5-a84c-18fc318bfa08-tmp\") pod \"insights-operator-5c847dcfc4-t7nj9\" (UID: \"ca3d9186-62d8-45f5-a84c-18fc318bfa08\") " pod="openshift-insights/insights-operator-5c847dcfc4-t7nj9"
Jul 07 17:54:39.775006 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.774847    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dgtd\" (UniqueName: \"kubernetes.io/projected/ca3d9186-62d8-45f5-a84c-18fc318bfa08-kube-api-access-9dgtd\") pod \"insights-operator-5c847dcfc4-t7nj9\" (UID: \"ca3d9186-62d8-45f5-a84c-18fc318bfa08\") " pod="openshift-insights/insights-operator-5c847dcfc4-t7nj9"
Jul 07 17:54:39.775006 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.774881    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca3d9186-62d8-45f5-a84c-18fc318bfa08-serving-cert\") pod \"insights-operator-5c847dcfc4-t7nj9\" (UID: \"ca3d9186-62d8-45f5-a84c-18fc318bfa08\") " pod="openshift-insights/insights-operator-5c847dcfc4-t7nj9"
Jul 07 17:54:39.775006 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.774941    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ca3d9186-62d8-45f5-a84c-18fc318bfa08-snapshots\") pod \"insights-operator-5c847dcfc4-t7nj9\" (UID: \"ca3d9186-62d8-45f5-a84c-18fc318bfa08\") " pod="openshift-insights/insights-operator-5c847dcfc4-t7nj9"
Jul 07 17:54:39.775006 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.774965    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3d9186-62d8-45f5-a84c-18fc318bfa08-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-t7nj9\" (UID: \"ca3d9186-62d8-45f5-a84c-18fc318bfa08\") " pod="openshift-insights/insights-operator-5c847dcfc4-t7nj9"
Jul 07 17:54:39.775166 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.775008    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3d9186-62d8-45f5-a84c-18fc318bfa08-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-t7nj9\" (UID: \"ca3d9186-62d8-45f5-a84c-18fc318bfa08\") " pod="openshift-insights/insights-operator-5c847dcfc4-t7nj9"
Jul 07 17:54:39.876198 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.876159    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31f23e0b-1ec1-47af-a692-c6b0da751108-service-ca-bundle\") pod \"router-default-f68b6fb67-nhtkt\" (UID: \"31f23e0b-1ec1-47af-a692-c6b0da751108\") " pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:54:39.876380 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.876209    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca3d9186-62d8-45f5-a84c-18fc318bfa08-tmp\") pod \"insights-operator-5c847dcfc4-t7nj9\" (UID: \"ca3d9186-62d8-45f5-a84c-18fc318bfa08\") " pod="openshift-insights/insights-operator-5c847dcfc4-t7nj9"
Jul 07 17:54:39.876380 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.876232    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dgtd\" (UniqueName: \"kubernetes.io/projected/ca3d9186-62d8-45f5-a84c-18fc318bfa08-kube-api-access-9dgtd\") pod \"insights-operator-5c847dcfc4-t7nj9\" (UID: \"ca3d9186-62d8-45f5-a84c-18fc318bfa08\") " pod="openshift-insights/insights-operator-5c847dcfc4-t7nj9"
Jul 07 17:54:39.876380 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.876285    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66xzx\" (UniqueName: \"kubernetes.io/projected/31f23e0b-1ec1-47af-a692-c6b0da751108-kube-api-access-66xzx\") pod \"router-default-f68b6fb67-nhtkt\" (UID: \"31f23e0b-1ec1-47af-a692-c6b0da751108\") " pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:54:39.876380 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.876324    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9bc45238-7341-43fe-a75f-231dbf7a3704-serving-cert\") pod \"console-operator-68b757fb67-lcfnl\" (UID: \"9bc45238-7341-43fe-a75f-231dbf7a3704\") " pod="openshift-console-operator/console-operator-68b757fb67-lcfnl"
Jul 07 17:54:39.876380 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.876354    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca3d9186-62d8-45f5-a84c-18fc318bfa08-serving-cert\") pod \"insights-operator-5c847dcfc4-t7nj9\" (UID: \"ca3d9186-62d8-45f5-a84c-18fc318bfa08\") " pod="openshift-insights/insights-operator-5c847dcfc4-t7nj9"
Jul 07 17:54:39.876618 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.876404    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9bc45238-7341-43fe-a75f-231dbf7a3704-config\") pod \"console-operator-68b757fb67-lcfnl\" (UID: \"9bc45238-7341-43fe-a75f-231dbf7a3704\") " pod="openshift-console-operator/console-operator-68b757fb67-lcfnl"
Jul 07 17:54:39.876618 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.876430    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9bc45238-7341-43fe-a75f-231dbf7a3704-trusted-ca\") pod \"console-operator-68b757fb67-lcfnl\" (UID: \"9bc45238-7341-43fe-a75f-231dbf7a3704\") " pod="openshift-console-operator/console-operator-68b757fb67-lcfnl"
Jul 07 17:54:39.876618 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.876493    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/31f23e0b-1ec1-47af-a692-c6b0da751108-stats-auth\") pod \"router-default-f68b6fb67-nhtkt\" (UID: \"31f23e0b-1ec1-47af-a692-c6b0da751108\") " pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:54:39.876618 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.876536    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31f23e0b-1ec1-47af-a692-c6b0da751108-metrics-certs\") pod \"router-default-f68b6fb67-nhtkt\" (UID: \"31f23e0b-1ec1-47af-a692-c6b0da751108\") " pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:54:39.876618 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.876568    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vc48\" (UniqueName: \"kubernetes.io/projected/9bc45238-7341-43fe-a75f-231dbf7a3704-kube-api-access-6vc48\") pod \"console-operator-68b757fb67-lcfnl\" (UID: \"9bc45238-7341-43fe-a75f-231dbf7a3704\") " pod="openshift-console-operator/console-operator-68b757fb67-lcfnl"
Jul 07 17:54:39.876618 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.876604    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ca3d9186-62d8-45f5-a84c-18fc318bfa08-snapshots\") pod \"insights-operator-5c847dcfc4-t7nj9\" (UID: \"ca3d9186-62d8-45f5-a84c-18fc318bfa08\") " pod="openshift-insights/insights-operator-5c847dcfc4-t7nj9"
Jul 07 17:54:39.876853 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.876634    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca3d9186-62d8-45f5-a84c-18fc318bfa08-tmp\") pod \"insights-operator-5c847dcfc4-t7nj9\" (UID: \"ca3d9186-62d8-45f5-a84c-18fc318bfa08\") " pod="openshift-insights/insights-operator-5c847dcfc4-t7nj9"
Jul 07 17:54:39.876853 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.876635    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3d9186-62d8-45f5-a84c-18fc318bfa08-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-t7nj9\" (UID: \"ca3d9186-62d8-45f5-a84c-18fc318bfa08\") " pod="openshift-insights/insights-operator-5c847dcfc4-t7nj9"
Jul 07 17:54:39.876853 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.876683    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3d9186-62d8-45f5-a84c-18fc318bfa08-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-t7nj9\" (UID: \"ca3d9186-62d8-45f5-a84c-18fc318bfa08\") " pod="openshift-insights/insights-operator-5c847dcfc4-t7nj9"
Jul 07 17:54:39.876853 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.876722    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/31f23e0b-1ec1-47af-a692-c6b0da751108-default-certificate\") pod \"router-default-f68b6fb67-nhtkt\" (UID: \"31f23e0b-1ec1-47af-a692-c6b0da751108\") " pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:54:39.877116 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.877100    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ca3d9186-62d8-45f5-a84c-18fc318bfa08-snapshots\") pod \"insights-operator-5c847dcfc4-t7nj9\" (UID: \"ca3d9186-62d8-45f5-a84c-18fc318bfa08\") " pod="openshift-insights/insights-operator-5c847dcfc4-t7nj9"
Jul 07 17:54:39.877420 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.877403    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3d9186-62d8-45f5-a84c-18fc318bfa08-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-t7nj9\" (UID: \"ca3d9186-62d8-45f5-a84c-18fc318bfa08\") " pod="openshift-insights/insights-operator-5c847dcfc4-t7nj9"
Jul 07 17:54:39.877492 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.877471    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3d9186-62d8-45f5-a84c-18fc318bfa08-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-t7nj9\" (UID: \"ca3d9186-62d8-45f5-a84c-18fc318bfa08\") " pod="openshift-insights/insights-operator-5c847dcfc4-t7nj9"
Jul 07 17:54:39.878970 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.878939    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca3d9186-62d8-45f5-a84c-18fc318bfa08-serving-cert\") pod \"insights-operator-5c847dcfc4-t7nj9\" (UID: \"ca3d9186-62d8-45f5-a84c-18fc318bfa08\") " pod="openshift-insights/insights-operator-5c847dcfc4-t7nj9"
Jul 07 17:54:39.891717 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.891689    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dgtd\" (UniqueName: \"kubernetes.io/projected/ca3d9186-62d8-45f5-a84c-18fc318bfa08-kube-api-access-9dgtd\") pod \"insights-operator-5c847dcfc4-t7nj9\" (UID: \"ca3d9186-62d8-45f5-a84c-18fc318bfa08\") " pod="openshift-insights/insights-operator-5c847dcfc4-t7nj9"
Jul 07 17:54:39.977068 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.977030    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/31f23e0b-1ec1-47af-a692-c6b0da751108-stats-auth\") pod \"router-default-f68b6fb67-nhtkt\" (UID: \"31f23e0b-1ec1-47af-a692-c6b0da751108\") " pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:54:39.977068 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.977071    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31f23e0b-1ec1-47af-a692-c6b0da751108-metrics-certs\") pod \"router-default-f68b6fb67-nhtkt\" (UID: \"31f23e0b-1ec1-47af-a692-c6b0da751108\") " pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:54:39.977262 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.977091    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vc48\" (UniqueName: \"kubernetes.io/projected/9bc45238-7341-43fe-a75f-231dbf7a3704-kube-api-access-6vc48\") pod \"console-operator-68b757fb67-lcfnl\" (UID: \"9bc45238-7341-43fe-a75f-231dbf7a3704\") " pod="openshift-console-operator/console-operator-68b757fb67-lcfnl"
Jul 07 17:54:39.977262 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.977114    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/31f23e0b-1ec1-47af-a692-c6b0da751108-default-certificate\") pod \"router-default-f68b6fb67-nhtkt\" (UID: \"31f23e0b-1ec1-47af-a692-c6b0da751108\") " pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:54:39.977262 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.977189    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31f23e0b-1ec1-47af-a692-c6b0da751108-service-ca-bundle\") pod \"router-default-f68b6fb67-nhtkt\" (UID: \"31f23e0b-1ec1-47af-a692-c6b0da751108\") " pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:54:39.977262 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.977251    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66xzx\" (UniqueName: \"kubernetes.io/projected/31f23e0b-1ec1-47af-a692-c6b0da751108-kube-api-access-66xzx\") pod \"router-default-f68b6fb67-nhtkt\" (UID: \"31f23e0b-1ec1-47af-a692-c6b0da751108\") " pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:54:39.977431 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.977291    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9bc45238-7341-43fe-a75f-231dbf7a3704-serving-cert\") pod \"console-operator-68b757fb67-lcfnl\" (UID: \"9bc45238-7341-43fe-a75f-231dbf7a3704\") " pod="openshift-console-operator/console-operator-68b757fb67-lcfnl"
Jul 07 17:54:39.977431 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:39.977309    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31f23e0b-1ec1-47af-a692-c6b0da751108-service-ca-bundle podName:31f23e0b-1ec1-47af-a692-c6b0da751108 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:40.477288742 +0000 UTC m=+71.234849591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/31f23e0b-1ec1-47af-a692-c6b0da751108-service-ca-bundle") pod "router-default-f68b6fb67-nhtkt" (UID: "31f23e0b-1ec1-47af-a692-c6b0da751108") : configmap references non-existent config key: service-ca.crt
Jul 07 17:54:39.977431 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:39.977349    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 17:54:39.977431 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.977360    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9bc45238-7341-43fe-a75f-231dbf7a3704-config\") pod \"console-operator-68b757fb67-lcfnl\" (UID: \"9bc45238-7341-43fe-a75f-231dbf7a3704\") " pod="openshift-console-operator/console-operator-68b757fb67-lcfnl"
Jul 07 17:54:39.977431 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.977393    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9bc45238-7341-43fe-a75f-231dbf7a3704-trusted-ca\") pod \"console-operator-68b757fb67-lcfnl\" (UID: \"9bc45238-7341-43fe-a75f-231dbf7a3704\") " pod="openshift-console-operator/console-operator-68b757fb67-lcfnl"
Jul 07 17:54:39.977431 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:39.977418    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31f23e0b-1ec1-47af-a692-c6b0da751108-metrics-certs podName:31f23e0b-1ec1-47af-a692-c6b0da751108 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:40.477400407 +0000 UTC m=+71.234961256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31f23e0b-1ec1-47af-a692-c6b0da751108-metrics-certs") pod "router-default-f68b6fb67-nhtkt" (UID: "31f23e0b-1ec1-47af-a692-c6b0da751108") : secret "router-metrics-certs-default" not found
Jul 07 17:54:39.978064 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.978045    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9bc45238-7341-43fe-a75f-231dbf7a3704-config\") pod \"console-operator-68b757fb67-lcfnl\" (UID: \"9bc45238-7341-43fe-a75f-231dbf7a3704\") " pod="openshift-console-operator/console-operator-68b757fb67-lcfnl"
Jul 07 17:54:39.978578 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.978558    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9bc45238-7341-43fe-a75f-231dbf7a3704-trusted-ca\") pod \"console-operator-68b757fb67-lcfnl\" (UID: \"9bc45238-7341-43fe-a75f-231dbf7a3704\") " pod="openshift-console-operator/console-operator-68b757fb67-lcfnl"
Jul 07 17:54:39.980038 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.980016    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/31f23e0b-1ec1-47af-a692-c6b0da751108-stats-auth\") pod \"router-default-f68b6fb67-nhtkt\" (UID: \"31f23e0b-1ec1-47af-a692-c6b0da751108\") " pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:54:39.980101 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.980052    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9bc45238-7341-43fe-a75f-231dbf7a3704-serving-cert\") pod \"console-operator-68b757fb67-lcfnl\" (UID: \"9bc45238-7341-43fe-a75f-231dbf7a3704\") " pod="openshift-console-operator/console-operator-68b757fb67-lcfnl"
Jul 07 17:54:39.980175 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.980161    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/31f23e0b-1ec1-47af-a692-c6b0da751108-default-certificate\") pod \"router-default-f68b6fb67-nhtkt\" (UID: \"31f23e0b-1ec1-47af-a692-c6b0da751108\") " pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:54:39.985978 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.985965    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-t7nj9"
Jul 07 17:54:39.995781 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.995747    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vc48\" (UniqueName: \"kubernetes.io/projected/9bc45238-7341-43fe-a75f-231dbf7a3704-kube-api-access-6vc48\") pod \"console-operator-68b757fb67-lcfnl\" (UID: \"9bc45238-7341-43fe-a75f-231dbf7a3704\") " pod="openshift-console-operator/console-operator-68b757fb67-lcfnl"
Jul 07 17:54:39.995893 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:39.995817    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66xzx\" (UniqueName: \"kubernetes.io/projected/31f23e0b-1ec1-47af-a692-c6b0da751108-kube-api-access-66xzx\") pod \"router-default-f68b6fb67-nhtkt\" (UID: \"31f23e0b-1ec1-47af-a692-c6b0da751108\") " pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:54:40.004337 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:40.004304    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-lcfnl"
Jul 07 17:54:40.264993 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:40.264957    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-t7nj9"]
Jul 07 17:54:40.267911 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:54:40.267879    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca3d9186_62d8_45f5_a84c_18fc318bfa08.slice/crio-2547ddea83abc246443cff4547fbdb74f853cd81161853d986abdb8e999a352a WatchSource:0}: Error finding container 2547ddea83abc246443cff4547fbdb74f853cd81161853d986abdb8e999a352a: Status 404 returned error can't find the container with id 2547ddea83abc246443cff4547fbdb74f853cd81161853d986abdb8e999a352a
Jul 07 17:54:40.282077 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:40.282056    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-lcfnl"]
Jul 07 17:54:40.286079 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:54:40.286057    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc45238_7341_43fe_a75f_231dbf7a3704.slice/crio-571f5c27aa76f125139f62487a03b1e5a4eaea344f468a483bb3598dddb35776 WatchSource:0}: Error finding container 571f5c27aa76f125139f62487a03b1e5a4eaea344f468a483bb3598dddb35776: Status 404 returned error can't find the container with id 571f5c27aa76f125139f62487a03b1e5a4eaea344f468a483bb3598dddb35776
Jul 07 17:54:40.480554 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:40.480522    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31f23e0b-1ec1-47af-a692-c6b0da751108-metrics-certs\") pod \"router-default-f68b6fb67-nhtkt\" (UID: \"31f23e0b-1ec1-47af-a692-c6b0da751108\") " pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:54:40.480737 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:40.480575    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31f23e0b-1ec1-47af-a692-c6b0da751108-service-ca-bundle\") pod \"router-default-f68b6fb67-nhtkt\" (UID: \"31f23e0b-1ec1-47af-a692-c6b0da751108\") " pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:54:40.480737 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:40.480672    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 17:54:40.480737 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:40.480733    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31f23e0b-1ec1-47af-a692-c6b0da751108-service-ca-bundle podName:31f23e0b-1ec1-47af-a692-c6b0da751108 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:41.480718295 +0000 UTC m=+72.238279145 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/31f23e0b-1ec1-47af-a692-c6b0da751108-service-ca-bundle") pod "router-default-f68b6fb67-nhtkt" (UID: "31f23e0b-1ec1-47af-a692-c6b0da751108") : configmap references non-existent config key: service-ca.crt
Jul 07 17:54:40.480872 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:40.480751    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31f23e0b-1ec1-47af-a692-c6b0da751108-metrics-certs podName:31f23e0b-1ec1-47af-a692-c6b0da751108 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:41.48074447 +0000 UTC m=+72.238305318 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31f23e0b-1ec1-47af-a692-c6b0da751108-metrics-certs") pod "router-default-f68b6fb67-nhtkt" (UID: "31f23e0b-1ec1-47af-a692-c6b0da751108") : secret "router-metrics-certs-default" not found
Jul 07 17:54:41.129040 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:41.128997    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-t7nj9" event={"ID":"ca3d9186-62d8-45f5-a84c-18fc318bfa08","Type":"ContainerStarted","Data":"2547ddea83abc246443cff4547fbdb74f853cd81161853d986abdb8e999a352a"}
Jul 07 17:54:41.130893 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:41.130837    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hhrd5" event={"ID":"649e0a8c-d3b7-4169-9bc3-65736133a6b3","Type":"ContainerStarted","Data":"d0dc7bff62e052c2430b336d813361ea819fc5841601ce964ad5a8dfa3ecdca2"}
Jul 07 17:54:41.131122 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:41.131103    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:54:41.132817 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:41.132792    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9qmtf" event={"ID":"5ca929e8-fe5f-4713-ae87-fcfdd2816546","Type":"ContainerStarted","Data":"6c47f1e8a15ab86b04f15e99c189d1e71cb0492121c1a090b9cd61e1e03405de"}
Jul 07 17:54:41.134165 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:41.134143    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-lcfnl" event={"ID":"9bc45238-7341-43fe-a75f-231dbf7a3704","Type":"ContainerStarted","Data":"571f5c27aa76f125139f62487a03b1e5a4eaea344f468a483bb3598dddb35776"}
Jul 07 17:54:41.199318 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:41.199264    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hhrd5" podStartSLOduration=66.130136512 podStartE2EDuration="1m11.199246445s" totalImagesPullingTime="5.069109933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:54:41.160670289 +0000 UTC m=+71.918231162" watchObservedRunningTime="2026-07-07 17:54:41.199246445 +0000 UTC m=+71.956807315"
Jul 07 17:54:41.200052 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:41.200009    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9qmtf" podStartSLOduration=65.827921975 podStartE2EDuration="1m11.19999545s" totalImagesPullingTime="5.372073475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:54:41.199923867 +0000 UTC m=+71.957484741" watchObservedRunningTime="2026-07-07 17:54:41.19999545 +0000 UTC m=+71.957556321"
Jul 07 17:54:41.489070 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:41.489032    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31f23e0b-1ec1-47af-a692-c6b0da751108-service-ca-bundle\") pod \"router-default-f68b6fb67-nhtkt\" (UID: \"31f23e0b-1ec1-47af-a692-c6b0da751108\") " pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:54:41.489354 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:41.489126    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31f23e0b-1ec1-47af-a692-c6b0da751108-metrics-certs\") pod \"router-default-f68b6fb67-nhtkt\" (UID: \"31f23e0b-1ec1-47af-a692-c6b0da751108\") " pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:54:41.489354 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:41.489207    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31f23e0b-1ec1-47af-a692-c6b0da751108-service-ca-bundle podName:31f23e0b-1ec1-47af-a692-c6b0da751108 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:43.489191207 +0000 UTC m=+74.246752056 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/31f23e0b-1ec1-47af-a692-c6b0da751108-service-ca-bundle") pod "router-default-f68b6fb67-nhtkt" (UID: "31f23e0b-1ec1-47af-a692-c6b0da751108") : configmap references non-existent config key: service-ca.crt
Jul 07 17:54:41.489354 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:41.489257    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 17:54:41.489354 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:41.489317    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31f23e0b-1ec1-47af-a692-c6b0da751108-metrics-certs podName:31f23e0b-1ec1-47af-a692-c6b0da751108 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:43.489300802 +0000 UTC m=+74.246861652 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31f23e0b-1ec1-47af-a692-c6b0da751108-metrics-certs") pod "router-default-f68b6fb67-nhtkt" (UID: "31f23e0b-1ec1-47af-a692-c6b0da751108") : secret "router-metrics-certs-default" not found
Jul 07 17:54:43.141967 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:43.141933    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lcfnl_9bc45238-7341-43fe-a75f-231dbf7a3704/console-operator/0.log"
Jul 07 17:54:43.142422 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:43.141982    2566 generic.go:356] "Generic (PLEG): container finished" podID="9bc45238-7341-43fe-a75f-231dbf7a3704" containerID="297fb053c28084cb9d5af458212c36e059f798a1ce555cc29399a61b43ef2a72" exitCode=255
Jul 07 17:54:43.142422 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:43.142084    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-lcfnl" event={"ID":"9bc45238-7341-43fe-a75f-231dbf7a3704","Type":"ContainerDied","Data":"297fb053c28084cb9d5af458212c36e059f798a1ce555cc29399a61b43ef2a72"}
Jul 07 17:54:43.142422 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:43.142301    2566 scope.go:117] "RemoveContainer" containerID="297fb053c28084cb9d5af458212c36e059f798a1ce555cc29399a61b43ef2a72"
Jul 07 17:54:43.143693 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:43.143670    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-t7nj9" event={"ID":"ca3d9186-62d8-45f5-a84c-18fc318bfa08","Type":"ContainerStarted","Data":"dbe82ad93dc58beeb8abc47b88efabeb14b61cd0725ceeb4370720a63f719f6f"}
Jul 07 17:54:43.178478 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:43.178363    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-t7nj9" podStartSLOduration=1.530261986 podStartE2EDuration="4.17834392s" totalImagesPullingTime="2.648081934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:54:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:54:43.178134924 +0000 UTC m=+73.935695816" watchObservedRunningTime="2026-07-07 17:54:43.17834392 +0000 UTC m=+73.935904792"
Jul 07 17:54:43.506316 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:43.506273    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31f23e0b-1ec1-47af-a692-c6b0da751108-service-ca-bundle\") pod \"router-default-f68b6fb67-nhtkt\" (UID: \"31f23e0b-1ec1-47af-a692-c6b0da751108\") " pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:54:43.506553 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:43.506375    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31f23e0b-1ec1-47af-a692-c6b0da751108-metrics-certs\") pod \"router-default-f68b6fb67-nhtkt\" (UID: \"31f23e0b-1ec1-47af-a692-c6b0da751108\") " pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:54:43.506553 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:43.506442    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31f23e0b-1ec1-47af-a692-c6b0da751108-service-ca-bundle podName:31f23e0b-1ec1-47af-a692-c6b0da751108 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:47.506423892 +0000 UTC m=+78.263984740 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/31f23e0b-1ec1-47af-a692-c6b0da751108-service-ca-bundle") pod "router-default-f68b6fb67-nhtkt" (UID: "31f23e0b-1ec1-47af-a692-c6b0da751108") : configmap references non-existent config key: service-ca.crt
Jul 07 17:54:43.506553 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:43.506500    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 17:54:43.506688 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:43.506560    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31f23e0b-1ec1-47af-a692-c6b0da751108-metrics-certs podName:31f23e0b-1ec1-47af-a692-c6b0da751108 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:47.506544495 +0000 UTC m=+78.264105343 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31f23e0b-1ec1-47af-a692-c6b0da751108-metrics-certs") pod "router-default-f68b6fb67-nhtkt" (UID: "31f23e0b-1ec1-47af-a692-c6b0da751108") : secret "router-metrics-certs-default" not found
Jul 07 17:54:44.153199 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:44.153164    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lcfnl_9bc45238-7341-43fe-a75f-231dbf7a3704/console-operator/1.log"
Jul 07 17:54:44.153781 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:44.153762    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lcfnl_9bc45238-7341-43fe-a75f-231dbf7a3704/console-operator/0.log"
Jul 07 17:54:44.153873 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:44.153810    2566 generic.go:356] "Generic (PLEG): container finished" podID="9bc45238-7341-43fe-a75f-231dbf7a3704" containerID="422da5a9d5d3796cc97e2ba23e4e564500191dd9d71cfda81ce12e125936a318" exitCode=255
Jul 07 17:54:44.153932 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:44.153865    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-lcfnl" event={"ID":"9bc45238-7341-43fe-a75f-231dbf7a3704","Type":"ContainerDied","Data":"422da5a9d5d3796cc97e2ba23e4e564500191dd9d71cfda81ce12e125936a318"}
Jul 07 17:54:44.153932 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:44.153926    2566 scope.go:117] "RemoveContainer" containerID="297fb053c28084cb9d5af458212c36e059f798a1ce555cc29399a61b43ef2a72"
Jul 07 17:54:44.154755 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:44.154732    2566 scope.go:117] "RemoveContainer" containerID="422da5a9d5d3796cc97e2ba23e4e564500191dd9d71cfda81ce12e125936a318"
Jul 07 17:54:44.154967 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:44.154933    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-lcfnl_openshift-console-operator(9bc45238-7341-43fe-a75f-231dbf7a3704)\"" pod="openshift-console-operator/console-operator-68b757fb67-lcfnl" podUID="9bc45238-7341-43fe-a75f-231dbf7a3704"
Jul 07 17:54:44.224793 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:44.224760    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2tslh"]
Jul 07 17:54:44.228968 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:44.228942    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2tslh"
Jul 07 17:54:44.231734 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:44.231711    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 17:54:44.231897 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:44.231738    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wcn5j\""
Jul 07 17:54:44.231897 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:44.231742    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 17:54:44.245286 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:44.245246    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2tslh"]
Jul 07 17:54:44.313692 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:44.313657    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2tslh\" (UID: \"7c71e9bc-6539-4eb1-9961-dfb0928d5c56\") " pod="openshift-insights/insights-runtime-extractor-2tslh"
Jul 07 17:54:44.313877 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:44.313698    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2tslh\" (UID: \"7c71e9bc-6539-4eb1-9961-dfb0928d5c56\") " pod="openshift-insights/insights-runtime-extractor-2tslh"
Jul 07 17:54:44.313877 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:44.313843    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-crio-socket\") pod \"insights-runtime-extractor-2tslh\" (UID: \"7c71e9bc-6539-4eb1-9961-dfb0928d5c56\") " pod="openshift-insights/insights-runtime-extractor-2tslh"
Jul 07 17:54:44.313976 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:44.313898    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztkpn\" (UniqueName: \"kubernetes.io/projected/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-kube-api-access-ztkpn\") pod \"insights-runtime-extractor-2tslh\" (UID: \"7c71e9bc-6539-4eb1-9961-dfb0928d5c56\") " pod="openshift-insights/insights-runtime-extractor-2tslh"
Jul 07 17:54:44.313976 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:44.313935    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-data-volume\") pod \"insights-runtime-extractor-2tslh\" (UID: \"7c71e9bc-6539-4eb1-9961-dfb0928d5c56\") " pod="openshift-insights/insights-runtime-extractor-2tslh"
Jul 07 17:54:44.415130 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:44.415041    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-data-volume\") pod \"insights-runtime-extractor-2tslh\" (UID: \"7c71e9bc-6539-4eb1-9961-dfb0928d5c56\") " pod="openshift-insights/insights-runtime-extractor-2tslh"
Jul 07 17:54:44.415130 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:44.415085    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2tslh\" (UID: \"7c71e9bc-6539-4eb1-9961-dfb0928d5c56\") " pod="openshift-insights/insights-runtime-extractor-2tslh"
Jul 07 17:54:44.415130 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:44.415111    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2tslh\" (UID: \"7c71e9bc-6539-4eb1-9961-dfb0928d5c56\") " pod="openshift-insights/insights-runtime-extractor-2tslh"
Jul 07 17:54:44.415394 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:44.415184    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-crio-socket\") pod \"insights-runtime-extractor-2tslh\" (UID: \"7c71e9bc-6539-4eb1-9961-dfb0928d5c56\") " pod="openshift-insights/insights-runtime-extractor-2tslh"
Jul 07 17:54:44.415394 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:44.415194    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:54:44.415394 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:44.415221    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztkpn\" (UniqueName: \"kubernetes.io/projected/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-kube-api-access-ztkpn\") pod \"insights-runtime-extractor-2tslh\" (UID: \"7c71e9bc-6539-4eb1-9961-dfb0928d5c56\") " pod="openshift-insights/insights-runtime-extractor-2tslh"
Jul 07 17:54:44.415394 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:44.415273    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-kube-rbac-proxy-cm podName:7c71e9bc-6539-4eb1-9961-dfb0928d5c56 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:44.915251579 +0000 UTC m=+75.672812432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2tslh" (UID: "7c71e9bc-6539-4eb1-9961-dfb0928d5c56") : configmap "kube-rbac-proxy" not found
Jul 07 17:54:44.415394 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:44.415313    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:54:44.415394 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:44.415348    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-crio-socket\") pod \"insights-runtime-extractor-2tslh\" (UID: \"7c71e9bc-6539-4eb1-9961-dfb0928d5c56\") " pod="openshift-insights/insights-runtime-extractor-2tslh"
Jul 07 17:54:44.415394 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:44.415382    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-insights-runtime-extractor-tls podName:7c71e9bc-6539-4eb1-9961-dfb0928d5c56 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:44.915364309 +0000 UTC m=+75.672925181 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2tslh" (UID: "7c71e9bc-6539-4eb1-9961-dfb0928d5c56") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:54:44.415696 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:44.415450    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-data-volume\") pod \"insights-runtime-extractor-2tslh\" (UID: \"7c71e9bc-6539-4eb1-9961-dfb0928d5c56\") " pod="openshift-insights/insights-runtime-extractor-2tslh"
Jul 07 17:54:44.427838 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:44.427800    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztkpn\" (UniqueName: \"kubernetes.io/projected/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-kube-api-access-ztkpn\") pod \"insights-runtime-extractor-2tslh\" (UID: \"7c71e9bc-6539-4eb1-9961-dfb0928d5c56\") " pod="openshift-insights/insights-runtime-extractor-2tslh"
Jul 07 17:54:44.918461 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:44.918416    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2tslh\" (UID: \"7c71e9bc-6539-4eb1-9961-dfb0928d5c56\") " pod="openshift-insights/insights-runtime-extractor-2tslh"
Jul 07 17:54:44.918461 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:44.918457    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2tslh\" (UID: \"7c71e9bc-6539-4eb1-9961-dfb0928d5c56\") " pod="openshift-insights/insights-runtime-extractor-2tslh"
Jul 07 17:54:44.918673 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:44.918539    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:54:44.918673 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:44.918552    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:54:44.918673 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:44.918602    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-kube-rbac-proxy-cm podName:7c71e9bc-6539-4eb1-9961-dfb0928d5c56 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:45.918588307 +0000 UTC m=+76.676149155 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2tslh" (UID: "7c71e9bc-6539-4eb1-9961-dfb0928d5c56") : configmap "kube-rbac-proxy" not found
Jul 07 17:54:44.918673 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:44.918615    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-insights-runtime-extractor-tls podName:7c71e9bc-6539-4eb1-9961-dfb0928d5c56 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:45.918609614 +0000 UTC m=+76.676170462 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2tslh" (UID: "7c71e9bc-6539-4eb1-9961-dfb0928d5c56") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:54:45.158351 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:45.158322    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lcfnl_9bc45238-7341-43fe-a75f-231dbf7a3704/console-operator/1.log"
Jul 07 17:54:45.158732 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:45.158640    2566 scope.go:117] "RemoveContainer" containerID="422da5a9d5d3796cc97e2ba23e4e564500191dd9d71cfda81ce12e125936a318"
Jul 07 17:54:45.158797 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:45.158777    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-lcfnl_openshift-console-operator(9bc45238-7341-43fe-a75f-231dbf7a3704)\"" pod="openshift-console-operator/console-operator-68b757fb67-lcfnl" podUID="9bc45238-7341-43fe-a75f-231dbf7a3704"
Jul 07 17:54:45.925773 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:45.925735    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2tslh\" (UID: \"7c71e9bc-6539-4eb1-9961-dfb0928d5c56\") " pod="openshift-insights/insights-runtime-extractor-2tslh"
Jul 07 17:54:45.925773 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:45.925779    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2tslh\" (UID: \"7c71e9bc-6539-4eb1-9961-dfb0928d5c56\") " pod="openshift-insights/insights-runtime-extractor-2tslh"
Jul 07 17:54:45.926055 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:45.925875    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:54:45.926055 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:45.925918    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:54:45.926055 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:45.925950    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-kube-rbac-proxy-cm podName:7c71e9bc-6539-4eb1-9961-dfb0928d5c56 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:47.925935576 +0000 UTC m=+78.683496425 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2tslh" (UID: "7c71e9bc-6539-4eb1-9961-dfb0928d5c56") : configmap "kube-rbac-proxy" not found
Jul 07 17:54:45.926055 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:45.925972    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-insights-runtime-extractor-tls podName:7c71e9bc-6539-4eb1-9961-dfb0928d5c56 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:47.925957117 +0000 UTC m=+78.683517968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2tslh" (UID: "7c71e9bc-6539-4eb1-9961-dfb0928d5c56") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:54:46.204843 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:46.204758    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pxsv8_1ca7075b-0176-4929-809b-3efa67cb7d5d/dns-node-resolver/0.log"
Jul 07 17:54:47.391490 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:47.391453    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-gxq4j"]
Jul 07 17:54:47.394840 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:47.394810    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gxq4j"
Jul 07 17:54:47.398091 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:47.398066    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-lpbxq\""
Jul 07 17:54:47.398206 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:47.398114    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 07 17:54:47.399153 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:47.399137    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 07 17:54:47.405339 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:47.405315    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t7czl_ad3b117b-52a4-49fa-8b26-e225f8cb3837/node-ca/0.log"
Jul 07 17:54:47.413962 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:47.413941    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-gxq4j"]
Jul 07 17:54:47.436637 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:47.436602    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbblf\" (UniqueName: \"kubernetes.io/projected/9517663c-f4e7-47e5-bca2-589bc9baa9d5-kube-api-access-fbblf\") pod \"migrator-d57d58cc9-gxq4j\" (UID: \"9517663c-f4e7-47e5-bca2-589bc9baa9d5\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gxq4j"
Jul 07 17:54:47.537215 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:47.537170    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31f23e0b-1ec1-47af-a692-c6b0da751108-service-ca-bundle\") pod \"router-default-f68b6fb67-nhtkt\" (UID: \"31f23e0b-1ec1-47af-a692-c6b0da751108\") " pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:54:47.537424 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:47.537227    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbblf\" (UniqueName: \"kubernetes.io/projected/9517663c-f4e7-47e5-bca2-589bc9baa9d5-kube-api-access-fbblf\") pod \"migrator-d57d58cc9-gxq4j\" (UID: \"9517663c-f4e7-47e5-bca2-589bc9baa9d5\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gxq4j"
Jul 07 17:54:47.537424 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:47.537254    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31f23e0b-1ec1-47af-a692-c6b0da751108-metrics-certs\") pod \"router-default-f68b6fb67-nhtkt\" (UID: \"31f23e0b-1ec1-47af-a692-c6b0da751108\") " pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:54:47.537424 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:47.537349    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 17:54:47.537424 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:47.537357    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31f23e0b-1ec1-47af-a692-c6b0da751108-service-ca-bundle podName:31f23e0b-1ec1-47af-a692-c6b0da751108 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:55.537334061 +0000 UTC m=+86.294894917 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/31f23e0b-1ec1-47af-a692-c6b0da751108-service-ca-bundle") pod "router-default-f68b6fb67-nhtkt" (UID: "31f23e0b-1ec1-47af-a692-c6b0da751108") : configmap references non-existent config key: service-ca.crt
Jul 07 17:54:47.537424 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:47.537396    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31f23e0b-1ec1-47af-a692-c6b0da751108-metrics-certs podName:31f23e0b-1ec1-47af-a692-c6b0da751108 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:55.537384334 +0000 UTC m=+86.294945183 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31f23e0b-1ec1-47af-a692-c6b0da751108-metrics-certs") pod "router-default-f68b6fb67-nhtkt" (UID: "31f23e0b-1ec1-47af-a692-c6b0da751108") : secret "router-metrics-certs-default" not found
Jul 07 17:54:47.548855 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:47.548802    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbblf\" (UniqueName: \"kubernetes.io/projected/9517663c-f4e7-47e5-bca2-589bc9baa9d5-kube-api-access-fbblf\") pod \"migrator-d57d58cc9-gxq4j\" (UID: \"9517663c-f4e7-47e5-bca2-589bc9baa9d5\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gxq4j"
Jul 07 17:54:47.703806 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:47.703718    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gxq4j"
Jul 07 17:54:47.800139 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:47.800108    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c6ss5_c59bceb7-2ee5-4f47-b279-31b1ff19937a/serve-healthcheck-canary/0.log"
Jul 07 17:54:47.836274 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:47.836236    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-gxq4j"]
Jul 07 17:54:47.840552 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:54:47.840528    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9517663c_f4e7_47e5_bca2_589bc9baa9d5.slice/crio-ad3e63fb7e5d86e28d4008e347673d3cc5be2e5052348030cc040f51b0b070e3 WatchSource:0}: Error finding container ad3e63fb7e5d86e28d4008e347673d3cc5be2e5052348030cc040f51b0b070e3: Status 404 returned error can't find the container with id ad3e63fb7e5d86e28d4008e347673d3cc5be2e5052348030cc040f51b0b070e3
Jul 07 17:54:47.938951 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:47.938918    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2tslh\" (UID: \"7c71e9bc-6539-4eb1-9961-dfb0928d5c56\") " pod="openshift-insights/insights-runtime-extractor-2tslh"
Jul 07 17:54:47.939134 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:47.938975    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2tslh\" (UID: \"7c71e9bc-6539-4eb1-9961-dfb0928d5c56\") " pod="openshift-insights/insights-runtime-extractor-2tslh"
Jul 07 17:54:47.939134 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:47.939058    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:54:47.939134 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:47.939093    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:54:47.939300 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:47.939139    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-kube-rbac-proxy-cm podName:7c71e9bc-6539-4eb1-9961-dfb0928d5c56 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:51.939119375 +0000 UTC m=+82.696680226 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2tslh" (UID: "7c71e9bc-6539-4eb1-9961-dfb0928d5c56") : configmap "kube-rbac-proxy" not found
Jul 07 17:54:47.939300 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:47.939158    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-insights-runtime-extractor-tls podName:7c71e9bc-6539-4eb1-9961-dfb0928d5c56 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:51.939149363 +0000 UTC m=+82.696710211 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2tslh" (UID: "7c71e9bc-6539-4eb1-9961-dfb0928d5c56") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:54:48.167614 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:48.167574    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gxq4j" event={"ID":"9517663c-f4e7-47e5-bca2-589bc9baa9d5","Type":"ContainerStarted","Data":"ad3e63fb7e5d86e28d4008e347673d3cc5be2e5052348030cc040f51b0b070e3"}
Jul 07 17:54:50.004748 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:50.004719    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-lcfnl"
Jul 07 17:54:50.005153 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:50.004780    2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-lcfnl"
Jul 07 17:54:50.005153 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:50.005148    2566 scope.go:117] "RemoveContainer" containerID="422da5a9d5d3796cc97e2ba23e4e564500191dd9d71cfda81ce12e125936a318"
Jul 07 17:54:50.005309 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:50.005288    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-lcfnl_openshift-console-operator(9bc45238-7341-43fe-a75f-231dbf7a3704)\"" pod="openshift-console-operator/console-operator-68b757fb67-lcfnl" podUID="9bc45238-7341-43fe-a75f-231dbf7a3704"
Jul 07 17:54:50.174472 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:50.174438    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gxq4j" event={"ID":"9517663c-f4e7-47e5-bca2-589bc9baa9d5","Type":"ContainerStarted","Data":"ca262e5dd8ea2c6ab241942868a8d3120d56612ef5ee1975245df634c7482867"}
Jul 07 17:54:50.174652 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:50.174496    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gxq4j" event={"ID":"9517663c-f4e7-47e5-bca2-589bc9baa9d5","Type":"ContainerStarted","Data":"6d2e40797d50a3c50b8f0acfe1ab0a8e4462eb7fdb18b8b42d1d445c53a17e7e"}
Jul 07 17:54:50.193420 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:50.193368    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gxq4j" podStartSLOduration=1.479052688 podStartE2EDuration="3.193353296s" totalImagesPullingTime="1.714300608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:54:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:54:50.192794293 +0000 UTC m=+80.950355174" watchObservedRunningTime="2026-07-07 17:54:50.193353296 +0000 UTC m=+80.950914167"
Jul 07 17:54:51.975622 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:51.975500    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2tslh\" (UID: \"7c71e9bc-6539-4eb1-9961-dfb0928d5c56\") " pod="openshift-insights/insights-runtime-extractor-2tslh"
Jul 07 17:54:51.975622 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:51.975565    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2tslh\" (UID: \"7c71e9bc-6539-4eb1-9961-dfb0928d5c56\") " pod="openshift-insights/insights-runtime-extractor-2tslh"
Jul 07 17:54:51.976019 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:51.975627    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:54:51.976019 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:51.975657    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:54:51.976019 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:51.975694    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-kube-rbac-proxy-cm podName:7c71e9bc-6539-4eb1-9961-dfb0928d5c56 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:59.975678354 +0000 UTC m=+90.733239203 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2tslh" (UID: "7c71e9bc-6539-4eb1-9961-dfb0928d5c56") : configmap "kube-rbac-proxy" not found
Jul 07 17:54:51.976019 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:51.975712    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-insights-runtime-extractor-tls podName:7c71e9bc-6539-4eb1-9961-dfb0928d5c56 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:59.975699216 +0000 UTC m=+90.733260065 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2tslh" (UID: "7c71e9bc-6539-4eb1-9961-dfb0928d5c56") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:54:55.603697 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:55.603658    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31f23e0b-1ec1-47af-a692-c6b0da751108-service-ca-bundle\") pod \"router-default-f68b6fb67-nhtkt\" (UID: \"31f23e0b-1ec1-47af-a692-c6b0da751108\") " pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:54:55.604099 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:54:55.603736    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31f23e0b-1ec1-47af-a692-c6b0da751108-metrics-certs\") pod \"router-default-f68b6fb67-nhtkt\" (UID: \"31f23e0b-1ec1-47af-a692-c6b0da751108\") " pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:54:55.604099 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:55.603861    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31f23e0b-1ec1-47af-a692-c6b0da751108-service-ca-bundle podName:31f23e0b-1ec1-47af-a692-c6b0da751108 nodeName:}" failed. No retries permitted until 2026-07-07 17:55:11.603819713 +0000 UTC m=+102.361380564 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/31f23e0b-1ec1-47af-a692-c6b0da751108-service-ca-bundle") pod "router-default-f68b6fb67-nhtkt" (UID: "31f23e0b-1ec1-47af-a692-c6b0da751108") : configmap references non-existent config key: service-ca.crt
Jul 07 17:54:55.604099 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:55.603895    2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 17:54:55.604099 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:54:55.603959    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31f23e0b-1ec1-47af-a692-c6b0da751108-metrics-certs podName:31f23e0b-1ec1-47af-a692-c6b0da751108 nodeName:}" failed. No retries permitted until 2026-07-07 17:55:11.603946018 +0000 UTC m=+102.361506867 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31f23e0b-1ec1-47af-a692-c6b0da751108-metrics-certs") pod "router-default-f68b6fb67-nhtkt" (UID: "31f23e0b-1ec1-47af-a692-c6b0da751108") : secret "router-metrics-certs-default" not found
Jul 07 17:55:00.039473 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:00.039418    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2tslh\" (UID: \"7c71e9bc-6539-4eb1-9961-dfb0928d5c56\") " pod="openshift-insights/insights-runtime-extractor-2tslh"
Jul 07 17:55:00.039892 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:00.039522    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2tslh\" (UID: \"7c71e9bc-6539-4eb1-9961-dfb0928d5c56\") " pod="openshift-insights/insights-runtime-extractor-2tslh"
Jul 07 17:55:00.039892 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:55:00.039641    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:55:00.039892 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:55:00.039719    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-insights-runtime-extractor-tls podName:7c71e9bc-6539-4eb1-9961-dfb0928d5c56 nodeName:}" failed. No retries permitted until 2026-07-07 17:55:16.039698673 +0000 UTC m=+106.797259524 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2tslh" (UID: "7c71e9bc-6539-4eb1-9961-dfb0928d5c56") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:55:00.040116 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:00.040092    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2tslh\" (UID: \"7c71e9bc-6539-4eb1-9961-dfb0928d5c56\") " pod="openshift-insights/insights-runtime-extractor-2tslh"
Jul 07 17:55:00.795561 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:00.795529    2566 scope.go:117] "RemoveContainer" containerID="422da5a9d5d3796cc97e2ba23e4e564500191dd9d71cfda81ce12e125936a318"
Jul 07 17:55:01.213103 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:01.213073    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lcfnl_9bc45238-7341-43fe-a75f-231dbf7a3704/console-operator/1.log"
Jul 07 17:55:01.213584 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:01.213148    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-lcfnl" event={"ID":"9bc45238-7341-43fe-a75f-231dbf7a3704","Type":"ContainerStarted","Data":"1d53601231255fa14efccdd1bd4f574046eb121e90fe7e3f382ae79ac3ba8ae8"}
Jul 07 17:55:01.213584 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:01.213425    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-lcfnl"
Jul 07 17:55:01.236687 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:01.236634    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-lcfnl" podStartSLOduration=19.609388001 podStartE2EDuration="22.236619327s" totalImagesPullingTime="2.627231326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:54:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:55:01.236551451 +0000 UTC m=+91.994112339" watchObservedRunningTime="2026-07-07 17:55:01.236619327 +0000 UTC m=+91.994180198"
Jul 07 17:55:01.300500 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:01.300423    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-lcfnl"
Jul 07 17:55:08.513930 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:08.513896    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3adf617f-d40a-4d88-bfb2-4409d1298149-metrics-tls\") pod \"dns-default-vsbcs\" (UID: \"3adf617f-d40a-4d88-bfb2-4409d1298149\") " pod="openshift-dns/dns-default-vsbcs"
Jul 07 17:55:08.516385 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:08.516360    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3adf617f-d40a-4d88-bfb2-4409d1298149-metrics-tls\") pod \"dns-default-vsbcs\" (UID: \"3adf617f-d40a-4d88-bfb2-4409d1298149\") " pod="openshift-dns/dns-default-vsbcs"
Jul 07 17:55:08.808708 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:08.808626    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q4bnp\""
Jul 07 17:55:08.816434 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:08.816411    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vsbcs"
Jul 07 17:55:08.948918 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:08.948888    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vsbcs"]
Jul 07 17:55:08.951633 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:55:08.951613    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3adf617f_d40a_4d88_bfb2_4409d1298149.slice/crio-ab525352bccc5eab314dd1933abaf81822f74be4943e8ee7b85ef7fd63fb2356 WatchSource:0}: Error finding container ab525352bccc5eab314dd1933abaf81822f74be4943e8ee7b85ef7fd63fb2356: Status 404 returned error can't find the container with id ab525352bccc5eab314dd1933abaf81822f74be4943e8ee7b85ef7fd63fb2356
Jul 07 17:55:09.238180 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:09.238149    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vsbcs" event={"ID":"3adf617f-d40a-4d88-bfb2-4409d1298149","Type":"ContainerStarted","Data":"ab525352bccc5eab314dd1933abaf81822f74be4943e8ee7b85ef7fd63fb2356"}
Jul 07 17:55:11.246056 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:11.246023    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vsbcs" event={"ID":"3adf617f-d40a-4d88-bfb2-4409d1298149","Type":"ContainerStarted","Data":"9a18ab2eec601f435658149b4150a7753bad10cdabb3bc02c60a694b74fd8faf"}
Jul 07 17:55:11.246450 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:11.246074    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vsbcs" event={"ID":"3adf617f-d40a-4d88-bfb2-4409d1298149","Type":"ContainerStarted","Data":"838df6c1ab1ac3fc02a868f1699c5f136f796141a3bcf03484700b2c670f1833"}
Jul 07 17:55:11.246450 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:11.246175    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vsbcs"
Jul 07 17:55:11.283101 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:11.283054    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vsbcs" podStartSLOduration=65.645301771 podStartE2EDuration="1m7.283037737s" totalImagesPullingTime="1.637735966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:54:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:55:11.282047048 +0000 UTC m=+102.039607940" watchObservedRunningTime="2026-07-07 17:55:11.283037737 +0000 UTC m=+102.040598607"
Jul 07 17:55:11.640916 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:11.640814    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31f23e0b-1ec1-47af-a692-c6b0da751108-metrics-certs\") pod \"router-default-f68b6fb67-nhtkt\" (UID: \"31f23e0b-1ec1-47af-a692-c6b0da751108\") " pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:55:11.641059 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:11.640924    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31f23e0b-1ec1-47af-a692-c6b0da751108-service-ca-bundle\") pod \"router-default-f68b6fb67-nhtkt\" (UID: \"31f23e0b-1ec1-47af-a692-c6b0da751108\") " pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:55:11.641516 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:11.641486    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31f23e0b-1ec1-47af-a692-c6b0da751108-service-ca-bundle\") pod \"router-default-f68b6fb67-nhtkt\" (UID: \"31f23e0b-1ec1-47af-a692-c6b0da751108\") " pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:55:11.643293 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:11.643274    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31f23e0b-1ec1-47af-a692-c6b0da751108-metrics-certs\") pod \"router-default-f68b6fb67-nhtkt\" (UID: \"31f23e0b-1ec1-47af-a692-c6b0da751108\") " pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:55:11.837255 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:11.837225    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:55:12.004656 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:12.004616    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-f68b6fb67-nhtkt"]
Jul 07 17:55:12.007457 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:55:12.007424    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31f23e0b_1ec1_47af_a692_c6b0da751108.slice/crio-52a40ce29c513c655ff4ded381c11e5830951c7f22980171079571e13072cdc0 WatchSource:0}: Error finding container 52a40ce29c513c655ff4ded381c11e5830951c7f22980171079571e13072cdc0: Status 404 returned error can't find the container with id 52a40ce29c513c655ff4ded381c11e5830951c7f22980171079571e13072cdc0
Jul 07 17:55:12.139907 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:12.139877    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hhrd5"
Jul 07 17:55:12.250094 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:12.250064    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-f68b6fb67-nhtkt" event={"ID":"31f23e0b-1ec1-47af-a692-c6b0da751108","Type":"ContainerStarted","Data":"4f92e05dbf9012acaf74ba2af6a68686852903248f8c2d2957034f60d6cc01cf"}
Jul 07 17:55:12.250470 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:12.250116    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-f68b6fb67-nhtkt" event={"ID":"31f23e0b-1ec1-47af-a692-c6b0da751108","Type":"ContainerStarted","Data":"52a40ce29c513c655ff4ded381c11e5830951c7f22980171079571e13072cdc0"}
Jul 07 17:55:12.283390 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:12.283337    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-f68b6fb67-nhtkt" podStartSLOduration=33.28331935 podStartE2EDuration="33.28331935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:54:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:55:12.282478978 +0000 UTC m=+103.040039851" watchObservedRunningTime="2026-07-07 17:55:12.28331935 +0000 UTC m=+103.040880221"
Jul 07 17:55:12.837793 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:12.837759    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:55:12.840114 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:12.840089    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:55:13.253325 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:13.253297    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:55:13.254532 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:13.254508    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-f68b6fb67-nhtkt"
Jul 07 17:55:15.415762 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.415729    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f9b74695-5bc2p"]
Jul 07 17:55:15.447692 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.447661    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f9b74695-5bc2p"]
Jul 07 17:55:15.447859 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.447767    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f9b74695-5bc2p"
Jul 07 17:55:15.450658 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.450632    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 07 17:55:15.450792 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.450697    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 07 17:55:15.451650 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.451630    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 07 17:55:15.451727 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.451659    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 07 17:55:15.451727 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.451690    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 07 17:55:15.451849 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.451814    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 07 17:55:15.456013 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.455996    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 07 17:55:15.574363 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.574331    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/01c91916-6fb2-400b-9d81-a9030893f8dc-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65f9b74695-5bc2p\" (UID: \"01c91916-6fb2-400b-9d81-a9030893f8dc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f9b74695-5bc2p"
Jul 07 17:55:15.574534 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.574371    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/01c91916-6fb2-400b-9d81-a9030893f8dc-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65f9b74695-5bc2p\" (UID: \"01c91916-6fb2-400b-9d81-a9030893f8dc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f9b74695-5bc2p"
Jul 07 17:55:15.574534 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.574392    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c6xj\" (UniqueName: \"kubernetes.io/projected/01c91916-6fb2-400b-9d81-a9030893f8dc-kube-api-access-5c6xj\") pod \"cluster-proxy-proxy-agent-65f9b74695-5bc2p\" (UID: \"01c91916-6fb2-400b-9d81-a9030893f8dc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f9b74695-5bc2p"
Jul 07 17:55:15.574534 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.574484    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/01c91916-6fb2-400b-9d81-a9030893f8dc-ca\") pod \"cluster-proxy-proxy-agent-65f9b74695-5bc2p\" (UID: \"01c91916-6fb2-400b-9d81-a9030893f8dc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f9b74695-5bc2p"
Jul 07 17:55:15.574534 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.574527    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/01c91916-6fb2-400b-9d81-a9030893f8dc-hub\") pod \"cluster-proxy-proxy-agent-65f9b74695-5bc2p\" (UID: \"01c91916-6fb2-400b-9d81-a9030893f8dc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f9b74695-5bc2p"
Jul 07 17:55:15.574665 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.574608    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/01c91916-6fb2-400b-9d81-a9030893f8dc-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65f9b74695-5bc2p\" (UID: \"01c91916-6fb2-400b-9d81-a9030893f8dc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f9b74695-5bc2p"
Jul 07 17:55:15.675101 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.675018    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/01c91916-6fb2-400b-9d81-a9030893f8dc-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65f9b74695-5bc2p\" (UID: \"01c91916-6fb2-400b-9d81-a9030893f8dc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f9b74695-5bc2p"
Jul 07 17:55:15.675101 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.675056    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/01c91916-6fb2-400b-9d81-a9030893f8dc-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65f9b74695-5bc2p\" (UID: \"01c91916-6fb2-400b-9d81-a9030893f8dc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f9b74695-5bc2p"
Jul 07 17:55:15.675101 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.675074    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c6xj\" (UniqueName: \"kubernetes.io/projected/01c91916-6fb2-400b-9d81-a9030893f8dc-kube-api-access-5c6xj\") pod \"cluster-proxy-proxy-agent-65f9b74695-5bc2p\" (UID: \"01c91916-6fb2-400b-9d81-a9030893f8dc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f9b74695-5bc2p"
Jul 07 17:55:15.675307 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.675111    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/01c91916-6fb2-400b-9d81-a9030893f8dc-ca\") pod \"cluster-proxy-proxy-agent-65f9b74695-5bc2p\" (UID: \"01c91916-6fb2-400b-9d81-a9030893f8dc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f9b74695-5bc2p"
Jul 07 17:55:15.675307 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.675255    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/01c91916-6fb2-400b-9d81-a9030893f8dc-hub\") pod \"cluster-proxy-proxy-agent-65f9b74695-5bc2p\" (UID: \"01c91916-6fb2-400b-9d81-a9030893f8dc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f9b74695-5bc2p"
Jul 07 17:55:15.675404 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.675329    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/01c91916-6fb2-400b-9d81-a9030893f8dc-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65f9b74695-5bc2p\" (UID: \"01c91916-6fb2-400b-9d81-a9030893f8dc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f9b74695-5bc2p"
Jul 07 17:55:15.675875 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.675820    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/01c91916-6fb2-400b-9d81-a9030893f8dc-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65f9b74695-5bc2p\" (UID: \"01c91916-6fb2-400b-9d81-a9030893f8dc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f9b74695-5bc2p"
Jul 07 17:55:15.678000 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.677973    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/01c91916-6fb2-400b-9d81-a9030893f8dc-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65f9b74695-5bc2p\" (UID: \"01c91916-6fb2-400b-9d81-a9030893f8dc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f9b74695-5bc2p"
Jul 07 17:55:15.678123 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.678018    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/01c91916-6fb2-400b-9d81-a9030893f8dc-hub\") pod \"cluster-proxy-proxy-agent-65f9b74695-5bc2p\" (UID: \"01c91916-6fb2-400b-9d81-a9030893f8dc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f9b74695-5bc2p"
Jul 07 17:55:15.678343 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.678325    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/01c91916-6fb2-400b-9d81-a9030893f8dc-ca\") pod \"cluster-proxy-proxy-agent-65f9b74695-5bc2p\" (UID: \"01c91916-6fb2-400b-9d81-a9030893f8dc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f9b74695-5bc2p"
Jul 07 17:55:15.678502 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.678481    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/01c91916-6fb2-400b-9d81-a9030893f8dc-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65f9b74695-5bc2p\" (UID: \"01c91916-6fb2-400b-9d81-a9030893f8dc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f9b74695-5bc2p"
Jul 07 17:55:15.692699 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.692675    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c6xj\" (UniqueName: \"kubernetes.io/projected/01c91916-6fb2-400b-9d81-a9030893f8dc-kube-api-access-5c6xj\") pod \"cluster-proxy-proxy-agent-65f9b74695-5bc2p\" (UID: \"01c91916-6fb2-400b-9d81-a9030893f8dc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f9b74695-5bc2p"
Jul 07 17:55:15.767069 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.767032    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f9b74695-5bc2p"
Jul 07 17:55:15.970938 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:15.970903    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f9b74695-5bc2p"]
Jul 07 17:55:15.973591 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:55:15.973566    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01c91916_6fb2_400b_9d81_a9030893f8dc.slice/crio-65122c23c6283c50824dc095047619d57f0a465085d4bd0dcc08cde34a2b7ee8 WatchSource:0}: Error finding container 65122c23c6283c50824dc095047619d57f0a465085d4bd0dcc08cde34a2b7ee8: Status 404 returned error can't find the container with id 65122c23c6283c50824dc095047619d57f0a465085d4bd0dcc08cde34a2b7ee8
Jul 07 17:55:16.079647 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:16.079603    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2tslh\" (UID: \"7c71e9bc-6539-4eb1-9961-dfb0928d5c56\") " pod="openshift-insights/insights-runtime-extractor-2tslh"
Jul 07 17:55:16.082203 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:16.082176    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7c71e9bc-6539-4eb1-9961-dfb0928d5c56-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2tslh\" (UID: \"7c71e9bc-6539-4eb1-9961-dfb0928d5c56\") " pod="openshift-insights/insights-runtime-extractor-2tslh"
Jul 07 17:55:16.263244 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:16.263157    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f9b74695-5bc2p" event={"ID":"01c91916-6fb2-400b-9d81-a9030893f8dc","Type":"ContainerStarted","Data":"65122c23c6283c50824dc095047619d57f0a465085d4bd0dcc08cde34a2b7ee8"}
Jul 07 17:55:16.337639 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:16.337604    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2tslh"
Jul 07 17:55:16.511789 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:16.511701    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2tslh"]
Jul 07 17:55:16.515745 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:55:16.515665    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c71e9bc_6539_4eb1_9961_dfb0928d5c56.slice/crio-9bc07708f86dfef066ecd8e646b95fe9eff293d8737988aaf86d0ff18e9f671d WatchSource:0}: Error finding container 9bc07708f86dfef066ecd8e646b95fe9eff293d8737988aaf86d0ff18e9f671d: Status 404 returned error can't find the container with id 9bc07708f86dfef066ecd8e646b95fe9eff293d8737988aaf86d0ff18e9f671d
Jul 07 17:55:17.272325 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:17.271625    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2tslh" event={"ID":"7c71e9bc-6539-4eb1-9961-dfb0928d5c56","Type":"ContainerStarted","Data":"9bc07708f86dfef066ecd8e646b95fe9eff293d8737988aaf86d0ff18e9f671d"}
Jul 07 17:55:21.252257 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:21.252227    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vsbcs"
Jul 07 17:55:22.290931 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:22.290888    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f9b74695-5bc2p" event={"ID":"01c91916-6fb2-400b-9d81-a9030893f8dc","Type":"ContainerStarted","Data":"c140ddbb3426ac7e01337b2a84016feeb5f9181ae4cf863ba2d4cf4f30149f7a"}
Jul 07 17:55:22.290931 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:22.290937    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f9b74695-5bc2p" event={"ID":"01c91916-6fb2-400b-9d81-a9030893f8dc","Type":"ContainerStarted","Data":"9f5694cfb28758a9d4734afeafc50bbfe6f6680f6467db283e3419abf3a50053"}
Jul 07 17:55:22.291460 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:22.290949    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f9b74695-5bc2p" event={"ID":"01c91916-6fb2-400b-9d81-a9030893f8dc","Type":"ContainerStarted","Data":"c09475efcef055fcbda543761e5d9f5c60abf64c844167fea4f5ce289d39508f"}
Jul 07 17:55:22.292349 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:22.292323    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2tslh" event={"ID":"7c71e9bc-6539-4eb1-9961-dfb0928d5c56","Type":"ContainerStarted","Data":"b8404e88b79feef1d10b7d177674e24012419a7a8af41c1b06b98468421ec537"}
Jul 07 17:55:22.318125 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:22.318068    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f9b74695-5bc2p" podStartSLOduration=1.474501889 podStartE2EDuration="7.318045519s" totalImagesPullingTime="5.84354363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:55:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:55:22.317209765 +0000 UTC m=+113.074770636" watchObservedRunningTime="2026-07-07 17:55:22.318045519 +0000 UTC m=+113.075606392"
Jul 07 17:55:23.299943 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:23.299902    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2tslh" event={"ID":"7c71e9bc-6539-4eb1-9961-dfb0928d5c56","Type":"ContainerStarted","Data":"9f7bbbbccb7e3cb8b5b8111f6bd1889883439d0471712400c2db097c1d427252"}
Jul 07 17:55:25.310678 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:25.310595    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2tslh" event={"ID":"7c71e9bc-6539-4eb1-9961-dfb0928d5c56","Type":"ContainerStarted","Data":"dc27242246ab364af6cae4ea409f80b812d9fbe6a4b6b3290451109ca6a3c39a"}
Jul 07 17:55:29.264227 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.264166    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2tslh" podStartSLOduration=36.878966973 podStartE2EDuration="45.264149755s" totalImagesPullingTime="8.385182782s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:54:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:55:25.350696198 +0000 UTC m=+116.108257083" watchObservedRunningTime="2026-07-07 17:55:29.264149755 +0000 UTC m=+120.021710626"
Jul 07 17:55:29.265337 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.265314    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s7tln"]
Jul 07 17:55:29.268311 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.268291    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.273174 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.273146    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 17:55:29.273287 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.273203    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 17:55:29.273287 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.273244    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 17:55:29.273287 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.273255    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 17:55:29.273287 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.273260    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 17:55:29.274064 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.274043    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 17:55:29.274201 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.274180    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f26r6\""
Jul 07 17:55:29.389388 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.389355    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/74e34a16-af05-4016-81d9-1d0f44f68fc5-node-exporter-tls\") pod \"node-exporter-s7tln\" (UID: \"74e34a16-af05-4016-81d9-1d0f44f68fc5\") " pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.389585 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.389395    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/74e34a16-af05-4016-81d9-1d0f44f68fc5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s7tln\" (UID: \"74e34a16-af05-4016-81d9-1d0f44f68fc5\") " pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.389585 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.389468    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/74e34a16-af05-4016-81d9-1d0f44f68fc5-node-exporter-textfile\") pod \"node-exporter-s7tln\" (UID: \"74e34a16-af05-4016-81d9-1d0f44f68fc5\") " pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.389585 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.389504    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74e34a16-af05-4016-81d9-1d0f44f68fc5-metrics-client-ca\") pod \"node-exporter-s7tln\" (UID: \"74e34a16-af05-4016-81d9-1d0f44f68fc5\") " pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.389585 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.389523    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ww9h\" (UniqueName: \"kubernetes.io/projected/74e34a16-af05-4016-81d9-1d0f44f68fc5-kube-api-access-7ww9h\") pod \"node-exporter-s7tln\" (UID: \"74e34a16-af05-4016-81d9-1d0f44f68fc5\") " pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.389585 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.389541    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74e34a16-af05-4016-81d9-1d0f44f68fc5-sys\") pod \"node-exporter-s7tln\" (UID: \"74e34a16-af05-4016-81d9-1d0f44f68fc5\") " pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.389815 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.389611    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/74e34a16-af05-4016-81d9-1d0f44f68fc5-node-exporter-accelerators-collector-config\") pod \"node-exporter-s7tln\" (UID: \"74e34a16-af05-4016-81d9-1d0f44f68fc5\") " pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.389815 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.389661    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/74e34a16-af05-4016-81d9-1d0f44f68fc5-root\") pod \"node-exporter-s7tln\" (UID: \"74e34a16-af05-4016-81d9-1d0f44f68fc5\") " pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.389815 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.389689    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/74e34a16-af05-4016-81d9-1d0f44f68fc5-node-exporter-wtmp\") pod \"node-exporter-s7tln\" (UID: \"74e34a16-af05-4016-81d9-1d0f44f68fc5\") " pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.490670 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.490636    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/74e34a16-af05-4016-81d9-1d0f44f68fc5-node-exporter-tls\") pod \"node-exporter-s7tln\" (UID: \"74e34a16-af05-4016-81d9-1d0f44f68fc5\") " pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.490812 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.490676    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/74e34a16-af05-4016-81d9-1d0f44f68fc5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s7tln\" (UID: \"74e34a16-af05-4016-81d9-1d0f44f68fc5\") " pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.490812 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.490710    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/74e34a16-af05-4016-81d9-1d0f44f68fc5-node-exporter-textfile\") pod \"node-exporter-s7tln\" (UID: \"74e34a16-af05-4016-81d9-1d0f44f68fc5\") " pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.490812 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.490736    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74e34a16-af05-4016-81d9-1d0f44f68fc5-metrics-client-ca\") pod \"node-exporter-s7tln\" (UID: \"74e34a16-af05-4016-81d9-1d0f44f68fc5\") " pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.490812 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.490751    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ww9h\" (UniqueName: \"kubernetes.io/projected/74e34a16-af05-4016-81d9-1d0f44f68fc5-kube-api-access-7ww9h\") pod \"node-exporter-s7tln\" (UID: \"74e34a16-af05-4016-81d9-1d0f44f68fc5\") " pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.490812 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.490772    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74e34a16-af05-4016-81d9-1d0f44f68fc5-sys\") pod \"node-exporter-s7tln\" (UID: \"74e34a16-af05-4016-81d9-1d0f44f68fc5\") " pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.490812 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.490800    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/74e34a16-af05-4016-81d9-1d0f44f68fc5-node-exporter-accelerators-collector-config\") pod \"node-exporter-s7tln\" (UID: \"74e34a16-af05-4016-81d9-1d0f44f68fc5\") " pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.491103 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.490862    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/74e34a16-af05-4016-81d9-1d0f44f68fc5-root\") pod \"node-exporter-s7tln\" (UID: \"74e34a16-af05-4016-81d9-1d0f44f68fc5\") " pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.491103 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.490888    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/74e34a16-af05-4016-81d9-1d0f44f68fc5-node-exporter-wtmp\") pod \"node-exporter-s7tln\" (UID: \"74e34a16-af05-4016-81d9-1d0f44f68fc5\") " pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.491103 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.490950    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74e34a16-af05-4016-81d9-1d0f44f68fc5-sys\") pod \"node-exporter-s7tln\" (UID: \"74e34a16-af05-4016-81d9-1d0f44f68fc5\") " pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.491103 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.491043    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/74e34a16-af05-4016-81d9-1d0f44f68fc5-node-exporter-wtmp\") pod \"node-exporter-s7tln\" (UID: \"74e34a16-af05-4016-81d9-1d0f44f68fc5\") " pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.491288 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.491097    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/74e34a16-af05-4016-81d9-1d0f44f68fc5-root\") pod \"node-exporter-s7tln\" (UID: \"74e34a16-af05-4016-81d9-1d0f44f68fc5\") " pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.491288 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.491157    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/74e34a16-af05-4016-81d9-1d0f44f68fc5-node-exporter-textfile\") pod \"node-exporter-s7tln\" (UID: \"74e34a16-af05-4016-81d9-1d0f44f68fc5\") " pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.491516 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.491491    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74e34a16-af05-4016-81d9-1d0f44f68fc5-metrics-client-ca\") pod \"node-exporter-s7tln\" (UID: \"74e34a16-af05-4016-81d9-1d0f44f68fc5\") " pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.491629 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.491548    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/74e34a16-af05-4016-81d9-1d0f44f68fc5-node-exporter-accelerators-collector-config\") pod \"node-exporter-s7tln\" (UID: \"74e34a16-af05-4016-81d9-1d0f44f68fc5\") " pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.493409 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.493389    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/74e34a16-af05-4016-81d9-1d0f44f68fc5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s7tln\" (UID: \"74e34a16-af05-4016-81d9-1d0f44f68fc5\") " pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.493568 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.493547    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/74e34a16-af05-4016-81d9-1d0f44f68fc5-node-exporter-tls\") pod \"node-exporter-s7tln\" (UID: \"74e34a16-af05-4016-81d9-1d0f44f68fc5\") " pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.505678 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.505639    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ww9h\" (UniqueName: \"kubernetes.io/projected/74e34a16-af05-4016-81d9-1d0f44f68fc5-kube-api-access-7ww9h\") pod \"node-exporter-s7tln\" (UID: \"74e34a16-af05-4016-81d9-1d0f44f68fc5\") " pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.577487 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:29.577399    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s7tln"
Jul 07 17:55:29.589569 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:55:29.589538    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74e34a16_af05_4016_81d9_1d0f44f68fc5.slice/crio-0dc7d4bf5e7cf4dac6d588af19adc3885a470cab596381cf2f9f4896d3ca6921 WatchSource:0}: Error finding container 0dc7d4bf5e7cf4dac6d588af19adc3885a470cab596381cf2f9f4896d3ca6921: Status 404 returned error can't find the container with id 0dc7d4bf5e7cf4dac6d588af19adc3885a470cab596381cf2f9f4896d3ca6921
Jul 07 17:55:30.335513 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:30.335465    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s7tln" event={"ID":"74e34a16-af05-4016-81d9-1d0f44f68fc5","Type":"ContainerStarted","Data":"0dc7d4bf5e7cf4dac6d588af19adc3885a470cab596381cf2f9f4896d3ca6921"}
Jul 07 17:55:31.341320 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:31.341281    2566 generic.go:356] "Generic (PLEG): container finished" podID="74e34a16-af05-4016-81d9-1d0f44f68fc5" containerID="00cf1a12f448d4b5d6106b674e01cd7e5b1482a9ab4173b3b5ebb6aee30990f0" exitCode=0
Jul 07 17:55:31.341761 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:31.341378    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s7tln" event={"ID":"74e34a16-af05-4016-81d9-1d0f44f68fc5","Type":"ContainerDied","Data":"00cf1a12f448d4b5d6106b674e01cd7e5b1482a9ab4173b3b5ebb6aee30990f0"}
Jul 07 17:55:32.346872 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:32.346816    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s7tln" event={"ID":"74e34a16-af05-4016-81d9-1d0f44f68fc5","Type":"ContainerStarted","Data":"dd145a0c39b78bd31dacb95bd626b2ccad5403333842fa81dc9d446adefd46fe"}
Jul 07 17:55:32.347348 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:32.346894    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s7tln" event={"ID":"74e34a16-af05-4016-81d9-1d0f44f68fc5","Type":"ContainerStarted","Data":"2522c229b201a6a6e441d6b64993dd9f33649f0af4984e64fd4e18b9350976c4"}
Jul 07 17:55:38.569905 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:38.569865    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bf127e3-735b-4304-9269-551261b5a0cc-metrics-certs\") pod \"network-metrics-daemon-7v8v2\" (UID: \"0bf127e3-735b-4304-9269-551261b5a0cc\") " pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:55:38.572303 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:38.572270    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bf127e3-735b-4304-9269-551261b5a0cc-metrics-certs\") pod \"network-metrics-daemon-7v8v2\" (UID: \"0bf127e3-735b-4304-9269-551261b5a0cc\") " pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:55:38.821282 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:38.821204    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lgh52\""
Jul 07 17:55:38.828730 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:38.828707    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v8v2"
Jul 07 17:55:38.966733 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:38.966678    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s7tln" podStartSLOduration=8.671506009 podStartE2EDuration="9.966658903s" totalImagesPullingTime="1.215212778s" totalInitContainerRuntime="79.940116ms" isStatefulPod=true podCreationTimestamp="2026-07-07 17:55:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:55:32.376023744 +0000 UTC m=+123.133584642" watchObservedRunningTime="2026-07-07 17:55:38.966658903 +0000 UTC m=+129.724219780"
Jul 07 17:55:38.967157 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:38.967097    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7v8v2"]
Jul 07 17:55:38.969901 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:55:38.969859    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bf127e3_735b_4304_9269_551261b5a0cc.slice/crio-37da88be9c1d10deedde4c93a331038156a4188d5f137b19ddcf97d4e02fa825 WatchSource:0}: Error finding container 37da88be9c1d10deedde4c93a331038156a4188d5f137b19ddcf97d4e02fa825: Status 404 returned error can't find the container with id 37da88be9c1d10deedde4c93a331038156a4188d5f137b19ddcf97d4e02fa825
Jul 07 17:55:39.370462 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:39.370429    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7v8v2" event={"ID":"0bf127e3-735b-4304-9269-551261b5a0cc","Type":"ContainerStarted","Data":"37da88be9c1d10deedde4c93a331038156a4188d5f137b19ddcf97d4e02fa825"}
Jul 07 17:55:40.375397 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:40.375355    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7v8v2" event={"ID":"0bf127e3-735b-4304-9269-551261b5a0cc","Type":"ContainerStarted","Data":"fe3ee46e076a1737d2867077ffdd6a4b2cdeb37b9a0a425166456b9e571bd413"}
Jul 07 17:55:41.380742 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:41.380708    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7v8v2" event={"ID":"0bf127e3-735b-4304-9269-551261b5a0cc","Type":"ContainerStarted","Data":"140dd611647c6256cfb451bac537e43563f303c1815a0a0b848179f2f4c39ae3"}
Jul 07 17:55:59.444881 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:59.444844    2566 generic.go:356] "Generic (PLEG): container finished" podID="ca3d9186-62d8-45f5-a84c-18fc318bfa08" containerID="dbe82ad93dc58beeb8abc47b88efabeb14b61cd0725ceeb4370720a63f719f6f" exitCode=0
Jul 07 17:55:59.445259 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:59.444914    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-t7nj9" event={"ID":"ca3d9186-62d8-45f5-a84c-18fc318bfa08","Type":"ContainerDied","Data":"dbe82ad93dc58beeb8abc47b88efabeb14b61cd0725ceeb4370720a63f719f6f"}
Jul 07 17:55:59.445259 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:59.445248    2566 scope.go:117] "RemoveContainer" containerID="dbe82ad93dc58beeb8abc47b88efabeb14b61cd0725ceeb4370720a63f719f6f"
Jul 07 17:55:59.488293 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:55:59.488245    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7v8v2" podStartSLOduration=148.217172223 podStartE2EDuration="2m29.488229295s" totalImagesPullingTime="1.271057072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:55:41.411073393 +0000 UTC m=+132.168634264" watchObservedRunningTime="2026-07-07 17:55:59.488229295 +0000 UTC m=+150.245790165"
Jul 07 17:56:00.128433 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:56:00.128393    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f68b6fb67-nhtkt_31f23e0b-1ec1-47af-a692-c6b0da751108/router/0.log"
Jul 07 17:56:00.136558 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:56:00.136520    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c6ss5_c59bceb7-2ee5-4f47-b279-31b1ff19937a/serve-healthcheck-canary/0.log"
Jul 07 17:56:00.450256 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:56:00.450173    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-t7nj9" event={"ID":"ca3d9186-62d8-45f5-a84c-18fc318bfa08","Type":"ContainerStarted","Data":"aab104ae91eb8299d60035bfe786bdb214269d0c7644705902086903808e080d"}
Jul 07 17:58:00.649815 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:00.649733    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv"]
Jul 07 17:58:00.652999 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:00.652978    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv"
Jul 07 17:58:00.656591 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:00.656569    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9xjg7\""
Jul 07 17:58:00.656708 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:00.656568    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 17:58:00.657799 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:00.657779    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 17:58:00.674138 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:00.674090    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv"]
Jul 07 17:58:00.802444 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:00.802408    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f721d8f-fe4c-4578-8d41-08166c8257c9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv\" (UID: \"7f721d8f-fe4c-4578-8d41-08166c8257c9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv"
Jul 07 17:58:00.802649 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:00.802457    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p74ml\" (UniqueName: \"kubernetes.io/projected/7f721d8f-fe4c-4578-8d41-08166c8257c9-kube-api-access-p74ml\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv\" (UID: \"7f721d8f-fe4c-4578-8d41-08166c8257c9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv"
Jul 07 17:58:00.802649 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:00.802560    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f721d8f-fe4c-4578-8d41-08166c8257c9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv\" (UID: \"7f721d8f-fe4c-4578-8d41-08166c8257c9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv"
Jul 07 17:58:00.903624 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:00.903527    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f721d8f-fe4c-4578-8d41-08166c8257c9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv\" (UID: \"7f721d8f-fe4c-4578-8d41-08166c8257c9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv"
Jul 07 17:58:00.903624 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:00.903571    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f721d8f-fe4c-4578-8d41-08166c8257c9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv\" (UID: \"7f721d8f-fe4c-4578-8d41-08166c8257c9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv"
Jul 07 17:58:00.903798 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:00.903722    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p74ml\" (UniqueName: \"kubernetes.io/projected/7f721d8f-fe4c-4578-8d41-08166c8257c9-kube-api-access-p74ml\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv\" (UID: \"7f721d8f-fe4c-4578-8d41-08166c8257c9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv"
Jul 07 17:58:00.903983 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:00.903966    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f721d8f-fe4c-4578-8d41-08166c8257c9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv\" (UID: \"7f721d8f-fe4c-4578-8d41-08166c8257c9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv"
Jul 07 17:58:00.904025 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:00.903996    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f721d8f-fe4c-4578-8d41-08166c8257c9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv\" (UID: \"7f721d8f-fe4c-4578-8d41-08166c8257c9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv"
Jul 07 17:58:00.914206 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:00.914170    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p74ml\" (UniqueName: \"kubernetes.io/projected/7f721d8f-fe4c-4578-8d41-08166c8257c9-kube-api-access-p74ml\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv\" (UID: \"7f721d8f-fe4c-4578-8d41-08166c8257c9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv"
Jul 07 17:58:00.962638 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:00.962599    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv"
Jul 07 17:58:01.100698 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:01.100672    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv"]
Jul 07 17:58:01.103176 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:58:01.103144    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f721d8f_fe4c_4578_8d41_08166c8257c9.slice/crio-e981fcc06efca771b7211223b33f4b77a9b7e80157884b5df9e98d9c921d4adf WatchSource:0}: Error finding container e981fcc06efca771b7211223b33f4b77a9b7e80157884b5df9e98d9c921d4adf: Status 404 returned error can't find the container with id e981fcc06efca771b7211223b33f4b77a9b7e80157884b5df9e98d9c921d4adf
Jul 07 17:58:01.863467 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:01.863429    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv" event={"ID":"7f721d8f-fe4c-4578-8d41-08166c8257c9","Type":"ContainerStarted","Data":"e981fcc06efca771b7211223b33f4b77a9b7e80157884b5df9e98d9c921d4adf"}
Jul 07 17:58:08.889581 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:08.889539    2566 generic.go:356] "Generic (PLEG): container finished" podID="7f721d8f-fe4c-4578-8d41-08166c8257c9" containerID="daddff45f513a282f3bae8ba0c4730c50d170de06f4b887ba94bbd15fd40777a" exitCode=0
Jul 07 17:58:08.890074 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:08.889594    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv" event={"ID":"7f721d8f-fe4c-4578-8d41-08166c8257c9","Type":"ContainerDied","Data":"daddff45f513a282f3bae8ba0c4730c50d170de06f4b887ba94bbd15fd40777a"}
Jul 07 17:58:11.902962 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:11.902923    2566 generic.go:356] "Generic (PLEG): container finished" podID="7f721d8f-fe4c-4578-8d41-08166c8257c9" containerID="1f22c252d7bc61725d4a2523689769d5fa9e45f1b0cff0a3d2abc9b43b2f01c6" exitCode=0
Jul 07 17:58:11.903374 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:11.903017    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv" event={"ID":"7f721d8f-fe4c-4578-8d41-08166c8257c9","Type":"ContainerDied","Data":"1f22c252d7bc61725d4a2523689769d5fa9e45f1b0cff0a3d2abc9b43b2f01c6"}
Jul 07 17:58:19.933883 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:19.933843    2566 generic.go:356] "Generic (PLEG): container finished" podID="7f721d8f-fe4c-4578-8d41-08166c8257c9" containerID="2f1ed82ce4eac726548cff3ba682370a0c66da7634621fe1206ce7e912b30b38" exitCode=0
Jul 07 17:58:19.934275 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:19.933903    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv" event={"ID":"7f721d8f-fe4c-4578-8d41-08166c8257c9","Type":"ContainerDied","Data":"2f1ed82ce4eac726548cff3ba682370a0c66da7634621fe1206ce7e912b30b38"}
Jul 07 17:58:21.062984 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:21.062959    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv"
Jul 07 17:58:21.167752 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:21.167714    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p74ml\" (UniqueName: \"kubernetes.io/projected/7f721d8f-fe4c-4578-8d41-08166c8257c9-kube-api-access-p74ml\") pod \"7f721d8f-fe4c-4578-8d41-08166c8257c9\" (UID: \"7f721d8f-fe4c-4578-8d41-08166c8257c9\") "
Jul 07 17:58:21.167975 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:21.167868    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f721d8f-fe4c-4578-8d41-08166c8257c9-bundle\") pod \"7f721d8f-fe4c-4578-8d41-08166c8257c9\" (UID: \"7f721d8f-fe4c-4578-8d41-08166c8257c9\") "
Jul 07 17:58:21.167975 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:21.167906    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f721d8f-fe4c-4578-8d41-08166c8257c9-util\") pod \"7f721d8f-fe4c-4578-8d41-08166c8257c9\" (UID: \"7f721d8f-fe4c-4578-8d41-08166c8257c9\") "
Jul 07 17:58:21.168499 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:21.168470    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f721d8f-fe4c-4578-8d41-08166c8257c9-bundle" (OuterVolumeSpecName: "bundle") pod "7f721d8f-fe4c-4578-8d41-08166c8257c9" (UID: "7f721d8f-fe4c-4578-8d41-08166c8257c9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:58:21.170104 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:21.170076    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f721d8f-fe4c-4578-8d41-08166c8257c9-kube-api-access-p74ml" (OuterVolumeSpecName: "kube-api-access-p74ml") pod "7f721d8f-fe4c-4578-8d41-08166c8257c9" (UID: "7f721d8f-fe4c-4578-8d41-08166c8257c9"). InnerVolumeSpecName "kube-api-access-p74ml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:58:21.172143 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:21.172123    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f721d8f-fe4c-4578-8d41-08166c8257c9-util" (OuterVolumeSpecName: "util") pod "7f721d8f-fe4c-4578-8d41-08166c8257c9" (UID: "7f721d8f-fe4c-4578-8d41-08166c8257c9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:58:21.268926 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:21.268882    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p74ml\" (UniqueName: \"kubernetes.io/projected/7f721d8f-fe4c-4578-8d41-08166c8257c9-kube-api-access-p74ml\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 17:58:21.268926 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:21.268923    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f721d8f-fe4c-4578-8d41-08166c8257c9-bundle\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 17:58:21.268926 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:21.268934    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f721d8f-fe4c-4578-8d41-08166c8257c9-util\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 17:58:21.942836 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:21.942793    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv"
Jul 07 17:58:21.943003 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:21.942790    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hq5qv" event={"ID":"7f721d8f-fe4c-4578-8d41-08166c8257c9","Type":"ContainerDied","Data":"e981fcc06efca771b7211223b33f4b77a9b7e80157884b5df9e98d9c921d4adf"}
Jul 07 17:58:21.943003 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:21.942942    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e981fcc06efca771b7211223b33f4b77a9b7e80157884b5df9e98d9c921d4adf"
Jul 07 17:58:28.932747 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:28.932718    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5pntm"]
Jul 07 17:58:28.933255 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:28.932963    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f721d8f-fe4c-4578-8d41-08166c8257c9" containerName="extract"
Jul 07 17:58:28.933255 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:28.932973    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f721d8f-fe4c-4578-8d41-08166c8257c9" containerName="extract"
Jul 07 17:58:28.933255 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:28.932983    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f721d8f-fe4c-4578-8d41-08166c8257c9" containerName="util"
Jul 07 17:58:28.933255 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:28.932988    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f721d8f-fe4c-4578-8d41-08166c8257c9" containerName="util"
Jul 07 17:58:28.933255 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:28.933005    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f721d8f-fe4c-4578-8d41-08166c8257c9" containerName="pull"
Jul 07 17:58:28.933255 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:28.933012    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f721d8f-fe4c-4578-8d41-08166c8257c9" containerName="pull"
Jul 07 17:58:28.933255 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:28.933049    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f721d8f-fe4c-4578-8d41-08166c8257c9" containerName="extract"
Jul 07 17:58:28.937242 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:28.937225    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5pntm"
Jul 07 17:58:28.940172 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:28.940149    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-8cgcd\""
Jul 07 17:58:28.940676 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:28.940661    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 07 17:58:28.940755 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:28.940714    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:58:28.949516 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:28.949493    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5pntm"]
Jul 07 17:58:29.129503 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:29.129462    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbl5f\" (UniqueName: \"kubernetes.io/projected/6381cb2b-ba61-42a4-bee6-710d5fed9b8b-kube-api-access-xbl5f\") pod \"cert-manager-operator-controller-manager-55c444bf86-5pntm\" (UID: \"6381cb2b-ba61-42a4-bee6-710d5fed9b8b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5pntm"
Jul 07 17:58:29.129670 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:29.129557    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6381cb2b-ba61-42a4-bee6-710d5fed9b8b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5pntm\" (UID: \"6381cb2b-ba61-42a4-bee6-710d5fed9b8b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5pntm"
Jul 07 17:58:29.230390 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:29.230353    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6381cb2b-ba61-42a4-bee6-710d5fed9b8b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5pntm\" (UID: \"6381cb2b-ba61-42a4-bee6-710d5fed9b8b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5pntm"
Jul 07 17:58:29.230581 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:29.230405    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbl5f\" (UniqueName: \"kubernetes.io/projected/6381cb2b-ba61-42a4-bee6-710d5fed9b8b-kube-api-access-xbl5f\") pod \"cert-manager-operator-controller-manager-55c444bf86-5pntm\" (UID: \"6381cb2b-ba61-42a4-bee6-710d5fed9b8b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5pntm"
Jul 07 17:58:29.230797 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:29.230773    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6381cb2b-ba61-42a4-bee6-710d5fed9b8b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5pntm\" (UID: \"6381cb2b-ba61-42a4-bee6-710d5fed9b8b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5pntm"
Jul 07 17:58:29.240427 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:29.240393    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbl5f\" (UniqueName: \"kubernetes.io/projected/6381cb2b-ba61-42a4-bee6-710d5fed9b8b-kube-api-access-xbl5f\") pod \"cert-manager-operator-controller-manager-55c444bf86-5pntm\" (UID: \"6381cb2b-ba61-42a4-bee6-710d5fed9b8b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5pntm"
Jul 07 17:58:29.246319 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:29.246281    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5pntm"
Jul 07 17:58:29.392052 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:29.392016    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5pntm"]
Jul 07 17:58:29.395250 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:58:29.395222    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6381cb2b_ba61_42a4_bee6_710d5fed9b8b.slice/crio-dab36bc84813032380ee1487db2bc1edaec45b7997fdb05e1939d0c514ca8733 WatchSource:0}: Error finding container dab36bc84813032380ee1487db2bc1edaec45b7997fdb05e1939d0c514ca8733: Status 404 returned error can't find the container with id dab36bc84813032380ee1487db2bc1edaec45b7997fdb05e1939d0c514ca8733
Jul 07 17:58:29.666115 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:29.666032    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lcfnl_9bc45238-7341-43fe-a75f-231dbf7a3704/console-operator/1.log"
Jul 07 17:58:29.669477 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:29.669451    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lcfnl_9bc45238-7341-43fe-a75f-231dbf7a3704/console-operator/1.log"
Jul 07 17:58:29.677074 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:29.677042    2566 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 17:58:29.971074 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:29.971034    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5pntm" event={"ID":"6381cb2b-ba61-42a4-bee6-710d5fed9b8b","Type":"ContainerStarted","Data":"dab36bc84813032380ee1487db2bc1edaec45b7997fdb05e1939d0c514ca8733"}
Jul 07 17:58:31.980636 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:31.980603    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5pntm" event={"ID":"6381cb2b-ba61-42a4-bee6-710d5fed9b8b","Type":"ContainerStarted","Data":"999281139fcea969518116467f1d9e3c28eac6849c7887e4bc9e3b9c1afb94ab"}
Jul 07 17:58:32.008022 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:32.007960    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5pntm" podStartSLOduration=2.186313252 podStartE2EDuration="4.007939297s" totalImagesPullingTime="1.821626045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:58:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:58:32.007328636 +0000 UTC m=+302.764889507" watchObservedRunningTime="2026-07-07 17:58:32.007939297 +0000 UTC m=+302.765500170"
Jul 07 17:58:33.222781 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:33.222748    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz"]
Jul 07 17:58:33.226089 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:33.226070    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz"
Jul 07 17:58:33.228917 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:33.228895    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 17:58:33.229041 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:33.228913    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9xjg7\""
Jul 07 17:58:33.229954 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:33.229939    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 17:58:33.238474 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:33.238447    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz"]
Jul 07 17:58:33.253790 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:33.253748    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d85n\" (UniqueName: \"kubernetes.io/projected/3d7f5ad5-3d27-4f69-9bb0-723c398a59c1-kube-api-access-5d85n\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz\" (UID: \"3d7f5ad5-3d27-4f69-9bb0-723c398a59c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz"
Jul 07 17:58:33.253978 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:33.253799    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d7f5ad5-3d27-4f69-9bb0-723c398a59c1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz\" (UID: \"3d7f5ad5-3d27-4f69-9bb0-723c398a59c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz"
Jul 07 17:58:33.253978 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:33.253878    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d7f5ad5-3d27-4f69-9bb0-723c398a59c1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz\" (UID: \"3d7f5ad5-3d27-4f69-9bb0-723c398a59c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz"
Jul 07 17:58:33.354288 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:33.354250    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d7f5ad5-3d27-4f69-9bb0-723c398a59c1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz\" (UID: \"3d7f5ad5-3d27-4f69-9bb0-723c398a59c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz"
Jul 07 17:58:33.354455 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:33.354305    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d7f5ad5-3d27-4f69-9bb0-723c398a59c1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz\" (UID: \"3d7f5ad5-3d27-4f69-9bb0-723c398a59c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz"
Jul 07 17:58:33.354455 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:33.354358    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d85n\" (UniqueName: \"kubernetes.io/projected/3d7f5ad5-3d27-4f69-9bb0-723c398a59c1-kube-api-access-5d85n\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz\" (UID: \"3d7f5ad5-3d27-4f69-9bb0-723c398a59c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz"
Jul 07 17:58:33.354699 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:33.354677    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d7f5ad5-3d27-4f69-9bb0-723c398a59c1-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz\" (UID: \"3d7f5ad5-3d27-4f69-9bb0-723c398a59c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz"
Jul 07 17:58:33.354739 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:33.354691    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d7f5ad5-3d27-4f69-9bb0-723c398a59c1-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz\" (UID: \"3d7f5ad5-3d27-4f69-9bb0-723c398a59c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz"
Jul 07 17:58:33.367906 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:33.367872    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d85n\" (UniqueName: \"kubernetes.io/projected/3d7f5ad5-3d27-4f69-9bb0-723c398a59c1-kube-api-access-5d85n\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz\" (UID: \"3d7f5ad5-3d27-4f69-9bb0-723c398a59c1\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz"
Jul 07 17:58:33.534913 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:33.534812    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz"
Jul 07 17:58:33.680204 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:33.680177    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz"]
Jul 07 17:58:33.682635 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:58:33.682606    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d7f5ad5_3d27_4f69_9bb0_723c398a59c1.slice/crio-474d73c6d356be900ee818e5d4e1ab9db7710fab063e8d80cc99b47b20b126dd WatchSource:0}: Error finding container 474d73c6d356be900ee818e5d4e1ab9db7710fab063e8d80cc99b47b20b126dd: Status 404 returned error can't find the container with id 474d73c6d356be900ee818e5d4e1ab9db7710fab063e8d80cc99b47b20b126dd
Jul 07 17:58:33.989496 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:33.989461    2566 generic.go:356] "Generic (PLEG): container finished" podID="3d7f5ad5-3d27-4f69-9bb0-723c398a59c1" containerID="32b21ecffca82f216c3085443b30923eac594558a559d88661bdc4241836ad8c" exitCode=0
Jul 07 17:58:33.989664 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:33.989528    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz" event={"ID":"3d7f5ad5-3d27-4f69-9bb0-723c398a59c1","Type":"ContainerDied","Data":"32b21ecffca82f216c3085443b30923eac594558a559d88661bdc4241836ad8c"}
Jul 07 17:58:33.989664 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:33.989570    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz" event={"ID":"3d7f5ad5-3d27-4f69-9bb0-723c398a59c1","Type":"ContainerStarted","Data":"474d73c6d356be900ee818e5d4e1ab9db7710fab063e8d80cc99b47b20b126dd"}
Jul 07 17:58:33.990585 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:33.990569    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 17:58:37.003089 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:37.003051    2566 generic.go:356] "Generic (PLEG): container finished" podID="3d7f5ad5-3d27-4f69-9bb0-723c398a59c1" containerID="c60097471c10845b5e7d38179d0c169c0e18247fcf0e11f130ded467457dab89" exitCode=0
Jul 07 17:58:37.003440 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:37.003106    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz" event={"ID":"3d7f5ad5-3d27-4f69-9bb0-723c398a59c1","Type":"ContainerDied","Data":"c60097471c10845b5e7d38179d0c169c0e18247fcf0e11f130ded467457dab89"}
Jul 07 17:58:38.009063 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:38.009029    2566 generic.go:356] "Generic (PLEG): container finished" podID="3d7f5ad5-3d27-4f69-9bb0-723c398a59c1" containerID="9955af4c6e4b8e34ab2ee3efa03b2782a30b7053f41ba614660d026048e97f74" exitCode=0
Jul 07 17:58:38.009445 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:38.009099    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz" event={"ID":"3d7f5ad5-3d27-4f69-9bb0-723c398a59c1","Type":"ContainerDied","Data":"9955af4c6e4b8e34ab2ee3efa03b2782a30b7053f41ba614660d026048e97f74"}
Jul 07 17:58:39.140041 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:39.140010    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz"
Jul 07 17:58:39.198899 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:39.198863    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d7f5ad5-3d27-4f69-9bb0-723c398a59c1-bundle\") pod \"3d7f5ad5-3d27-4f69-9bb0-723c398a59c1\" (UID: \"3d7f5ad5-3d27-4f69-9bb0-723c398a59c1\") "
Jul 07 17:58:39.199058 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:39.198914    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d7f5ad5-3d27-4f69-9bb0-723c398a59c1-util\") pod \"3d7f5ad5-3d27-4f69-9bb0-723c398a59c1\" (UID: \"3d7f5ad5-3d27-4f69-9bb0-723c398a59c1\") "
Jul 07 17:58:39.199058 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:39.198959    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5d85n\" (UniqueName: \"kubernetes.io/projected/3d7f5ad5-3d27-4f69-9bb0-723c398a59c1-kube-api-access-5d85n\") pod \"3d7f5ad5-3d27-4f69-9bb0-723c398a59c1\" (UID: \"3d7f5ad5-3d27-4f69-9bb0-723c398a59c1\") "
Jul 07 17:58:39.199325 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:39.199294    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d7f5ad5-3d27-4f69-9bb0-723c398a59c1-bundle" (OuterVolumeSpecName: "bundle") pod "3d7f5ad5-3d27-4f69-9bb0-723c398a59c1" (UID: "3d7f5ad5-3d27-4f69-9bb0-723c398a59c1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:58:39.201214 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:39.201187    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d7f5ad5-3d27-4f69-9bb0-723c398a59c1-kube-api-access-5d85n" (OuterVolumeSpecName: "kube-api-access-5d85n") pod "3d7f5ad5-3d27-4f69-9bb0-723c398a59c1" (UID: "3d7f5ad5-3d27-4f69-9bb0-723c398a59c1"). InnerVolumeSpecName "kube-api-access-5d85n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:58:39.203478 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:39.203451    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d7f5ad5-3d27-4f69-9bb0-723c398a59c1-util" (OuterVolumeSpecName: "util") pod "3d7f5ad5-3d27-4f69-9bb0-723c398a59c1" (UID: "3d7f5ad5-3d27-4f69-9bb0-723c398a59c1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:58:39.300090 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:39.299995    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5d85n\" (UniqueName: \"kubernetes.io/projected/3d7f5ad5-3d27-4f69-9bb0-723c398a59c1-kube-api-access-5d85n\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 17:58:39.300090 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:39.300029    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d7f5ad5-3d27-4f69-9bb0-723c398a59c1-bundle\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 17:58:39.300090 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:39.300039    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d7f5ad5-3d27-4f69-9bb0-723c398a59c1-util\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 17:58:40.019665 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:40.019626    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz" event={"ID":"3d7f5ad5-3d27-4f69-9bb0-723c398a59c1","Type":"ContainerDied","Data":"474d73c6d356be900ee818e5d4e1ab9db7710fab063e8d80cc99b47b20b126dd"}
Jul 07 17:58:40.019928 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:40.019681    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="474d73c6d356be900ee818e5d4e1ab9db7710fab063e8d80cc99b47b20b126dd"
Jul 07 17:58:40.019928 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:40.019683    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsxlfz"
Jul 07 17:58:53.876766 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:53.876730    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp"]
Jul 07 17:58:53.877173 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:53.876994    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d7f5ad5-3d27-4f69-9bb0-723c398a59c1" containerName="pull"
Jul 07 17:58:53.877173 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:53.877033    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d7f5ad5-3d27-4f69-9bb0-723c398a59c1" containerName="pull"
Jul 07 17:58:53.877173 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:53.877043    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d7f5ad5-3d27-4f69-9bb0-723c398a59c1" containerName="extract"
Jul 07 17:58:53.877173 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:53.877049    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d7f5ad5-3d27-4f69-9bb0-723c398a59c1" containerName="extract"
Jul 07 17:58:53.877173 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:53.877062    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d7f5ad5-3d27-4f69-9bb0-723c398a59c1" containerName="util"
Jul 07 17:58:53.877173 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:53.877067    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d7f5ad5-3d27-4f69-9bb0-723c398a59c1" containerName="util"
Jul 07 17:58:53.877173 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:53.877118    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d7f5ad5-3d27-4f69-9bb0-723c398a59c1" containerName="extract"
Jul 07 17:58:53.879712 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:53.879696    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp"
Jul 07 17:58:53.882588 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:53.882565    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 17:58:53.883811 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:53.883788    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9xjg7\""
Jul 07 17:58:53.883933 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:53.883858    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 17:58:53.891146 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:53.891119    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp"]
Jul 07 17:58:53.910894 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:53.910861    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57463e6b-bb2f-4dac-8725-bdc4bf4a3f19-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp\" (UID: \"57463e6b-bb2f-4dac-8725-bdc4bf4a3f19\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp"
Jul 07 17:58:53.911115 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:53.910945    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57463e6b-bb2f-4dac-8725-bdc4bf4a3f19-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp\" (UID: \"57463e6b-bb2f-4dac-8725-bdc4bf4a3f19\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp"
Jul 07 17:58:53.911115 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:53.910975    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t26wm\" (UniqueName: \"kubernetes.io/projected/57463e6b-bb2f-4dac-8725-bdc4bf4a3f19-kube-api-access-t26wm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp\" (UID: \"57463e6b-bb2f-4dac-8725-bdc4bf4a3f19\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp"
Jul 07 17:58:54.011574 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:54.011531    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57463e6b-bb2f-4dac-8725-bdc4bf4a3f19-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp\" (UID: \"57463e6b-bb2f-4dac-8725-bdc4bf4a3f19\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp"
Jul 07 17:58:54.011754 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:54.011588    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57463e6b-bb2f-4dac-8725-bdc4bf4a3f19-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp\" (UID: \"57463e6b-bb2f-4dac-8725-bdc4bf4a3f19\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp"
Jul 07 17:58:54.011754 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:54.011620    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t26wm\" (UniqueName: \"kubernetes.io/projected/57463e6b-bb2f-4dac-8725-bdc4bf4a3f19-kube-api-access-t26wm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp\" (UID: \"57463e6b-bb2f-4dac-8725-bdc4bf4a3f19\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp"
Jul 07 17:58:54.011974 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:54.011956    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57463e6b-bb2f-4dac-8725-bdc4bf4a3f19-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp\" (UID: \"57463e6b-bb2f-4dac-8725-bdc4bf4a3f19\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp"
Jul 07 17:58:54.012015 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:54.011996    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57463e6b-bb2f-4dac-8725-bdc4bf4a3f19-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp\" (UID: \"57463e6b-bb2f-4dac-8725-bdc4bf4a3f19\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp"
Jul 07 17:58:54.023663 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:54.023621    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t26wm\" (UniqueName: \"kubernetes.io/projected/57463e6b-bb2f-4dac-8725-bdc4bf4a3f19-kube-api-access-t26wm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp\" (UID: \"57463e6b-bb2f-4dac-8725-bdc4bf4a3f19\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp"
Jul 07 17:58:54.188876 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:54.188746    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp"
Jul 07 17:58:54.328723 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:54.328687    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp"]
Jul 07 17:58:54.331912 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:58:54.331882    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57463e6b_bb2f_4dac_8725_bdc4bf4a3f19.slice/crio-da8d6f9a0fe71ca50c446ee5d564d5fb49d2a5197d718895665b08aeca71485d WatchSource:0}: Error finding container da8d6f9a0fe71ca50c446ee5d564d5fb49d2a5197d718895665b08aeca71485d: Status 404 returned error can't find the container with id da8d6f9a0fe71ca50c446ee5d564d5fb49d2a5197d718895665b08aeca71485d
Jul 07 17:58:55.077987 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:55.077946    2566 generic.go:356] "Generic (PLEG): container finished" podID="57463e6b-bb2f-4dac-8725-bdc4bf4a3f19" containerID="3a09bc485120f9e38678f7e3bbb202b7c95e0f372c9e2c338ca56ac5dc4027f4" exitCode=0
Jul 07 17:58:55.078379 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:55.077995    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp" event={"ID":"57463e6b-bb2f-4dac-8725-bdc4bf4a3f19","Type":"ContainerDied","Data":"3a09bc485120f9e38678f7e3bbb202b7c95e0f372c9e2c338ca56ac5dc4027f4"}
Jul 07 17:58:55.078379 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:55.078041    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp" event={"ID":"57463e6b-bb2f-4dac-8725-bdc4bf4a3f19","Type":"ContainerStarted","Data":"da8d6f9a0fe71ca50c446ee5d564d5fb49d2a5197d718895665b08aeca71485d"}
Jul 07 17:58:56.084136 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:56.084098    2566 generic.go:356] "Generic (PLEG): container finished" podID="57463e6b-bb2f-4dac-8725-bdc4bf4a3f19" containerID="a7e23a91e43acc066f1bf35926a95ea78a8495c519bfd0c81127da31f6452842" exitCode=0
Jul 07 17:58:56.084658 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:56.084151    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp" event={"ID":"57463e6b-bb2f-4dac-8725-bdc4bf4a3f19","Type":"ContainerDied","Data":"a7e23a91e43acc066f1bf35926a95ea78a8495c519bfd0c81127da31f6452842"}
Jul 07 17:58:57.091715 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:57.091682    2566 generic.go:356] "Generic (PLEG): container finished" podID="57463e6b-bb2f-4dac-8725-bdc4bf4a3f19" containerID="1d0454f5c99fcb1ffe043e1f6d975c3d1eef5b2f37d693e100b0a4cbcf9de312" exitCode=0
Jul 07 17:58:57.092171 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:57.091771    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp" event={"ID":"57463e6b-bb2f-4dac-8725-bdc4bf4a3f19","Type":"ContainerDied","Data":"1d0454f5c99fcb1ffe043e1f6d975c3d1eef5b2f37d693e100b0a4cbcf9de312"}
Jul 07 17:58:58.220097 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:58.220067    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp"
Jul 07 17:58:58.346605 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:58.346513    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57463e6b-bb2f-4dac-8725-bdc4bf4a3f19-bundle\") pod \"57463e6b-bb2f-4dac-8725-bdc4bf4a3f19\" (UID: \"57463e6b-bb2f-4dac-8725-bdc4bf4a3f19\") "
Jul 07 17:58:58.346605 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:58.346556    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57463e6b-bb2f-4dac-8725-bdc4bf4a3f19-util\") pod \"57463e6b-bb2f-4dac-8725-bdc4bf4a3f19\" (UID: \"57463e6b-bb2f-4dac-8725-bdc4bf4a3f19\") "
Jul 07 17:58:58.346862 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:58.346640    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t26wm\" (UniqueName: \"kubernetes.io/projected/57463e6b-bb2f-4dac-8725-bdc4bf4a3f19-kube-api-access-t26wm\") pod \"57463e6b-bb2f-4dac-8725-bdc4bf4a3f19\" (UID: \"57463e6b-bb2f-4dac-8725-bdc4bf4a3f19\") "
Jul 07 17:58:58.347326 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:58.347300    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57463e6b-bb2f-4dac-8725-bdc4bf4a3f19-bundle" (OuterVolumeSpecName: "bundle") pod "57463e6b-bb2f-4dac-8725-bdc4bf4a3f19" (UID: "57463e6b-bb2f-4dac-8725-bdc4bf4a3f19"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:58:58.348980 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:58.348952    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57463e6b-bb2f-4dac-8725-bdc4bf4a3f19-kube-api-access-t26wm" (OuterVolumeSpecName: "kube-api-access-t26wm") pod "57463e6b-bb2f-4dac-8725-bdc4bf4a3f19" (UID: "57463e6b-bb2f-4dac-8725-bdc4bf4a3f19"). InnerVolumeSpecName "kube-api-access-t26wm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:58:58.352356 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:58.352331    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57463e6b-bb2f-4dac-8725-bdc4bf4a3f19-util" (OuterVolumeSpecName: "util") pod "57463e6b-bb2f-4dac-8725-bdc4bf4a3f19" (UID: "57463e6b-bb2f-4dac-8725-bdc4bf4a3f19"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:58:58.448027 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:58.447982    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t26wm\" (UniqueName: \"kubernetes.io/projected/57463e6b-bb2f-4dac-8725-bdc4bf4a3f19-kube-api-access-t26wm\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 17:58:58.448027 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:58.448018    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57463e6b-bb2f-4dac-8725-bdc4bf4a3f19-bundle\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 17:58:58.448027 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:58.448028    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57463e6b-bb2f-4dac-8725-bdc4bf4a3f19-util\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 17:58:59.101877 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:59.101808    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp" event={"ID":"57463e6b-bb2f-4dac-8725-bdc4bf4a3f19","Type":"ContainerDied","Data":"da8d6f9a0fe71ca50c446ee5d564d5fb49d2a5197d718895665b08aeca71485d"}
Jul 07 17:58:59.102086 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:59.101899    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da8d6f9a0fe71ca50c446ee5d564d5fb49d2a5197d718895665b08aeca71485d"
Jul 07 17:58:59.102086 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:58:59.101851    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm5wp"
Jul 07 17:59:07.353768 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.353731    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-pcp5m"]
Jul 07 17:59:07.354456 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.354012    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57463e6b-bb2f-4dac-8725-bdc4bf4a3f19" containerName="util"
Jul 07 17:59:07.354456 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.354025    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="57463e6b-bb2f-4dac-8725-bdc4bf4a3f19" containerName="util"
Jul 07 17:59:07.354456 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.354031    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57463e6b-bb2f-4dac-8725-bdc4bf4a3f19" containerName="extract"
Jul 07 17:59:07.354456 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.354036    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="57463e6b-bb2f-4dac-8725-bdc4bf4a3f19" containerName="extract"
Jul 07 17:59:07.354456 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.354052    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57463e6b-bb2f-4dac-8725-bdc4bf4a3f19" containerName="pull"
Jul 07 17:59:07.354456 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.354057    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="57463e6b-bb2f-4dac-8725-bdc4bf4a3f19" containerName="pull"
Jul 07 17:59:07.354456 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.354100    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="57463e6b-bb2f-4dac-8725-bdc4bf4a3f19" containerName="extract"
Jul 07 17:59:07.357986 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.357967    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-pcp5m"
Jul 07 17:59:07.363200 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.363172    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 17:59:07.363200 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.363187    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 17:59:07.363410 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.363216    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 17:59:07.363640 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.363621    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l566k\""
Jul 07 17:59:07.365773 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.365756    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 17:59:07.392905 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.392874    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-pcp5m"]
Jul 07 17:59:07.412283 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.412240    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/39fdfc6b-613f-4bf3-80ca-67486c0fd30e-manifests\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-pcp5m\" (UID: \"39fdfc6b-613f-4bf3-80ca-67486c0fd30e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-pcp5m"
Jul 07 17:59:07.412475 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.412294    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39fdfc6b-613f-4bf3-80ca-67486c0fd30e-tmp\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-pcp5m\" (UID: \"39fdfc6b-613f-4bf3-80ca-67486c0fd30e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-pcp5m"
Jul 07 17:59:07.412475 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.412373    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfgss\" (UniqueName: \"kubernetes.io/projected/39fdfc6b-613f-4bf3-80ca-67486c0fd30e-kube-api-access-nfgss\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-pcp5m\" (UID: \"39fdfc6b-613f-4bf3-80ca-67486c0fd30e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-pcp5m"
Jul 07 17:59:07.412475 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.412406    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/39fdfc6b-613f-4bf3-80ca-67486c0fd30e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-pcp5m\" (UID: \"39fdfc6b-613f-4bf3-80ca-67486c0fd30e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-pcp5m"
Jul 07 17:59:07.412475 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.412450    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/39fdfc6b-613f-4bf3-80ca-67486c0fd30e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-pcp5m\" (UID: \"39fdfc6b-613f-4bf3-80ca-67486c0fd30e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-pcp5m"
Jul 07 17:59:07.513394 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.513351    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/39fdfc6b-613f-4bf3-80ca-67486c0fd30e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-pcp5m\" (UID: \"39fdfc6b-613f-4bf3-80ca-67486c0fd30e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-pcp5m"
Jul 07 17:59:07.513394 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.513400    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/39fdfc6b-613f-4bf3-80ca-67486c0fd30e-manifests\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-pcp5m\" (UID: \"39fdfc6b-613f-4bf3-80ca-67486c0fd30e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-pcp5m"
Jul 07 17:59:07.513644 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.513423    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39fdfc6b-613f-4bf3-80ca-67486c0fd30e-tmp\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-pcp5m\" (UID: \"39fdfc6b-613f-4bf3-80ca-67486c0fd30e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-pcp5m"
Jul 07 17:59:07.513644 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.513468    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfgss\" (UniqueName: \"kubernetes.io/projected/39fdfc6b-613f-4bf3-80ca-67486c0fd30e-kube-api-access-nfgss\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-pcp5m\" (UID: \"39fdfc6b-613f-4bf3-80ca-67486c0fd30e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-pcp5m"
Jul 07 17:59:07.513644 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.513491    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/39fdfc6b-613f-4bf3-80ca-67486c0fd30e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-pcp5m\" (UID: \"39fdfc6b-613f-4bf3-80ca-67486c0fd30e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-pcp5m"
Jul 07 17:59:07.513815 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.513790    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/39fdfc6b-613f-4bf3-80ca-67486c0fd30e-manifests\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-pcp5m\" (UID: \"39fdfc6b-613f-4bf3-80ca-67486c0fd30e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-pcp5m"
Jul 07 17:59:07.515956 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.515931    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39fdfc6b-613f-4bf3-80ca-67486c0fd30e-tmp\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-pcp5m\" (UID: \"39fdfc6b-613f-4bf3-80ca-67486c0fd30e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-pcp5m"
Jul 07 17:59:07.516216 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.516195    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/39fdfc6b-613f-4bf3-80ca-67486c0fd30e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-pcp5m\" (UID: \"39fdfc6b-613f-4bf3-80ca-67486c0fd30e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-pcp5m"
Jul 07 17:59:07.516288 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.516231    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/39fdfc6b-613f-4bf3-80ca-67486c0fd30e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-pcp5m\" (UID: \"39fdfc6b-613f-4bf3-80ca-67486c0fd30e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-pcp5m"
Jul 07 17:59:07.529136 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.529091    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfgss\" (UniqueName: \"kubernetes.io/projected/39fdfc6b-613f-4bf3-80ca-67486c0fd30e-kube-api-access-nfgss\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-pcp5m\" (UID: \"39fdfc6b-613f-4bf3-80ca-67486c0fd30e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-pcp5m"
Jul 07 17:59:07.668573 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.668469    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-pcp5m"
Jul 07 17:59:07.829778 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:07.829742    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-pcp5m"]
Jul 07 17:59:07.834924 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:59:07.834880    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39fdfc6b_613f_4bf3_80ca_67486c0fd30e.slice/crio-2f8389061796588c8a91b6147f98adc0f0b9839a36b288f9793137268e2a156e WatchSource:0}: Error finding container 2f8389061796588c8a91b6147f98adc0f0b9839a36b288f9793137268e2a156e: Status 404 returned error can't find the container with id 2f8389061796588c8a91b6147f98adc0f0b9839a36b288f9793137268e2a156e
Jul 07 17:59:08.140282 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:08.140245    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-pcp5m" event={"ID":"39fdfc6b-613f-4bf3-80ca-67486c0fd30e","Type":"ContainerStarted","Data":"2f8389061796588c8a91b6147f98adc0f0b9839a36b288f9793137268e2a156e"}
Jul 07 17:59:12.159681 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:12.159632    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-pcp5m" event={"ID":"39fdfc6b-613f-4bf3-80ca-67486c0fd30e","Type":"ContainerStarted","Data":"cc10e6ed432f2ed2114a054e09e58f15eb9604689c2e658addba7f1ed3c04fec"}
Jul 07 17:59:13.167889 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:13.167849    2566 generic.go:356] "Generic (PLEG): container finished" podID="39fdfc6b-613f-4bf3-80ca-67486c0fd30e" containerID="cc10e6ed432f2ed2114a054e09e58f15eb9604689c2e658addba7f1ed3c04fec" exitCode=0
Jul 07 17:59:13.168267 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:13.167911    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-pcp5m" event={"ID":"39fdfc6b-613f-4bf3-80ca-67486c0fd30e","Type":"ContainerDied","Data":"cc10e6ed432f2ed2114a054e09e58f15eb9604689c2e658addba7f1ed3c04fec"}
Jul 07 17:59:14.173957 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:14.173920    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-pcp5m" event={"ID":"39fdfc6b-613f-4bf3-80ca-67486c0fd30e","Type":"ContainerStarted","Data":"ee414c2f521a8e53f9114a27b558259145c33d255bdeb2f83ce84d3e4fbe9b34"}
Jul 07 17:59:14.174350 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:14.174162    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-pcp5m"
Jul 07 17:59:14.207869 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:14.207795    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-pcp5m" podStartSLOduration=2.5503189539999997 podStartE2EDuration="7.207777693s" totalImagesPullingTime="3.58326478s" totalInitContainerRuntime="1.074193959s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:59:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:59:14.205587016 +0000 UTC m=+344.963147902" watchObservedRunningTime="2026-07-07 17:59:14.207777693 +0000 UTC m=+344.965338617"
Jul 07 17:59:25.181334 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:25.181259    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-pcp5m"
Jul 07 17:59:27.907318 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:27.907281    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5bdc88f569-d7dp4"]
Jul 07 17:59:27.915238 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:27.915215    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5bdc88f569-d7dp4"
Jul 07 17:59:27.918449 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:27.918427    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 17:59:27.919561 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:27.919540    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 17:59:27.931934 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:27.931905    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5bdc88f569-d7dp4"]
Jul 07 17:59:28.072260 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:28.072227    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/561c33c4-fcf6-4317-9324-b7fc8e196b17-tmp\") pod \"kube-auth-proxy-5bdc88f569-d7dp4\" (UID: \"561c33c4-fcf6-4317-9324-b7fc8e196b17\") " pod="openshift-ingress/kube-auth-proxy-5bdc88f569-d7dp4"
Jul 07 17:59:28.072466 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:28.072341    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/561c33c4-fcf6-4317-9324-b7fc8e196b17-tls-certs\") pod \"kube-auth-proxy-5bdc88f569-d7dp4\" (UID: \"561c33c4-fcf6-4317-9324-b7fc8e196b17\") " pod="openshift-ingress/kube-auth-proxy-5bdc88f569-d7dp4"
Jul 07 17:59:28.072466 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:28.072400    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkq66\" (UniqueName: \"kubernetes.io/projected/561c33c4-fcf6-4317-9324-b7fc8e196b17-kube-api-access-gkq66\") pod \"kube-auth-proxy-5bdc88f569-d7dp4\" (UID: \"561c33c4-fcf6-4317-9324-b7fc8e196b17\") " pod="openshift-ingress/kube-auth-proxy-5bdc88f569-d7dp4"
Jul 07 17:59:28.173201 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:28.173110    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/561c33c4-fcf6-4317-9324-b7fc8e196b17-tls-certs\") pod \"kube-auth-proxy-5bdc88f569-d7dp4\" (UID: \"561c33c4-fcf6-4317-9324-b7fc8e196b17\") " pod="openshift-ingress/kube-auth-proxy-5bdc88f569-d7dp4"
Jul 07 17:59:28.173201 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:28.173151    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkq66\" (UniqueName: \"kubernetes.io/projected/561c33c4-fcf6-4317-9324-b7fc8e196b17-kube-api-access-gkq66\") pod \"kube-auth-proxy-5bdc88f569-d7dp4\" (UID: \"561c33c4-fcf6-4317-9324-b7fc8e196b17\") " pod="openshift-ingress/kube-auth-proxy-5bdc88f569-d7dp4"
Jul 07 17:59:28.173201 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:28.173176    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/561c33c4-fcf6-4317-9324-b7fc8e196b17-tmp\") pod \"kube-auth-proxy-5bdc88f569-d7dp4\" (UID: \"561c33c4-fcf6-4317-9324-b7fc8e196b17\") " pod="openshift-ingress/kube-auth-proxy-5bdc88f569-d7dp4"
Jul 07 17:59:28.173465 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:59:28.173290    2566 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 07 17:59:28.173465 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:59:28.173378    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/561c33c4-fcf6-4317-9324-b7fc8e196b17-tls-certs podName:561c33c4-fcf6-4317-9324-b7fc8e196b17 nodeName:}" failed. No retries permitted until 2026-07-07 17:59:28.673352859 +0000 UTC m=+359.430913708 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/561c33c4-fcf6-4317-9324-b7fc8e196b17-tls-certs") pod "kube-auth-proxy-5bdc88f569-d7dp4" (UID: "561c33c4-fcf6-4317-9324-b7fc8e196b17") : secret "kube-auth-proxy-tls" not found
Jul 07 17:59:28.175605 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:28.175581    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/561c33c4-fcf6-4317-9324-b7fc8e196b17-tmp\") pod \"kube-auth-proxy-5bdc88f569-d7dp4\" (UID: \"561c33c4-fcf6-4317-9324-b7fc8e196b17\") " pod="openshift-ingress/kube-auth-proxy-5bdc88f569-d7dp4"
Jul 07 17:59:28.208461 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:28.208432    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkq66\" (UniqueName: \"kubernetes.io/projected/561c33c4-fcf6-4317-9324-b7fc8e196b17-kube-api-access-gkq66\") pod \"kube-auth-proxy-5bdc88f569-d7dp4\" (UID: \"561c33c4-fcf6-4317-9324-b7fc8e196b17\") " pod="openshift-ingress/kube-auth-proxy-5bdc88f569-d7dp4"
Jul 07 17:59:28.212108 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:28.212078    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9f9gs"]
Jul 07 17:59:28.215016 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:28.214994    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9f9gs"
Jul 07 17:59:28.219409 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:28.219390    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 07 17:59:28.222590 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:28.222571    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-6bm5q\""
Jul 07 17:59:28.234572 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:28.234544    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9f9gs"]
Jul 07 17:59:28.374605 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:28.374570    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk5p6\" (UniqueName: \"kubernetes.io/projected/e79f47de-5ed8-43ea-a814-96da6d4d3181-kube-api-access-sk5p6\") pod \"odh-model-controller-7998c67dc4-9f9gs\" (UID: \"e79f47de-5ed8-43ea-a814-96da6d4d3181\") " pod="opendatahub/odh-model-controller-7998c67dc4-9f9gs"
Jul 07 17:59:28.374814 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:28.374661    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e79f47de-5ed8-43ea-a814-96da6d4d3181-cert\") pod \"odh-model-controller-7998c67dc4-9f9gs\" (UID: \"e79f47de-5ed8-43ea-a814-96da6d4d3181\") " pod="opendatahub/odh-model-controller-7998c67dc4-9f9gs"
Jul 07 17:59:28.475954 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:28.475913    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e79f47de-5ed8-43ea-a814-96da6d4d3181-cert\") pod \"odh-model-controller-7998c67dc4-9f9gs\" (UID: \"e79f47de-5ed8-43ea-a814-96da6d4d3181\") " pod="opendatahub/odh-model-controller-7998c67dc4-9f9gs"
Jul 07 17:59:28.476138 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:28.475987    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk5p6\" (UniqueName: \"kubernetes.io/projected/e79f47de-5ed8-43ea-a814-96da6d4d3181-kube-api-access-sk5p6\") pod \"odh-model-controller-7998c67dc4-9f9gs\" (UID: \"e79f47de-5ed8-43ea-a814-96da6d4d3181\") " pod="opendatahub/odh-model-controller-7998c67dc4-9f9gs"
Jul 07 17:59:28.478533 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:28.478511    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e79f47de-5ed8-43ea-a814-96da6d4d3181-cert\") pod \"odh-model-controller-7998c67dc4-9f9gs\" (UID: \"e79f47de-5ed8-43ea-a814-96da6d4d3181\") " pod="opendatahub/odh-model-controller-7998c67dc4-9f9gs"
Jul 07 17:59:28.493925 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:28.493889    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk5p6\" (UniqueName: \"kubernetes.io/projected/e79f47de-5ed8-43ea-a814-96da6d4d3181-kube-api-access-sk5p6\") pod \"odh-model-controller-7998c67dc4-9f9gs\" (UID: \"e79f47de-5ed8-43ea-a814-96da6d4d3181\") " pod="opendatahub/odh-model-controller-7998c67dc4-9f9gs"
Jul 07 17:59:28.524725 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:28.524685    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9f9gs"
Jul 07 17:59:28.666577 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:28.666549    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9f9gs"]
Jul 07 17:59:28.669144 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:59:28.669111    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode79f47de_5ed8_43ea_a814_96da6d4d3181.slice/crio-1e56c9ecd75fac08353348270c5416c202288f8d69ea49aac1f3f095a3adc917 WatchSource:0}: Error finding container 1e56c9ecd75fac08353348270c5416c202288f8d69ea49aac1f3f095a3adc917: Status 404 returned error can't find the container with id 1e56c9ecd75fac08353348270c5416c202288f8d69ea49aac1f3f095a3adc917
Jul 07 17:59:28.678192 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:28.678162    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/561c33c4-fcf6-4317-9324-b7fc8e196b17-tls-certs\") pod \"kube-auth-proxy-5bdc88f569-d7dp4\" (UID: \"561c33c4-fcf6-4317-9324-b7fc8e196b17\") " pod="openshift-ingress/kube-auth-proxy-5bdc88f569-d7dp4"
Jul 07 17:59:28.678326 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:59:28.678277    2566 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 07 17:59:28.678368 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:59:28.678339    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/561c33c4-fcf6-4317-9324-b7fc8e196b17-tls-certs podName:561c33c4-fcf6-4317-9324-b7fc8e196b17 nodeName:}" failed. No retries permitted until 2026-07-07 17:59:29.678324477 +0000 UTC m=+360.435885325 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/561c33c4-fcf6-4317-9324-b7fc8e196b17-tls-certs") pod "kube-auth-proxy-5bdc88f569-d7dp4" (UID: "561c33c4-fcf6-4317-9324-b7fc8e196b17") : secret "kube-auth-proxy-tls" not found
Jul 07 17:59:29.240279 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.240240    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9f9gs" event={"ID":"e79f47de-5ed8-43ea-a814-96da6d4d3181","Type":"ContainerStarted","Data":"1e56c9ecd75fac08353348270c5416c202288f8d69ea49aac1f3f095a3adc917"}
Jul 07 17:59:29.292666 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.292632    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-btmch"]
Jul 07 17:59:29.296874 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.296850    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-btmch"
Jul 07 17:59:29.299614 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.299595    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 07 17:59:29.311306 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.311281    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-btmch"]
Jul 07 17:59:29.385329 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.385281    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a27f97e-b598-43be-8426-636cffc1f30a-tls-certs\") pod \"model-serving-api-54d89bd5fc-btmch\" (UID: \"3a27f97e-b598-43be-8426-636cffc1f30a\") " pod="opendatahub/model-serving-api-54d89bd5fc-btmch"
Jul 07 17:59:29.385514 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.385346    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtdpx\" (UniqueName: \"kubernetes.io/projected/3a27f97e-b598-43be-8426-636cffc1f30a-kube-api-access-qtdpx\") pod \"model-serving-api-54d89bd5fc-btmch\" (UID: \"3a27f97e-b598-43be-8426-636cffc1f30a\") " pod="opendatahub/model-serving-api-54d89bd5fc-btmch"
Jul 07 17:59:29.486139 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.486099    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a27f97e-b598-43be-8426-636cffc1f30a-tls-certs\") pod \"model-serving-api-54d89bd5fc-btmch\" (UID: \"3a27f97e-b598-43be-8426-636cffc1f30a\") " pod="opendatahub/model-serving-api-54d89bd5fc-btmch"
Jul 07 17:59:29.486334 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.486173    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtdpx\" (UniqueName: \"kubernetes.io/projected/3a27f97e-b598-43be-8426-636cffc1f30a-kube-api-access-qtdpx\") pod \"model-serving-api-54d89bd5fc-btmch\" (UID: \"3a27f97e-b598-43be-8426-636cffc1f30a\") " pod="opendatahub/model-serving-api-54d89bd5fc-btmch"
Jul 07 17:59:29.486708 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:59:29.486682    2566 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 07 17:59:29.486865 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:59:29.486767    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a27f97e-b598-43be-8426-636cffc1f30a-tls-certs podName:3a27f97e-b598-43be-8426-636cffc1f30a nodeName:}" failed. No retries permitted until 2026-07-07 17:59:29.986744987 +0000 UTC m=+360.744305836 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/3a27f97e-b598-43be-8426-636cffc1f30a-tls-certs") pod "model-serving-api-54d89bd5fc-btmch" (UID: "3a27f97e-b598-43be-8426-636cffc1f30a") : secret "model-serving-api-tls" not found
Jul 07 17:59:29.500116 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.500025    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"]
Jul 07 17:59:29.502072 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.502042    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtdpx\" (UniqueName: \"kubernetes.io/projected/3a27f97e-b598-43be-8426-636cffc1f30a-kube-api-access-qtdpx\") pod \"model-serving-api-54d89bd5fc-btmch\" (UID: \"3a27f97e-b598-43be-8426-636cffc1f30a\") " pod="opendatahub/model-serving-api-54d89bd5fc-btmch"
Jul 07 17:59:29.503571 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.503552    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"
Jul 07 17:59:29.506859 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.506813    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 17:59:29.507001 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.506914    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 07 17:59:29.507280 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.507263    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-cw87v\""
Jul 07 17:59:29.507579 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.507556    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 07 17:59:29.513403 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.513379    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 07 17:59:29.521537 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.521499    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"]
Jul 07 17:59:29.587322 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.587284    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86826cde-7867-423c-a5cc-2a7de7e03114-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-pdz2b\" (UID: \"86826cde-7867-423c-a5cc-2a7de7e03114\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"
Jul 07 17:59:29.587497 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.587346    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/86826cde-7867-423c-a5cc-2a7de7e03114-local-certs\") pod \"istiod-openshift-gateway-7574459656-pdz2b\" (UID: \"86826cde-7867-423c-a5cc-2a7de7e03114\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"
Jul 07 17:59:29.587497 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.587411    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/86826cde-7867-423c-a5cc-2a7de7e03114-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-pdz2b\" (UID: \"86826cde-7867-423c-a5cc-2a7de7e03114\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"
Jul 07 17:59:29.587497 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.587442    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/86826cde-7867-423c-a5cc-2a7de7e03114-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-pdz2b\" (UID: \"86826cde-7867-423c-a5cc-2a7de7e03114\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"
Jul 07 17:59:29.587497 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.587474    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/86826cde-7867-423c-a5cc-2a7de7e03114-cacerts\") pod \"istiod-openshift-gateway-7574459656-pdz2b\" (UID: \"86826cde-7867-423c-a5cc-2a7de7e03114\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"
Jul 07 17:59:29.587805 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.587533    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86826cde-7867-423c-a5cc-2a7de7e03114-istio-token\") pod \"istiod-openshift-gateway-7574459656-pdz2b\" (UID: \"86826cde-7867-423c-a5cc-2a7de7e03114\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"
Jul 07 17:59:29.587805 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.587558    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77w68\" (UniqueName: \"kubernetes.io/projected/86826cde-7867-423c-a5cc-2a7de7e03114-kube-api-access-77w68\") pod \"istiod-openshift-gateway-7574459656-pdz2b\" (UID: \"86826cde-7867-423c-a5cc-2a7de7e03114\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"
Jul 07 17:59:29.688695 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.688664    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86826cde-7867-423c-a5cc-2a7de7e03114-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-pdz2b\" (UID: \"86826cde-7867-423c-a5cc-2a7de7e03114\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"
Jul 07 17:59:29.688886 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.688710    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/86826cde-7867-423c-a5cc-2a7de7e03114-local-certs\") pod \"istiod-openshift-gateway-7574459656-pdz2b\" (UID: \"86826cde-7867-423c-a5cc-2a7de7e03114\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"
Jul 07 17:59:29.688886 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.688742    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/86826cde-7867-423c-a5cc-2a7de7e03114-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-pdz2b\" (UID: \"86826cde-7867-423c-a5cc-2a7de7e03114\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"
Jul 07 17:59:29.688886 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.688765    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/86826cde-7867-423c-a5cc-2a7de7e03114-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-pdz2b\" (UID: \"86826cde-7867-423c-a5cc-2a7de7e03114\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"
Jul 07 17:59:29.688886 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.688790    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/86826cde-7867-423c-a5cc-2a7de7e03114-cacerts\") pod \"istiod-openshift-gateway-7574459656-pdz2b\" (UID: \"86826cde-7867-423c-a5cc-2a7de7e03114\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"
Jul 07 17:59:29.688886 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.688845    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/561c33c4-fcf6-4317-9324-b7fc8e196b17-tls-certs\") pod \"kube-auth-proxy-5bdc88f569-d7dp4\" (UID: \"561c33c4-fcf6-4317-9324-b7fc8e196b17\") " pod="openshift-ingress/kube-auth-proxy-5bdc88f569-d7dp4"
Jul 07 17:59:29.688886 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.688870    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86826cde-7867-423c-a5cc-2a7de7e03114-istio-token\") pod \"istiod-openshift-gateway-7574459656-pdz2b\" (UID: \"86826cde-7867-423c-a5cc-2a7de7e03114\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"
Jul 07 17:59:29.689190 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.688893    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77w68\" (UniqueName: \"kubernetes.io/projected/86826cde-7867-423c-a5cc-2a7de7e03114-kube-api-access-77w68\") pod \"istiod-openshift-gateway-7574459656-pdz2b\" (UID: \"86826cde-7867-423c-a5cc-2a7de7e03114\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"
Jul 07 17:59:29.691891 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.691865    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 07 17:59:29.692110 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.691865    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 07 17:59:29.692189 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.692150    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 07 17:59:29.692189 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.692179    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/561c33c4-fcf6-4317-9324-b7fc8e196b17-tls-certs\") pod \"kube-auth-proxy-5bdc88f569-d7dp4\" (UID: \"561c33c4-fcf6-4317-9324-b7fc8e196b17\") " pod="openshift-ingress/kube-auth-proxy-5bdc88f569-d7dp4"
Jul 07 17:59:29.692294 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.692001    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/86826cde-7867-423c-a5cc-2a7de7e03114-local-certs\") pod \"istiod-openshift-gateway-7574459656-pdz2b\" (UID: \"86826cde-7867-423c-a5cc-2a7de7e03114\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"
Jul 07 17:59:29.692294 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.691936    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 17:59:29.699945 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.699913    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86826cde-7867-423c-a5cc-2a7de7e03114-istio-token\") pod \"istiod-openshift-gateway-7574459656-pdz2b\" (UID: \"86826cde-7867-423c-a5cc-2a7de7e03114\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"
Jul 07 17:59:29.700094 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.700040    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77w68\" (UniqueName: \"kubernetes.io/projected/86826cde-7867-423c-a5cc-2a7de7e03114-kube-api-access-77w68\") pod \"istiod-openshift-gateway-7574459656-pdz2b\" (UID: \"86826cde-7867-423c-a5cc-2a7de7e03114\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"
Jul 07 17:59:29.701770 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.701742    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/86826cde-7867-423c-a5cc-2a7de7e03114-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-pdz2b\" (UID: \"86826cde-7867-423c-a5cc-2a7de7e03114\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"
Jul 07 17:59:29.702983 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.702957    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/86826cde-7867-423c-a5cc-2a7de7e03114-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-pdz2b\" (UID: \"86826cde-7867-423c-a5cc-2a7de7e03114\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"
Jul 07 17:59:29.703966 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.703944    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/86826cde-7867-423c-a5cc-2a7de7e03114-cacerts\") pod \"istiod-openshift-gateway-7574459656-pdz2b\" (UID: \"86826cde-7867-423c-a5cc-2a7de7e03114\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"
Jul 07 17:59:29.704075 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.703649    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86826cde-7867-423c-a5cc-2a7de7e03114-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-pdz2b\" (UID: \"86826cde-7867-423c-a5cc-2a7de7e03114\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"
Jul 07 17:59:29.725070 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.724817    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5bdc88f569-d7dp4"
Jul 07 17:59:29.822591 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.822563    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-cw87v\""
Jul 07 17:59:29.830403 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.830372    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"
Jul 07 17:59:29.914098 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.914016    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5bdc88f569-d7dp4"]
Jul 07 17:59:29.917772 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:59:29.917724    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod561c33c4_fcf6_4317_9324_b7fc8e196b17.slice/crio-9ba9a4534b0f8b760d79481f8f6206aabbeeca7ae328f6d8904aa16341374896 WatchSource:0}: Error finding container 9ba9a4534b0f8b760d79481f8f6206aabbeeca7ae328f6d8904aa16341374896: Status 404 returned error can't find the container with id 9ba9a4534b0f8b760d79481f8f6206aabbeeca7ae328f6d8904aa16341374896
Jul 07 17:59:29.991719 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.991679    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a27f97e-b598-43be-8426-636cffc1f30a-tls-certs\") pod \"model-serving-api-54d89bd5fc-btmch\" (UID: \"3a27f97e-b598-43be-8426-636cffc1f30a\") " pod="opendatahub/model-serving-api-54d89bd5fc-btmch"
Jul 07 17:59:29.994867 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:29.994817    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a27f97e-b598-43be-8426-636cffc1f30a-tls-certs\") pod \"model-serving-api-54d89bd5fc-btmch\" (UID: \"3a27f97e-b598-43be-8426-636cffc1f30a\") " pod="opendatahub/model-serving-api-54d89bd5fc-btmch"
Jul 07 17:59:30.017394 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:30.017363    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"]
Jul 07 17:59:30.018932 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:59:30.018899    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86826cde_7867_423c_a5cc_2a7de7e03114.slice/crio-5f79dbf49d3c381ed86db3d17dbd04fde45f31b72deb1761a04a6fbd8ae7d755 WatchSource:0}: Error finding container 5f79dbf49d3c381ed86db3d17dbd04fde45f31b72deb1761a04a6fbd8ae7d755: Status 404 returned error can't find the container with id 5f79dbf49d3c381ed86db3d17dbd04fde45f31b72deb1761a04a6fbd8ae7d755
Jul 07 17:59:30.207112 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:30.207023    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-btmch"
Jul 07 17:59:30.247292 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:30.247245    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b" event={"ID":"86826cde-7867-423c-a5cc-2a7de7e03114","Type":"ContainerStarted","Data":"5f79dbf49d3c381ed86db3d17dbd04fde45f31b72deb1761a04a6fbd8ae7d755"}
Jul 07 17:59:30.248885 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:30.248846    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5bdc88f569-d7dp4" event={"ID":"561c33c4-fcf6-4317-9324-b7fc8e196b17","Type":"ContainerStarted","Data":"9ba9a4534b0f8b760d79481f8f6206aabbeeca7ae328f6d8904aa16341374896"}
Jul 07 17:59:31.031626 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:31.031545    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-btmch"]
Jul 07 17:59:31.035036 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:59:31.035000    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a27f97e_b598_43be_8426_636cffc1f30a.slice/crio-97929673aeb4117bf4a1e11e82b22aa161346457ca63fc4f739d48b3e958343c WatchSource:0}: Error finding container 97929673aeb4117bf4a1e11e82b22aa161346457ca63fc4f739d48b3e958343c: Status 404 returned error can't find the container with id 97929673aeb4117bf4a1e11e82b22aa161346457ca63fc4f739d48b3e958343c
Jul 07 17:59:31.257338 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:31.257298    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-btmch" event={"ID":"3a27f97e-b598-43be-8426-636cffc1f30a","Type":"ContainerStarted","Data":"97929673aeb4117bf4a1e11e82b22aa161346457ca63fc4f739d48b3e958343c"}
Jul 07 17:59:33.805917 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:33.805866    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 17:59:33.806276 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:33.805953    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 17:59:33.815903 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:33.815873    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 17:59:34.274954 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:34.274911    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9f9gs" event={"ID":"e79f47de-5ed8-43ea-a814-96da6d4d3181","Type":"ContainerStarted","Data":"b21882aa0c754809fc87b73cc2097285b4fdb7ed6ac6931d9dd0fa479c00f3da"}
Jul 07 17:59:34.275152 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:34.275026    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-9f9gs"
Jul 07 17:59:34.276846 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:34.276772    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b" event={"ID":"86826cde-7867-423c-a5cc-2a7de7e03114","Type":"ContainerStarted","Data":"6a6c92e0a9b11c1df7c35f98ca004939942e0917ec99146e3dd7f5a7e542a395"}
Jul 07 17:59:34.277006 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:34.276851    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"
Jul 07 17:59:34.278727 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:34.278700    2566 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-pdz2b container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 17:59:34.278876 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:34.278722    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5bdc88f569-d7dp4" event={"ID":"561c33c4-fcf6-4317-9324-b7fc8e196b17","Type":"ContainerStarted","Data":"60c2ad9851bf050857cd65d1f821e84c2fd6beb958b62d25c659cb5df04b7a5d"}
Jul 07 17:59:34.278876 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:34.278753    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b" podUID="86826cde-7867-423c-a5cc-2a7de7e03114" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 17:59:34.297018 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:34.296929    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-9f9gs" podStartSLOduration=1.164905376 podStartE2EDuration="6.296909889s" totalImagesPullingTime="5.132004513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:59:34.295807375 +0000 UTC m=+365.053368259" watchObservedRunningTime="2026-07-07 17:59:34.296909889 +0000 UTC m=+365.054470764"
Jul 07 17:59:34.320040 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:34.319976    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5bdc88f569-d7dp4" podStartSLOduration=3.42739809 podStartE2EDuration="7.319961048s" totalImagesPullingTime="3.892562958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:59:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:59:34.318601847 +0000 UTC m=+365.076162735" watchObservedRunningTime="2026-07-07 17:59:34.319961048 +0000 UTC m=+365.077521928"
Jul 07 17:59:34.349745 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:34.349680    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b" podStartSLOduration=1.5657642250000001 podStartE2EDuration="5.349656637s" totalImagesPullingTime="3.783892412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:59:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:59:34.347158114 +0000 UTC m=+365.104719018" watchObservedRunningTime="2026-07-07 17:59:34.349656637 +0000 UTC m=+365.107217509"
Jul 07 17:59:35.285337 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:35.285286    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-btmch" event={"ID":"3a27f97e-b598-43be-8426-636cffc1f30a","Type":"ContainerStarted","Data":"ad0f80584130b46fc56554566076d1ce2491de361c25ccd2c3b07dbf2529b7f2"}
Jul 07 17:59:35.286375 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:35.286348    2566 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-pdz2b container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 17:59:35.286703 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:35.286398    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b" podUID="86826cde-7867-423c-a5cc-2a7de7e03114" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 17:59:35.307648 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:35.307584    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-btmch" podStartSLOduration=2.771829913 podStartE2EDuration="6.30756834s" totalImagesPullingTime="3.535738427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:59:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:59:35.305476991 +0000 UTC m=+366.063037861" watchObservedRunningTime="2026-07-07 17:59:35.30756834 +0000 UTC m=+366.065129255"
Jul 07 17:59:36.290279 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:36.290250    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-btmch"
Jul 07 17:59:37.657723 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:37.657686    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-694995b85-hms5c"]
Jul 07 17:59:37.664661 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:37.664632    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-694995b85-hms5c"
Jul 07 17:59:37.669110 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:37.669071    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 07 17:59:37.669110 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:37.669096    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:59:37.669110 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:37.669113    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 17:59:37.669403 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:37.669177    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 07 17:59:37.669403 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:37.669069    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 07 17:59:37.669403 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:37.669377    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-n68jh\""
Jul 07 17:59:37.672809 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:37.672786    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-694995b85-hms5c"]
Jul 07 17:59:37.764282 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:37.764241    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpl2k\" (UniqueName: \"kubernetes.io/projected/3e2412a1-99a3-4da9-8bb3-794f93bf1e48-kube-api-access-rpl2k\") pod \"lws-controller-manager-694995b85-hms5c\" (UID: \"3e2412a1-99a3-4da9-8bb3-794f93bf1e48\") " pod="openshift-lws-operator/lws-controller-manager-694995b85-hms5c"
Jul 07 17:59:37.764282 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:37.764284    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3e2412a1-99a3-4da9-8bb3-794f93bf1e48-manager-config\") pod \"lws-controller-manager-694995b85-hms5c\" (UID: \"3e2412a1-99a3-4da9-8bb3-794f93bf1e48\") " pod="openshift-lws-operator/lws-controller-manager-694995b85-hms5c"
Jul 07 17:59:37.764500 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:37.764309    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e2412a1-99a3-4da9-8bb3-794f93bf1e48-metrics-cert\") pod \"lws-controller-manager-694995b85-hms5c\" (UID: \"3e2412a1-99a3-4da9-8bb3-794f93bf1e48\") " pod="openshift-lws-operator/lws-controller-manager-694995b85-hms5c"
Jul 07 17:59:37.764500 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:37.764437    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e2412a1-99a3-4da9-8bb3-794f93bf1e48-cert\") pod \"lws-controller-manager-694995b85-hms5c\" (UID: \"3e2412a1-99a3-4da9-8bb3-794f93bf1e48\") " pod="openshift-lws-operator/lws-controller-manager-694995b85-hms5c"
Jul 07 17:59:37.865803 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:37.865766    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e2412a1-99a3-4da9-8bb3-794f93bf1e48-cert\") pod \"lws-controller-manager-694995b85-hms5c\" (UID: \"3e2412a1-99a3-4da9-8bb3-794f93bf1e48\") " pod="openshift-lws-operator/lws-controller-manager-694995b85-hms5c"
Jul 07 17:59:37.865966 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:37.865807    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpl2k\" (UniqueName: \"kubernetes.io/projected/3e2412a1-99a3-4da9-8bb3-794f93bf1e48-kube-api-access-rpl2k\") pod \"lws-controller-manager-694995b85-hms5c\" (UID: \"3e2412a1-99a3-4da9-8bb3-794f93bf1e48\") " pod="openshift-lws-operator/lws-controller-manager-694995b85-hms5c"
Jul 07 17:59:37.865966 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:37.865950    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3e2412a1-99a3-4da9-8bb3-794f93bf1e48-manager-config\") pod \"lws-controller-manager-694995b85-hms5c\" (UID: \"3e2412a1-99a3-4da9-8bb3-794f93bf1e48\") " pod="openshift-lws-operator/lws-controller-manager-694995b85-hms5c"
Jul 07 17:59:37.866104 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:37.865991    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e2412a1-99a3-4da9-8bb3-794f93bf1e48-metrics-cert\") pod \"lws-controller-manager-694995b85-hms5c\" (UID: \"3e2412a1-99a3-4da9-8bb3-794f93bf1e48\") " pod="openshift-lws-operator/lws-controller-manager-694995b85-hms5c"
Jul 07 17:59:37.866602 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:37.866580    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3e2412a1-99a3-4da9-8bb3-794f93bf1e48-manager-config\") pod \"lws-controller-manager-694995b85-hms5c\" (UID: \"3e2412a1-99a3-4da9-8bb3-794f93bf1e48\") " pod="openshift-lws-operator/lws-controller-manager-694995b85-hms5c"
Jul 07 17:59:37.868547 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:37.868522    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e2412a1-99a3-4da9-8bb3-794f93bf1e48-cert\") pod \"lws-controller-manager-694995b85-hms5c\" (UID: \"3e2412a1-99a3-4da9-8bb3-794f93bf1e48\") " pod="openshift-lws-operator/lws-controller-manager-694995b85-hms5c"
Jul 07 17:59:37.868547 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:37.868540    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e2412a1-99a3-4da9-8bb3-794f93bf1e48-metrics-cert\") pod \"lws-controller-manager-694995b85-hms5c\" (UID: \"3e2412a1-99a3-4da9-8bb3-794f93bf1e48\") " pod="openshift-lws-operator/lws-controller-manager-694995b85-hms5c"
Jul 07 17:59:37.904395 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:37.904361    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpl2k\" (UniqueName: \"kubernetes.io/projected/3e2412a1-99a3-4da9-8bb3-794f93bf1e48-kube-api-access-rpl2k\") pod \"lws-controller-manager-694995b85-hms5c\" (UID: \"3e2412a1-99a3-4da9-8bb3-794f93bf1e48\") " pod="openshift-lws-operator/lws-controller-manager-694995b85-hms5c"
Jul 07 17:59:37.974403 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:37.974368    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-694995b85-hms5c"
Jul 07 17:59:38.118663 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:38.118618    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-694995b85-hms5c"]
Jul 07 17:59:38.121194 ip-10-0-128-53 kubenswrapper[2566]: W0707 17:59:38.121166    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e2412a1_99a3_4da9_8bb3_794f93bf1e48.slice/crio-642be0bbf2332fba424af613fc4228aa03c9471689d379f73f9ab226f4db0670 WatchSource:0}: Error finding container 642be0bbf2332fba424af613fc4228aa03c9471689d379f73f9ab226f4db0670: Status 404 returned error can't find the container with id 642be0bbf2332fba424af613fc4228aa03c9471689d379f73f9ab226f4db0670
Jul 07 17:59:38.286280 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:38.286199    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"
Jul 07 17:59:38.304207 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:38.304176    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-694995b85-hms5c" event={"ID":"3e2412a1-99a3-4da9-8bb3-794f93bf1e48","Type":"ContainerStarted","Data":"642be0bbf2332fba424af613fc4228aa03c9471689d379f73f9ab226f4db0670"}
Jul 07 17:59:40.315056 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:40.315017    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-694995b85-hms5c" event={"ID":"3e2412a1-99a3-4da9-8bb3-794f93bf1e48","Type":"ContainerStarted","Data":"aac0c84c2e1b20496b3cc77021cd4b8030e6311a39ce0c6ef2a2d686522ee3aa"}
Jul 07 17:59:40.315492 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:40.315114    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-694995b85-hms5c"
Jul 07 17:59:40.363261 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:40.363201    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-694995b85-hms5c" podStartSLOduration=1.735564542 podStartE2EDuration="3.363182128s" totalImagesPullingTime="1.627617586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:59:40.361952885 +0000 UTC m=+371.119513774" watchObservedRunningTime="2026-07-07 17:59:40.363182128 +0000 UTC m=+371.120743068"
Jul 07 17:59:43.423529 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:43.423492    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"]
Jul 07 17:59:43.423922 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:43.423675    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b" podUID="86826cde-7867-423c-a5cc-2a7de7e03114" containerName="discovery" containerID="cri-o://6a6c92e0a9b11c1df7c35f98ca004939942e0917ec99146e3dd7f5a7e542a395" gracePeriod=30
Jul 07 17:59:43.675553 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:43.675485    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"
Jul 07 17:59:43.712255 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:43.712157    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/86826cde-7867-423c-a5cc-2a7de7e03114-cacerts\") pod \"86826cde-7867-423c-a5cc-2a7de7e03114\" (UID: \"86826cde-7867-423c-a5cc-2a7de7e03114\") "
Jul 07 17:59:43.712255 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:43.712225    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77w68\" (UniqueName: \"kubernetes.io/projected/86826cde-7867-423c-a5cc-2a7de7e03114-kube-api-access-77w68\") pod \"86826cde-7867-423c-a5cc-2a7de7e03114\" (UID: \"86826cde-7867-423c-a5cc-2a7de7e03114\") "
Jul 07 17:59:43.712548 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:43.712293    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/86826cde-7867-423c-a5cc-2a7de7e03114-local-certs\") pod \"86826cde-7867-423c-a5cc-2a7de7e03114\" (UID: \"86826cde-7867-423c-a5cc-2a7de7e03114\") "
Jul 07 17:59:43.712548 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:43.712320    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86826cde-7867-423c-a5cc-2a7de7e03114-istio-kubeconfig\") pod \"86826cde-7867-423c-a5cc-2a7de7e03114\" (UID: \"86826cde-7867-423c-a5cc-2a7de7e03114\") "
Jul 07 17:59:43.712548 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:43.712347    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/86826cde-7867-423c-a5cc-2a7de7e03114-istio-csr-dns-cert\") pod \"86826cde-7867-423c-a5cc-2a7de7e03114\" (UID: \"86826cde-7867-423c-a5cc-2a7de7e03114\") "
Jul 07 17:59:43.712548 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:43.712376    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/86826cde-7867-423c-a5cc-2a7de7e03114-istio-csr-ca-configmap\") pod \"86826cde-7867-423c-a5cc-2a7de7e03114\" (UID: \"86826cde-7867-423c-a5cc-2a7de7e03114\") "
Jul 07 17:59:43.712548 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:43.712400    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86826cde-7867-423c-a5cc-2a7de7e03114-istio-token\") pod \"86826cde-7867-423c-a5cc-2a7de7e03114\" (UID: \"86826cde-7867-423c-a5cc-2a7de7e03114\") "
Jul 07 17:59:43.713364 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:43.713294    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86826cde-7867-423c-a5cc-2a7de7e03114-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "86826cde-7867-423c-a5cc-2a7de7e03114" (UID: "86826cde-7867-423c-a5cc-2a7de7e03114"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:59:43.715313 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:43.715258    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86826cde-7867-423c-a5cc-2a7de7e03114-cacerts" (OuterVolumeSpecName: "cacerts") pod "86826cde-7867-423c-a5cc-2a7de7e03114" (UID: "86826cde-7867-423c-a5cc-2a7de7e03114"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:59:43.715926 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:43.715786    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86826cde-7867-423c-a5cc-2a7de7e03114-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "86826cde-7867-423c-a5cc-2a7de7e03114" (UID: "86826cde-7867-423c-a5cc-2a7de7e03114"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:59:43.715926 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:43.715901    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86826cde-7867-423c-a5cc-2a7de7e03114-local-certs" (OuterVolumeSpecName: "local-certs") pod "86826cde-7867-423c-a5cc-2a7de7e03114" (UID: "86826cde-7867-423c-a5cc-2a7de7e03114"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:59:43.716080 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:43.715971    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86826cde-7867-423c-a5cc-2a7de7e03114-istio-token" (OuterVolumeSpecName: "istio-token") pod "86826cde-7867-423c-a5cc-2a7de7e03114" (UID: "86826cde-7867-423c-a5cc-2a7de7e03114"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:59:43.716268 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:43.716245    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86826cde-7867-423c-a5cc-2a7de7e03114-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "86826cde-7867-423c-a5cc-2a7de7e03114" (UID: "86826cde-7867-423c-a5cc-2a7de7e03114"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:59:43.716268 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:43.716250    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86826cde-7867-423c-a5cc-2a7de7e03114-kube-api-access-77w68" (OuterVolumeSpecName: "kube-api-access-77w68") pod "86826cde-7867-423c-a5cc-2a7de7e03114" (UID: "86826cde-7867-423c-a5cc-2a7de7e03114"). InnerVolumeSpecName "kube-api-access-77w68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:59:43.813883 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:43.813853    2566 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/86826cde-7867-423c-a5cc-2a7de7e03114-local-certs\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 17:59:43.813883 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:43.813880    2566 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/86826cde-7867-423c-a5cc-2a7de7e03114-istio-kubeconfig\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 17:59:43.814086 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:43.813893    2566 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/86826cde-7867-423c-a5cc-2a7de7e03114-istio-csr-dns-cert\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 17:59:43.814086 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:43.813907    2566 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/86826cde-7867-423c-a5cc-2a7de7e03114-istio-csr-ca-configmap\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 17:59:43.814086 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:43.813921    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86826cde-7867-423c-a5cc-2a7de7e03114-istio-token\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 17:59:43.814086 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:43.813933    2566 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/86826cde-7867-423c-a5cc-2a7de7e03114-cacerts\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 17:59:43.814086 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:43.813945    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77w68\" (UniqueName: \"kubernetes.io/projected/86826cde-7867-423c-a5cc-2a7de7e03114-kube-api-access-77w68\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 17:59:44.334090 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:44.334052    2566 generic.go:356] "Generic (PLEG): container finished" podID="86826cde-7867-423c-a5cc-2a7de7e03114" containerID="6a6c92e0a9b11c1df7c35f98ca004939942e0917ec99146e3dd7f5a7e542a395" exitCode=0
Jul 07 17:59:44.334273 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:44.334103    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"
Jul 07 17:59:44.334273 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:44.334140    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b" event={"ID":"86826cde-7867-423c-a5cc-2a7de7e03114","Type":"ContainerDied","Data":"6a6c92e0a9b11c1df7c35f98ca004939942e0917ec99146e3dd7f5a7e542a395"}
Jul 07 17:59:44.334273 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:44.334200    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b" event={"ID":"86826cde-7867-423c-a5cc-2a7de7e03114","Type":"ContainerDied","Data":"5f79dbf49d3c381ed86db3d17dbd04fde45f31b72deb1761a04a6fbd8ae7d755"}
Jul 07 17:59:44.334273 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:44.334227    2566 scope.go:117] "RemoveContainer" containerID="6a6c92e0a9b11c1df7c35f98ca004939942e0917ec99146e3dd7f5a7e542a395"
Jul 07 17:59:44.342680 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:44.342660    2566 scope.go:117] "RemoveContainer" containerID="6a6c92e0a9b11c1df7c35f98ca004939942e0917ec99146e3dd7f5a7e542a395"
Jul 07 17:59:44.343060 ip-10-0-128-53 kubenswrapper[2566]: E0707 17:59:44.343017    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a6c92e0a9b11c1df7c35f98ca004939942e0917ec99146e3dd7f5a7e542a395\": container with ID starting with 6a6c92e0a9b11c1df7c35f98ca004939942e0917ec99146e3dd7f5a7e542a395 not found: ID does not exist" containerID="6a6c92e0a9b11c1df7c35f98ca004939942e0917ec99146e3dd7f5a7e542a395"
Jul 07 17:59:44.343135 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:44.343069    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a6c92e0a9b11c1df7c35f98ca004939942e0917ec99146e3dd7f5a7e542a395"} err="failed to get container status \"6a6c92e0a9b11c1df7c35f98ca004939942e0917ec99146e3dd7f5a7e542a395\": rpc error: code = NotFound desc = could not find container \"6a6c92e0a9b11c1df7c35f98ca004939942e0917ec99146e3dd7f5a7e542a395\": container with ID starting with 6a6c92e0a9b11c1df7c35f98ca004939942e0917ec99146e3dd7f5a7e542a395 not found: ID does not exist"
Jul 07 17:59:44.363254 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:44.363222    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"]
Jul 07 17:59:44.373096 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:44.373056    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pdz2b"]
Jul 07 17:59:45.287686 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:45.287652    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-9f9gs"
Jul 07 17:59:45.800742 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:45.800707    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86826cde-7867-423c-a5cc-2a7de7e03114" path="/var/lib/kubelet/pods/86826cde-7867-423c-a5cc-2a7de7e03114/volumes"
Jul 07 17:59:47.302955 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:47.302928    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-btmch"
Jul 07 17:59:51.321850 ip-10-0-128-53 kubenswrapper[2566]: I0707 17:59:51.321795    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-694995b85-hms5c"
Jul 07 18:00:45.746344 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:45.746311    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl"]
Jul 07 18:00:45.746770 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:45.746582    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86826cde-7867-423c-a5cc-2a7de7e03114" containerName="discovery"
Jul 07 18:00:45.746770 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:45.746593    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="86826cde-7867-423c-a5cc-2a7de7e03114" containerName="discovery"
Jul 07 18:00:45.746770 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:45.746653    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="86826cde-7867-423c-a5cc-2a7de7e03114" containerName="discovery"
Jul 07 18:00:45.750906 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:45.750888    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl"
Jul 07 18:00:45.755165 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:45.755141    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bfxpp\""
Jul 07 18:00:45.755805 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:45.755780    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 18:00:45.756694 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:45.756674    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 18:00:45.843695 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:45.843657    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl"]
Jul 07 18:00:45.903147 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:45.903110    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl\" (UID: \"e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl"
Jul 07 18:00:45.903330 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:45.903181    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl\" (UID: \"e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl"
Jul 07 18:00:45.903330 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:45.903205    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w5kw\" (UniqueName: \"kubernetes.io/projected/e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf-kube-api-access-4w5kw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl\" (UID: \"e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl"
Jul 07 18:00:46.004225 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.004139    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl\" (UID: \"e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl"
Jul 07 18:00:46.004225 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.004206    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl\" (UID: \"e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl"
Jul 07 18:00:46.004398 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.004235    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w5kw\" (UniqueName: \"kubernetes.io/projected/e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf-kube-api-access-4w5kw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl\" (UID: \"e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl"
Jul 07 18:00:46.004579 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.004556    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl\" (UID: \"e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl"
Jul 07 18:00:46.004615 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.004579    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl\" (UID: \"e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl"
Jul 07 18:00:46.015070 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.015036    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w5kw\" (UniqueName: \"kubernetes.io/projected/e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf-kube-api-access-4w5kw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl\" (UID: \"e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl"
Jul 07 18:00:46.059812 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.059775    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl"
Jul 07 18:00:46.180221 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.180189    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm"]
Jul 07 18:00:46.183887 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.183863    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm"
Jul 07 18:00:46.207717 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.207683    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm"]
Jul 07 18:00:46.246529 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.246497    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl"]
Jul 07 18:00:46.249289 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:00:46.249267    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode80f5f2b_a8aa_4eb0_8fd9_5e08a67fadbf.slice/crio-0beccc4a47ec9935ff0090354a977c2d75276b00a6d3a789fedf4548b214c6ec WatchSource:0}: Error finding container 0beccc4a47ec9935ff0090354a977c2d75276b00a6d3a789fedf4548b214c6ec: Status 404 returned error can't find the container with id 0beccc4a47ec9935ff0090354a977c2d75276b00a6d3a789fedf4548b214c6ec
Jul 07 18:00:46.306046 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.306018    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b794b63e-9f2c-4094-a758-40914a1dfbb5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm\" (UID: \"b794b63e-9f2c-4094-a758-40914a1dfbb5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm"
Jul 07 18:00:46.306134 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.306064    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b794b63e-9f2c-4094-a758-40914a1dfbb5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm\" (UID: \"b794b63e-9f2c-4094-a758-40914a1dfbb5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm"
Jul 07 18:00:46.306134 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.306119    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv97k\" (UniqueName: \"kubernetes.io/projected/b794b63e-9f2c-4094-a758-40914a1dfbb5-kube-api-access-lv97k\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm\" (UID: \"b794b63e-9f2c-4094-a758-40914a1dfbb5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm"
Jul 07 18:00:46.406785 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.406751    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b794b63e-9f2c-4094-a758-40914a1dfbb5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm\" (UID: \"b794b63e-9f2c-4094-a758-40914a1dfbb5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm"
Jul 07 18:00:46.406785 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.406793    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv97k\" (UniqueName: \"kubernetes.io/projected/b794b63e-9f2c-4094-a758-40914a1dfbb5-kube-api-access-lv97k\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm\" (UID: \"b794b63e-9f2c-4094-a758-40914a1dfbb5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm"
Jul 07 18:00:46.407069 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.406875    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b794b63e-9f2c-4094-a758-40914a1dfbb5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm\" (UID: \"b794b63e-9f2c-4094-a758-40914a1dfbb5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm"
Jul 07 18:00:46.407226 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.407203    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b794b63e-9f2c-4094-a758-40914a1dfbb5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm\" (UID: \"b794b63e-9f2c-4094-a758-40914a1dfbb5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm"
Jul 07 18:00:46.407294 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.407214    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b794b63e-9f2c-4094-a758-40914a1dfbb5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm\" (UID: \"b794b63e-9f2c-4094-a758-40914a1dfbb5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm"
Jul 07 18:00:46.428161 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.428132    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv97k\" (UniqueName: \"kubernetes.io/projected/b794b63e-9f2c-4094-a758-40914a1dfbb5-kube-api-access-lv97k\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm\" (UID: \"b794b63e-9f2c-4094-a758-40914a1dfbb5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm"
Jul 07 18:00:46.494200 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.494174    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm"
Jul 07 18:00:46.555455 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.555424    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp"]
Jul 07 18:00:46.559051 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.559027    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp"
Jul 07 18:00:46.589883 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.589855    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp"]
Jul 07 18:00:46.615512 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.615479    2566 generic.go:356] "Generic (PLEG): container finished" podID="e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf" containerID="5248a736419d4dcf1a78c933e7976f51e8d6fe4f62778fc1d61d57e315b46df0" exitCode=0
Jul 07 18:00:46.615668 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.615553    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl" event={"ID":"e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf","Type":"ContainerDied","Data":"5248a736419d4dcf1a78c933e7976f51e8d6fe4f62778fc1d61d57e315b46df0"}
Jul 07 18:00:46.615668 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.615601    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl" event={"ID":"e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf","Type":"ContainerStarted","Data":"0beccc4a47ec9935ff0090354a977c2d75276b00a6d3a789fedf4548b214c6ec"}
Jul 07 18:00:46.648936 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.648894    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm"]
Jul 07 18:00:46.651537 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:00:46.651497    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb794b63e_9f2c_4094_a758_40914a1dfbb5.slice/crio-d1a098fceb6abe286822e05b320744d1f912e0b8a1ec921f3ce7602943957d34 WatchSource:0}: Error finding container d1a098fceb6abe286822e05b320744d1f912e0b8a1ec921f3ce7602943957d34: Status 404 returned error can't find the container with id d1a098fceb6abe286822e05b320744d1f912e0b8a1ec921f3ce7602943957d34
Jul 07 18:00:46.709541 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.709516    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp\" (UID: \"4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp"
Jul 07 18:00:46.709658 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.709560    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp\" (UID: \"4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp"
Jul 07 18:00:46.709658 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.709645    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5mqr\" (UniqueName: \"kubernetes.io/projected/4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d-kube-api-access-g5mqr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp\" (UID: \"4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp"
Jul 07 18:00:46.810375 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.810282    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp\" (UID: \"4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp"
Jul 07 18:00:46.810375 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.810334    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp\" (UID: \"4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp"
Jul 07 18:00:46.810929 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.810390    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5mqr\" (UniqueName: \"kubernetes.io/projected/4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d-kube-api-access-g5mqr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp\" (UID: \"4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp"
Jul 07 18:00:46.810929 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.810641    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp\" (UID: \"4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp"
Jul 07 18:00:46.810929 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.810716    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp\" (UID: \"4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp"
Jul 07 18:00:46.823532 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.823492    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5mqr\" (UniqueName: \"kubernetes.io/projected/4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d-kube-api-access-g5mqr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp\" (UID: \"4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp"
Jul 07 18:00:46.868148 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.868115    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp"
Jul 07 18:00:46.993724 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.993694    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm"]
Jul 07 18:00:46.998102 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:46.998081    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm"
Jul 07 18:00:47.014860 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:47.014804    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp"]
Jul 07 18:00:47.017210 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:47.017170    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm"]
Jul 07 18:00:47.019574 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:00:47.019528    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a93fe2d_5f3f_45ea_8e8f_edbcc224a98d.slice/crio-6a78e73a3eccf0658cfd858bf29bb98d4868198e1b467e5df6662102df247496 WatchSource:0}: Error finding container 6a78e73a3eccf0658cfd858bf29bb98d4868198e1b467e5df6662102df247496: Status 404 returned error can't find the container with id 6a78e73a3eccf0658cfd858bf29bb98d4868198e1b467e5df6662102df247496
Jul 07 18:00:47.113574 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:47.113529    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d43bcd-7935-40d2-9f42-f11b714d7f31-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm\" (UID: \"09d43bcd-7935-40d2-9f42-f11b714d7f31\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm"
Jul 07 18:00:47.113574 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:47.113579    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d43bcd-7935-40d2-9f42-f11b714d7f31-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm\" (UID: \"09d43bcd-7935-40d2-9f42-f11b714d7f31\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm"
Jul 07 18:00:47.113866 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:47.113662    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qkjp\" (UniqueName: \"kubernetes.io/projected/09d43bcd-7935-40d2-9f42-f11b714d7f31-kube-api-access-2qkjp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm\" (UID: \"09d43bcd-7935-40d2-9f42-f11b714d7f31\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm"
Jul 07 18:00:47.214741 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:47.214704    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d43bcd-7935-40d2-9f42-f11b714d7f31-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm\" (UID: \"09d43bcd-7935-40d2-9f42-f11b714d7f31\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm"
Jul 07 18:00:47.214941 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:47.214764    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qkjp\" (UniqueName: \"kubernetes.io/projected/09d43bcd-7935-40d2-9f42-f11b714d7f31-kube-api-access-2qkjp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm\" (UID: \"09d43bcd-7935-40d2-9f42-f11b714d7f31\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm"
Jul 07 18:00:47.214941 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:47.214806    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d43bcd-7935-40d2-9f42-f11b714d7f31-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm\" (UID: \"09d43bcd-7935-40d2-9f42-f11b714d7f31\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm"
Jul 07 18:00:47.215192 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:47.215169    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d43bcd-7935-40d2-9f42-f11b714d7f31-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm\" (UID: \"09d43bcd-7935-40d2-9f42-f11b714d7f31\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm"
Jul 07 18:00:47.215228 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:47.215178    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d43bcd-7935-40d2-9f42-f11b714d7f31-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm\" (UID: \"09d43bcd-7935-40d2-9f42-f11b714d7f31\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm"
Jul 07 18:00:47.228246 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:47.228216    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qkjp\" (UniqueName: \"kubernetes.io/projected/09d43bcd-7935-40d2-9f42-f11b714d7f31-kube-api-access-2qkjp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm\" (UID: \"09d43bcd-7935-40d2-9f42-f11b714d7f31\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm"
Jul 07 18:00:47.307156 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:47.307126    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm"
Jul 07 18:00:47.486120 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:47.486090    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm"]
Jul 07 18:00:47.489784 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:00:47.489756    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09d43bcd_7935_40d2_9f42_f11b714d7f31.slice/crio-b7fd18f4d08a6fdf743c1946f3ba53a6a03f681bf6398b52d984086aecdee25e WatchSource:0}: Error finding container b7fd18f4d08a6fdf743c1946f3ba53a6a03f681bf6398b52d984086aecdee25e: Status 404 returned error can't find the container with id b7fd18f4d08a6fdf743c1946f3ba53a6a03f681bf6398b52d984086aecdee25e
Jul 07 18:00:47.623080 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:47.623044    2566 generic.go:356] "Generic (PLEG): container finished" podID="e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf" containerID="d7afecc1b2c2973724d227726bf69ead50504c3f6d52e91e15ca852f5ee7e571" exitCode=0
Jul 07 18:00:47.623257 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:47.623127    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl" event={"ID":"e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf","Type":"ContainerDied","Data":"d7afecc1b2c2973724d227726bf69ead50504c3f6d52e91e15ca852f5ee7e571"}
Jul 07 18:00:47.624908 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:47.624886    2566 generic.go:356] "Generic (PLEG): container finished" podID="b794b63e-9f2c-4094-a758-40914a1dfbb5" containerID="ec600c49d999ec5eea4e360502a796990fc5b3fadda627c0b3cf5fa41d0c5708" exitCode=0
Jul 07 18:00:47.625020 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:47.624992    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm" event={"ID":"b794b63e-9f2c-4094-a758-40914a1dfbb5","Type":"ContainerDied","Data":"ec600c49d999ec5eea4e360502a796990fc5b3fadda627c0b3cf5fa41d0c5708"}
Jul 07 18:00:47.625091 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:47.625044    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm" event={"ID":"b794b63e-9f2c-4094-a758-40914a1dfbb5","Type":"ContainerStarted","Data":"d1a098fceb6abe286822e05b320744d1f912e0b8a1ec921f3ce7602943957d34"}
Jul 07 18:00:47.626741 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:47.626714    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm" event={"ID":"09d43bcd-7935-40d2-9f42-f11b714d7f31","Type":"ContainerStarted","Data":"11b80aae5276bf4fa8a5863c3fda8af13764ba73c988a9aac055bba8f334b8f8"}
Jul 07 18:00:47.626851 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:47.626762    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm" event={"ID":"09d43bcd-7935-40d2-9f42-f11b714d7f31","Type":"ContainerStarted","Data":"b7fd18f4d08a6fdf743c1946f3ba53a6a03f681bf6398b52d984086aecdee25e"}
Jul 07 18:00:47.628844 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:47.628341    2566 generic.go:356] "Generic (PLEG): container finished" podID="4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d" containerID="70b0cc4acd20d6250553b1701f8ff5f1f344f67bc3d664173378b5ad425033a5" exitCode=0
Jul 07 18:00:47.628844 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:47.628367    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp" event={"ID":"4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d","Type":"ContainerDied","Data":"70b0cc4acd20d6250553b1701f8ff5f1f344f67bc3d664173378b5ad425033a5"}
Jul 07 18:00:47.628844 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:47.628415    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp" event={"ID":"4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d","Type":"ContainerStarted","Data":"6a78e73a3eccf0658cfd858bf29bb98d4868198e1b467e5df6662102df247496"}
Jul 07 18:00:48.636034 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:48.635997    2566 generic.go:356] "Generic (PLEG): container finished" podID="e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf" containerID="eb19ec0e93c3217db0a1da7123ee43c5650db3f80fd3959de9675f5c3bd32cc6" exitCode=0
Jul 07 18:00:48.636471 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:48.636092    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl" event={"ID":"e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf","Type":"ContainerDied","Data":"eb19ec0e93c3217db0a1da7123ee43c5650db3f80fd3959de9675f5c3bd32cc6"}
Jul 07 18:00:48.637974 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:48.637944    2566 generic.go:356] "Generic (PLEG): container finished" podID="b794b63e-9f2c-4094-a758-40914a1dfbb5" containerID="3017bbc64ea85e43a68244b8f11e70e4061a01318132c6988a55c1ba70cf757e" exitCode=0
Jul 07 18:00:48.638093 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:48.638017    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm" event={"ID":"b794b63e-9f2c-4094-a758-40914a1dfbb5","Type":"ContainerDied","Data":"3017bbc64ea85e43a68244b8f11e70e4061a01318132c6988a55c1ba70cf757e"}
Jul 07 18:00:48.639602 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:48.639578    2566 generic.go:356] "Generic (PLEG): container finished" podID="09d43bcd-7935-40d2-9f42-f11b714d7f31" containerID="11b80aae5276bf4fa8a5863c3fda8af13764ba73c988a9aac055bba8f334b8f8" exitCode=0
Jul 07 18:00:48.639671 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:48.639636    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm" event={"ID":"09d43bcd-7935-40d2-9f42-f11b714d7f31","Type":"ContainerDied","Data":"11b80aae5276bf4fa8a5863c3fda8af13764ba73c988a9aac055bba8f334b8f8"}
Jul 07 18:00:48.641592 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:48.641568    2566 generic.go:356] "Generic (PLEG): container finished" podID="4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d" containerID="21134001453b3833cbfdd73af1d44f87e956d6ca6e1ea5ff1123e1c03c6a5df2" exitCode=0
Jul 07 18:00:48.641666 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:48.641614    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp" event={"ID":"4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d","Type":"ContainerDied","Data":"21134001453b3833cbfdd73af1d44f87e956d6ca6e1ea5ff1123e1c03c6a5df2"}
Jul 07 18:00:49.650812 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:49.650773    2566 generic.go:356] "Generic (PLEG): container finished" podID="4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d" containerID="6ec07c57e39c74eaa7e685671f9d69a9186b5abffa7a5a96e7795156d5677716" exitCode=0
Jul 07 18:00:49.651190 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:49.650858    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp" event={"ID":"4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d","Type":"ContainerDied","Data":"6ec07c57e39c74eaa7e685671f9d69a9186b5abffa7a5a96e7795156d5677716"}
Jul 07 18:00:49.652924 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:49.652901    2566 generic.go:356] "Generic (PLEG): container finished" podID="b794b63e-9f2c-4094-a758-40914a1dfbb5" containerID="08852b3b4226c9fa65088db0d5e0e24a510bc147e3f6f6be4598084f5f1b58b9" exitCode=0
Jul 07 18:00:49.653016 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:49.652983    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm" event={"ID":"b794b63e-9f2c-4094-a758-40914a1dfbb5","Type":"ContainerDied","Data":"08852b3b4226c9fa65088db0d5e0e24a510bc147e3f6f6be4598084f5f1b58b9"}
Jul 07 18:00:49.788042 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:49.788020    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl"
Jul 07 18:00:49.935135 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:49.935041    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf-bundle\") pod \"e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf\" (UID: \"e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf\") "
Jul 07 18:00:49.935135 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:49.935086    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf-util\") pod \"e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf\" (UID: \"e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf\") "
Jul 07 18:00:49.935324 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:49.935151    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4w5kw\" (UniqueName: \"kubernetes.io/projected/e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf-kube-api-access-4w5kw\") pod \"e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf\" (UID: \"e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf\") "
Jul 07 18:00:49.935666 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:49.935635    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf-bundle" (OuterVolumeSpecName: "bundle") pod "e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf" (UID: "e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:00:49.937572 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:49.937549    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf-kube-api-access-4w5kw" (OuterVolumeSpecName: "kube-api-access-4w5kw") pod "e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf" (UID: "e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf"). InnerVolumeSpecName "kube-api-access-4w5kw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:00:49.940262 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:49.940241    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf-util" (OuterVolumeSpecName: "util") pod "e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf" (UID: "e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:00:50.036001 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:50.035967    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf-bundle\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:00:50.036001 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:50.035995    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf-util\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:00:50.036001 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:50.036004    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4w5kw\" (UniqueName: \"kubernetes.io/projected/e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf-kube-api-access-4w5kw\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:00:50.663161 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:50.663074    2566 generic.go:356] "Generic (PLEG): container finished" podID="09d43bcd-7935-40d2-9f42-f11b714d7f31" containerID="fd1d5220a9895981ded0d2ea45b3d3132a275e652d25cfad438b74a8d5d2e58a" exitCode=0
Jul 07 18:00:50.663568 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:50.663163    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm" event={"ID":"09d43bcd-7935-40d2-9f42-f11b714d7f31","Type":"ContainerDied","Data":"fd1d5220a9895981ded0d2ea45b3d3132a275e652d25cfad438b74a8d5d2e58a"}
Jul 07 18:00:50.665364 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:50.665329    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl"
Jul 07 18:00:50.665364 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:50.665335    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl" event={"ID":"e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf","Type":"ContainerDied","Data":"0beccc4a47ec9935ff0090354a977c2d75276b00a6d3a789fedf4548b214c6ec"}
Jul 07 18:00:50.665477 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:50.665374    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0beccc4a47ec9935ff0090354a977c2d75276b00a6d3a789fedf4548b214c6ec"
Jul 07 18:00:50.702786 ip-10-0-128-53 kubenswrapper[2566]: E0707 18:00:50.702544    2566 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode80f5f2b_a8aa_4eb0_8fd9_5e08a67fadbf.slice\": RecentStats: unable to find data in memory cache]"
Jul 07 18:00:50.809447 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:50.809411    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp"
Jul 07 18:00:50.830151 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:50.830126    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm"
Jul 07 18:00:50.842727 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:50.842699    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b794b63e-9f2c-4094-a758-40914a1dfbb5-bundle\") pod \"b794b63e-9f2c-4094-a758-40914a1dfbb5\" (UID: \"b794b63e-9f2c-4094-a758-40914a1dfbb5\") "
Jul 07 18:00:50.842910 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:50.842736    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b794b63e-9f2c-4094-a758-40914a1dfbb5-util\") pod \"b794b63e-9f2c-4094-a758-40914a1dfbb5\" (UID: \"b794b63e-9f2c-4094-a758-40914a1dfbb5\") "
Jul 07 18:00:50.842910 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:50.842789    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5mqr\" (UniqueName: \"kubernetes.io/projected/4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d-kube-api-access-g5mqr\") pod \"4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d\" (UID: \"4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d\") "
Jul 07 18:00:50.842910 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:50.842844    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lv97k\" (UniqueName: \"kubernetes.io/projected/b794b63e-9f2c-4094-a758-40914a1dfbb5-kube-api-access-lv97k\") pod \"b794b63e-9f2c-4094-a758-40914a1dfbb5\" (UID: \"b794b63e-9f2c-4094-a758-40914a1dfbb5\") "
Jul 07 18:00:50.842910 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:50.842869    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d-bundle\") pod \"4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d\" (UID: \"4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d\") "
Jul 07 18:00:50.842910 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:50.842895    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d-util\") pod \"4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d\" (UID: \"4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d\") "
Jul 07 18:00:50.843294 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:50.843243    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b794b63e-9f2c-4094-a758-40914a1dfbb5-bundle" (OuterVolumeSpecName: "bundle") pod "b794b63e-9f2c-4094-a758-40914a1dfbb5" (UID: "b794b63e-9f2c-4094-a758-40914a1dfbb5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:00:50.843966 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:50.843882    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d-bundle" (OuterVolumeSpecName: "bundle") pod "4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d" (UID: "4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:00:50.845673 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:50.845637    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b794b63e-9f2c-4094-a758-40914a1dfbb5-kube-api-access-lv97k" (OuterVolumeSpecName: "kube-api-access-lv97k") pod "b794b63e-9f2c-4094-a758-40914a1dfbb5" (UID: "b794b63e-9f2c-4094-a758-40914a1dfbb5"). InnerVolumeSpecName "kube-api-access-lv97k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:00:50.845807 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:50.845714    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d-kube-api-access-g5mqr" (OuterVolumeSpecName: "kube-api-access-g5mqr") pod "4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d" (UID: "4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d"). InnerVolumeSpecName "kube-api-access-g5mqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:00:50.851775 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:50.851741    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b794b63e-9f2c-4094-a758-40914a1dfbb5-util" (OuterVolumeSpecName: "util") pod "b794b63e-9f2c-4094-a758-40914a1dfbb5" (UID: "b794b63e-9f2c-4094-a758-40914a1dfbb5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:00:50.852195 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:50.852171    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d-util" (OuterVolumeSpecName: "util") pod "4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d" (UID: "4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:00:50.943527 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:50.943439    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b794b63e-9f2c-4094-a758-40914a1dfbb5-bundle\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:00:50.943527 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:50.943468    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b794b63e-9f2c-4094-a758-40914a1dfbb5-util\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:00:50.943527 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:50.943477    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5mqr\" (UniqueName: \"kubernetes.io/projected/4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d-kube-api-access-g5mqr\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:00:50.943527 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:50.943487    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lv97k\" (UniqueName: \"kubernetes.io/projected/b794b63e-9f2c-4094-a758-40914a1dfbb5-kube-api-access-lv97k\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:00:50.943527 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:50.943496    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d-bundle\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:00:50.943527 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:50.943504    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d-util\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:00:51.671475 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:51.671446    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm"
Jul 07 18:00:51.671893 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:51.671488    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm" event={"ID":"b794b63e-9f2c-4094-a758-40914a1dfbb5","Type":"ContainerDied","Data":"d1a098fceb6abe286822e05b320744d1f912e0b8a1ec921f3ce7602943957d34"}
Jul 07 18:00:51.671893 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:51.671535    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1a098fceb6abe286822e05b320744d1f912e0b8a1ec921f3ce7602943957d34"
Jul 07 18:00:51.673598 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:51.673574    2566 generic.go:356] "Generic (PLEG): container finished" podID="09d43bcd-7935-40d2-9f42-f11b714d7f31" containerID="ef643c50f0cf9f390ad13b6eff9506c366c533f803e801acb563d2c090cc8836" exitCode=0
Jul 07 18:00:51.673705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:51.673649    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm" event={"ID":"09d43bcd-7935-40d2-9f42-f11b714d7f31","Type":"ContainerDied","Data":"ef643c50f0cf9f390ad13b6eff9506c366c533f803e801acb563d2c090cc8836"}
Jul 07 18:00:51.675524 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:51.675497    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp" event={"ID":"4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d","Type":"ContainerDied","Data":"6a78e73a3eccf0658cfd858bf29bb98d4868198e1b467e5df6662102df247496"}
Jul 07 18:00:51.675524 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:51.675514    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp"
Jul 07 18:00:51.675641 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:51.675543    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a78e73a3eccf0658cfd858bf29bb98d4868198e1b467e5df6662102df247496"
Jul 07 18:00:52.816096 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:52.816069    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm"
Jul 07 18:00:52.856005 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:52.855974    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d43bcd-7935-40d2-9f42-f11b714d7f31-util\") pod \"09d43bcd-7935-40d2-9f42-f11b714d7f31\" (UID: \"09d43bcd-7935-40d2-9f42-f11b714d7f31\") "
Jul 07 18:00:52.856180 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:52.856032    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qkjp\" (UniqueName: \"kubernetes.io/projected/09d43bcd-7935-40d2-9f42-f11b714d7f31-kube-api-access-2qkjp\") pod \"09d43bcd-7935-40d2-9f42-f11b714d7f31\" (UID: \"09d43bcd-7935-40d2-9f42-f11b714d7f31\") "
Jul 07 18:00:52.856180 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:52.856082    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d43bcd-7935-40d2-9f42-f11b714d7f31-bundle\") pod \"09d43bcd-7935-40d2-9f42-f11b714d7f31\" (UID: \"09d43bcd-7935-40d2-9f42-f11b714d7f31\") "
Jul 07 18:00:52.856665 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:52.856617    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09d43bcd-7935-40d2-9f42-f11b714d7f31-bundle" (OuterVolumeSpecName: "bundle") pod "09d43bcd-7935-40d2-9f42-f11b714d7f31" (UID: "09d43bcd-7935-40d2-9f42-f11b714d7f31"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:00:52.858528 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:52.858499    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09d43bcd-7935-40d2-9f42-f11b714d7f31-kube-api-access-2qkjp" (OuterVolumeSpecName: "kube-api-access-2qkjp") pod "09d43bcd-7935-40d2-9f42-f11b714d7f31" (UID: "09d43bcd-7935-40d2-9f42-f11b714d7f31"). InnerVolumeSpecName "kube-api-access-2qkjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:00:52.861057 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:52.861035    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09d43bcd-7935-40d2-9f42-f11b714d7f31-util" (OuterVolumeSpecName: "util") pod "09d43bcd-7935-40d2-9f42-f11b714d7f31" (UID: "09d43bcd-7935-40d2-9f42-f11b714d7f31"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:00:52.956801 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:52.956699    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qkjp\" (UniqueName: \"kubernetes.io/projected/09d43bcd-7935-40d2-9f42-f11b714d7f31-kube-api-access-2qkjp\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:00:52.956801 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:52.956738    2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d43bcd-7935-40d2-9f42-f11b714d7f31-bundle\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:00:52.956801 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:52.956747    2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d43bcd-7935-40d2-9f42-f11b714d7f31-util\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:00:53.686333 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:53.686288    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm" event={"ID":"09d43bcd-7935-40d2-9f42-f11b714d7f31","Type":"ContainerDied","Data":"b7fd18f4d08a6fdf743c1946f3ba53a6a03f681bf6398b52d984086aecdee25e"}
Jul 07 18:00:53.686333 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:53.686320    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm"
Jul 07 18:00:53.686536 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:00:53.686347    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7fd18f4d08a6fdf743c1946f3ba53a6a03f681bf6398b52d984086aecdee25e"
Jul 07 18:01:24.015238 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015205    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-gvnxk"]
Jul 07 18:01:24.015705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015473    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b794b63e-9f2c-4094-a758-40914a1dfbb5" containerName="util"
Jul 07 18:01:24.015705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015483    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b794b63e-9f2c-4094-a758-40914a1dfbb5" containerName="util"
Jul 07 18:01:24.015705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015492    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d" containerName="util"
Jul 07 18:01:24.015705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015497    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d" containerName="util"
Jul 07 18:01:24.015705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015504    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09d43bcd-7935-40d2-9f42-f11b714d7f31" containerName="util"
Jul 07 18:01:24.015705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015509    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="09d43bcd-7935-40d2-9f42-f11b714d7f31" containerName="util"
Jul 07 18:01:24.015705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015517    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b794b63e-9f2c-4094-a758-40914a1dfbb5" containerName="extract"
Jul 07 18:01:24.015705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015523    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b794b63e-9f2c-4094-a758-40914a1dfbb5" containerName="extract"
Jul 07 18:01:24.015705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015528    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d" containerName="extract"
Jul 07 18:01:24.015705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015533    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d" containerName="extract"
Jul 07 18:01:24.015705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015539    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09d43bcd-7935-40d2-9f42-f11b714d7f31" containerName="pull"
Jul 07 18:01:24.015705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015543    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="09d43bcd-7935-40d2-9f42-f11b714d7f31" containerName="pull"
Jul 07 18:01:24.015705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015549    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf" containerName="pull"
Jul 07 18:01:24.015705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015553    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf" containerName="pull"
Jul 07 18:01:24.015705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015558    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf" containerName="extract"
Jul 07 18:01:24.015705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015564    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf" containerName="extract"
Jul 07 18:01:24.015705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015572    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b794b63e-9f2c-4094-a758-40914a1dfbb5" containerName="pull"
Jul 07 18:01:24.015705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015577    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b794b63e-9f2c-4094-a758-40914a1dfbb5" containerName="pull"
Jul 07 18:01:24.015705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015588    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf" containerName="util"
Jul 07 18:01:24.015705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015593    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf" containerName="util"
Jul 07 18:01:24.015705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015601    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d" containerName="pull"
Jul 07 18:01:24.015705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015606    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d" containerName="pull"
Jul 07 18:01:24.015705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015611    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09d43bcd-7935-40d2-9f42-f11b714d7f31" containerName="extract"
Jul 07 18:01:24.015705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015616    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="09d43bcd-7935-40d2-9f42-f11b714d7f31" containerName="extract"
Jul 07 18:01:24.015705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015659    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="09d43bcd-7935-40d2-9f42-f11b714d7f31" containerName="extract"
Jul 07 18:01:24.015705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015667    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf" containerName="extract"
Jul 07 18:01:24.015705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015672    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b794b63e-9f2c-4094-a758-40914a1dfbb5" containerName="extract"
Jul 07 18:01:24.015705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.015679    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d" containerName="extract"
Jul 07 18:01:24.018452 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.018434    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gvnxk"
Jul 07 18:01:24.023296 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.023271    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 07 18:01:24.023455 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.023304    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 18:01:24.023455 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.023329    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 18:01:24.023455 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.023329    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 07 18:01:24.023455 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.023336    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bfxpp\""
Jul 07 18:01:24.031172 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.031145    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-gvnxk"]
Jul 07 18:01:24.105189 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.105146    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb076d7d-d224-4d92-bb5c-88a4d16a73e3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gvnxk\" (UID: \"cb076d7d-d224-4d92-bb5c-88a4d16a73e3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gvnxk"
Jul 07 18:01:24.105374 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.105198    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cb076d7d-d224-4d92-bb5c-88a4d16a73e3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-gvnxk\" (UID: \"cb076d7d-d224-4d92-bb5c-88a4d16a73e3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gvnxk"
Jul 07 18:01:24.105374 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.105226    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfdfb\" (UniqueName: \"kubernetes.io/projected/cb076d7d-d224-4d92-bb5c-88a4d16a73e3-kube-api-access-dfdfb\") pod \"kuadrant-console-plugin-66b5774985-gvnxk\" (UID: \"cb076d7d-d224-4d92-bb5c-88a4d16a73e3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gvnxk"
Jul 07 18:01:24.205799 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.205761    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb076d7d-d224-4d92-bb5c-88a4d16a73e3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gvnxk\" (UID: \"cb076d7d-d224-4d92-bb5c-88a4d16a73e3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gvnxk"
Jul 07 18:01:24.206010 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.205812    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cb076d7d-d224-4d92-bb5c-88a4d16a73e3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-gvnxk\" (UID: \"cb076d7d-d224-4d92-bb5c-88a4d16a73e3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gvnxk"
Jul 07 18:01:24.206010 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.205858    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfdfb\" (UniqueName: \"kubernetes.io/projected/cb076d7d-d224-4d92-bb5c-88a4d16a73e3-kube-api-access-dfdfb\") pod \"kuadrant-console-plugin-66b5774985-gvnxk\" (UID: \"cb076d7d-d224-4d92-bb5c-88a4d16a73e3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gvnxk"
Jul 07 18:01:24.206442 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.206422    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cb076d7d-d224-4d92-bb5c-88a4d16a73e3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-gvnxk\" (UID: \"cb076d7d-d224-4d92-bb5c-88a4d16a73e3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gvnxk"
Jul 07 18:01:24.208341 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.208321    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb076d7d-d224-4d92-bb5c-88a4d16a73e3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gvnxk\" (UID: \"cb076d7d-d224-4d92-bb5c-88a4d16a73e3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gvnxk"
Jul 07 18:01:24.220731 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.220705    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfdfb\" (UniqueName: \"kubernetes.io/projected/cb076d7d-d224-4d92-bb5c-88a4d16a73e3-kube-api-access-dfdfb\") pod \"kuadrant-console-plugin-66b5774985-gvnxk\" (UID: \"cb076d7d-d224-4d92-bb5c-88a4d16a73e3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gvnxk"
Jul 07 18:01:24.327844 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.327742    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gvnxk"
Jul 07 18:01:24.504037 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.503987    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-gvnxk"]
Jul 07 18:01:24.506361 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:01:24.506330    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb076d7d_d224_4d92_bb5c_88a4d16a73e3.slice/crio-d65d0726ce3edc31b15cf84d0db7d0336ca558f58c7ce64fc31b11aa142641ab WatchSource:0}: Error finding container d65d0726ce3edc31b15cf84d0db7d0336ca558f58c7ce64fc31b11aa142641ab: Status 404 returned error can't find the container with id d65d0726ce3edc31b15cf84d0db7d0336ca558f58c7ce64fc31b11aa142641ab
Jul 07 18:01:24.828936 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:24.828888    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gvnxk" event={"ID":"cb076d7d-d224-4d92-bb5c-88a4d16a73e3","Type":"ContainerStarted","Data":"d65d0726ce3edc31b15cf84d0db7d0336ca558f58c7ce64fc31b11aa142641ab"}
Jul 07 18:01:49.962039 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:49.962004    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gvnxk" event={"ID":"cb076d7d-d224-4d92-bb5c-88a4d16a73e3","Type":"ContainerStarted","Data":"fb87381b410e881c2942922c01fcd89425fb2d5d44b5d4ae29f75bb1dc7cd8f1"}
Jul 07 18:01:50.001083 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:01:50.001020    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gvnxk" podStartSLOduration=2.234113724 podStartE2EDuration="27.001005349s" totalImagesPullingTime="24.766891625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:01:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:01:49.998304338 +0000 UTC m=+500.755865208" watchObservedRunningTime="2026-07-07 18:01:50.001005349 +0000 UTC m=+500.758566234"
Jul 07 18:02:09.299228 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:09.299190    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-4pqjr"]
Jul 07 18:02:09.364693 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:09.364660    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4pqjr"]
Jul 07 18:02:09.364883 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:09.364754    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4pqjr"
Jul 07 18:02:09.367859 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:09.367835    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9zg8t\""
Jul 07 18:02:09.470463 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:09.470427    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-djwkc"]
Jul 07 18:02:09.473776 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:09.473758    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-djwkc"
Jul 07 18:02:09.484769 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:09.484742    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-djwkc"]
Jul 07 18:02:09.485067 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:09.485035    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg7tw\" (UniqueName: \"kubernetes.io/projected/4bae871d-d223-4671-8061-5efc966ec32c-kube-api-access-dg7tw\") pod \"authorino-58cd955675-4pqjr\" (UID: \"4bae871d-d223-4671-8061-5efc966ec32c\") " pod="kuadrant-system/authorino-58cd955675-4pqjr"
Jul 07 18:02:09.586433 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:09.586350    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrvkk\" (UniqueName: \"kubernetes.io/projected/64b46b5a-b0e5-4325-907f-e42cdd7fa2cf-kube-api-access-nrvkk\") pod \"authorino-75d556bd77-djwkc\" (UID: \"64b46b5a-b0e5-4325-907f-e42cdd7fa2cf\") " pod="kuadrant-system/authorino-75d556bd77-djwkc"
Jul 07 18:02:09.586433 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:09.586423    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg7tw\" (UniqueName: \"kubernetes.io/projected/4bae871d-d223-4671-8061-5efc966ec32c-kube-api-access-dg7tw\") pod \"authorino-58cd955675-4pqjr\" (UID: \"4bae871d-d223-4671-8061-5efc966ec32c\") " pod="kuadrant-system/authorino-58cd955675-4pqjr"
Jul 07 18:02:09.595665 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:09.595637    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg7tw\" (UniqueName: \"kubernetes.io/projected/4bae871d-d223-4671-8061-5efc966ec32c-kube-api-access-dg7tw\") pod \"authorino-58cd955675-4pqjr\" (UID: \"4bae871d-d223-4671-8061-5efc966ec32c\") " pod="kuadrant-system/authorino-58cd955675-4pqjr"
Jul 07 18:02:09.673785 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:09.673734    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4pqjr"
Jul 07 18:02:09.687294 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:09.687261    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrvkk\" (UniqueName: \"kubernetes.io/projected/64b46b5a-b0e5-4325-907f-e42cdd7fa2cf-kube-api-access-nrvkk\") pod \"authorino-75d556bd77-djwkc\" (UID: \"64b46b5a-b0e5-4325-907f-e42cdd7fa2cf\") " pod="kuadrant-system/authorino-75d556bd77-djwkc"
Jul 07 18:02:09.697630 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:09.697600    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrvkk\" (UniqueName: \"kubernetes.io/projected/64b46b5a-b0e5-4325-907f-e42cdd7fa2cf-kube-api-access-nrvkk\") pod \"authorino-75d556bd77-djwkc\" (UID: \"64b46b5a-b0e5-4325-907f-e42cdd7fa2cf\") " pod="kuadrant-system/authorino-75d556bd77-djwkc"
Jul 07 18:02:09.782328 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:09.782297    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-djwkc"
Jul 07 18:02:09.832859 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:09.832711    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4pqjr"]
Jul 07 18:02:09.837218 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:02:09.837156    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4bae871d_d223_4671_8061_5efc966ec32c.slice/crio-d79734b50988baafa225bb65a9ae6fcb878b16bfb8588f74cf802db4d94c7a79 WatchSource:0}: Error finding container d79734b50988baafa225bb65a9ae6fcb878b16bfb8588f74cf802db4d94c7a79: Status 404 returned error can't find the container with id d79734b50988baafa225bb65a9ae6fcb878b16bfb8588f74cf802db4d94c7a79
Jul 07 18:02:09.924069 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:09.924043    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-djwkc"]
Jul 07 18:02:09.926131 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:02:09.926099    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64b46b5a_b0e5_4325_907f_e42cdd7fa2cf.slice/crio-533a44298841798de1300666b016259f5aceb1c40f48503c6ad6f7ab1e7e6b80 WatchSource:0}: Error finding container 533a44298841798de1300666b016259f5aceb1c40f48503c6ad6f7ab1e7e6b80: Status 404 returned error can't find the container with id 533a44298841798de1300666b016259f5aceb1c40f48503c6ad6f7ab1e7e6b80
Jul 07 18:02:10.050799 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:10.050763    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-djwkc" event={"ID":"64b46b5a-b0e5-4325-907f-e42cdd7fa2cf","Type":"ContainerStarted","Data":"533a44298841798de1300666b016259f5aceb1c40f48503c6ad6f7ab1e7e6b80"}
Jul 07 18:02:10.051895 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:10.051873    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4pqjr" event={"ID":"4bae871d-d223-4671-8061-5efc966ec32c","Type":"ContainerStarted","Data":"d79734b50988baafa225bb65a9ae6fcb878b16bfb8588f74cf802db4d94c7a79"}
Jul 07 18:02:14.076078 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:14.076035    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-djwkc" event={"ID":"64b46b5a-b0e5-4325-907f-e42cdd7fa2cf","Type":"ContainerStarted","Data":"218103b2fdd9bc6e4a645290e9ea83a87e137d9ae7b82a4651753715f1a591b6"}
Jul 07 18:02:14.077399 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:14.077375    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4pqjr" event={"ID":"4bae871d-d223-4671-8061-5efc966ec32c","Type":"ContainerStarted","Data":"32cf56573cc2ea83a181f7b2aa74ae2abba31983eb74688cc15a3a6ea2a55687"}
Jul 07 18:02:14.095569 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:14.095507    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-djwkc" podStartSLOduration=1.678320547 podStartE2EDuration="5.095492565s" totalImagesPullingTime="3.417172018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:02:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:02:14.094506739 +0000 UTC m=+524.852067616" watchObservedRunningTime="2026-07-07 18:02:14.095492565 +0000 UTC m=+524.853053435"
Jul 07 18:02:14.111994 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:14.111935    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-4pqjr" podStartSLOduration=1.6164584400000002 podStartE2EDuration="5.111912953s" totalImagesPullingTime="3.495454513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:02:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:02:14.111522147 +0000 UTC m=+524.869083020" watchObservedRunningTime="2026-07-07 18:02:14.111912953 +0000 UTC m=+524.869473825"
Jul 07 18:02:14.152793 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:14.152755    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4pqjr"]
Jul 07 18:02:16.087240 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:16.087198    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-4pqjr" podUID="4bae871d-d223-4671-8061-5efc966ec32c" containerName="authorino" containerID="cri-o://32cf56573cc2ea83a181f7b2aa74ae2abba31983eb74688cc15a3a6ea2a55687" gracePeriod=30
Jul 07 18:02:16.357025 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:16.356952    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4pqjr"
Jul 07 18:02:16.450948 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:16.450907    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dg7tw\" (UniqueName: \"kubernetes.io/projected/4bae871d-d223-4671-8061-5efc966ec32c-kube-api-access-dg7tw\") pod \"4bae871d-d223-4671-8061-5efc966ec32c\" (UID: \"4bae871d-d223-4671-8061-5efc966ec32c\") "
Jul 07 18:02:16.453198 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:16.453168    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bae871d-d223-4671-8061-5efc966ec32c-kube-api-access-dg7tw" (OuterVolumeSpecName: "kube-api-access-dg7tw") pod "4bae871d-d223-4671-8061-5efc966ec32c" (UID: "4bae871d-d223-4671-8061-5efc966ec32c"). InnerVolumeSpecName "kube-api-access-dg7tw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:02:16.552141 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:16.552098    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dg7tw\" (UniqueName: \"kubernetes.io/projected/4bae871d-d223-4671-8061-5efc966ec32c-kube-api-access-dg7tw\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:02:17.092941 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:17.092902    2566 generic.go:356] "Generic (PLEG): container finished" podID="4bae871d-d223-4671-8061-5efc966ec32c" containerID="32cf56573cc2ea83a181f7b2aa74ae2abba31983eb74688cc15a3a6ea2a55687" exitCode=0
Jul 07 18:02:17.093401 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:17.092945    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4pqjr"
Jul 07 18:02:17.093401 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:17.092989    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4pqjr" event={"ID":"4bae871d-d223-4671-8061-5efc966ec32c","Type":"ContainerDied","Data":"32cf56573cc2ea83a181f7b2aa74ae2abba31983eb74688cc15a3a6ea2a55687"}
Jul 07 18:02:17.093401 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:17.093031    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4pqjr" event={"ID":"4bae871d-d223-4671-8061-5efc966ec32c","Type":"ContainerDied","Data":"d79734b50988baafa225bb65a9ae6fcb878b16bfb8588f74cf802db4d94c7a79"}
Jul 07 18:02:17.093401 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:17.093057    2566 scope.go:117] "RemoveContainer" containerID="32cf56573cc2ea83a181f7b2aa74ae2abba31983eb74688cc15a3a6ea2a55687"
Jul 07 18:02:17.101983 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:17.101964    2566 scope.go:117] "RemoveContainer" containerID="32cf56573cc2ea83a181f7b2aa74ae2abba31983eb74688cc15a3a6ea2a55687"
Jul 07 18:02:17.102273 ip-10-0-128-53 kubenswrapper[2566]: E0707 18:02:17.102256    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32cf56573cc2ea83a181f7b2aa74ae2abba31983eb74688cc15a3a6ea2a55687\": container with ID starting with 32cf56573cc2ea83a181f7b2aa74ae2abba31983eb74688cc15a3a6ea2a55687 not found: ID does not exist" containerID="32cf56573cc2ea83a181f7b2aa74ae2abba31983eb74688cc15a3a6ea2a55687"
Jul 07 18:02:17.102328 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:17.102282    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32cf56573cc2ea83a181f7b2aa74ae2abba31983eb74688cc15a3a6ea2a55687"} err="failed to get container status \"32cf56573cc2ea83a181f7b2aa74ae2abba31983eb74688cc15a3a6ea2a55687\": rpc error: code = NotFound desc = could not find container \"32cf56573cc2ea83a181f7b2aa74ae2abba31983eb74688cc15a3a6ea2a55687\": container with ID starting with 32cf56573cc2ea83a181f7b2aa74ae2abba31983eb74688cc15a3a6ea2a55687 not found: ID does not exist"
Jul 07 18:02:17.126406 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:17.126373    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4pqjr"]
Jul 07 18:02:17.129440 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:17.129415    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-4pqjr"]
Jul 07 18:02:17.799846 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:17.799803    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bae871d-d223-4671-8061-5efc966ec32c" path="/var/lib/kubelet/pods/4bae871d-d223-4671-8061-5efc966ec32c/volumes"
Jul 07 18:02:38.141969 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:38.141935    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mwclw"]
Jul 07 18:02:38.142410 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:38.142213    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bae871d-d223-4671-8061-5efc966ec32c" containerName="authorino"
Jul 07 18:02:38.142410 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:38.142225    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bae871d-d223-4671-8061-5efc966ec32c" containerName="authorino"
Jul 07 18:02:38.142410 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:38.142281    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bae871d-d223-4671-8061-5efc966ec32c" containerName="authorino"
Jul 07 18:02:38.146192 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:38.146174    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mwclw"
Jul 07 18:02:38.159978 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:38.159955    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mwclw"]
Jul 07 18:02:38.332236 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:38.332198    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kstm4\" (UniqueName: \"kubernetes.io/projected/924c3bde-dfb8-4336-ac42-a83e82c637df-kube-api-access-kstm4\") pod \"authorino-5d4b67c446-mwclw\" (UID: \"924c3bde-dfb8-4336-ac42-a83e82c637df\") " pod="kuadrant-system/authorino-5d4b67c446-mwclw"
Jul 07 18:02:38.433687 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:38.433606    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kstm4\" (UniqueName: \"kubernetes.io/projected/924c3bde-dfb8-4336-ac42-a83e82c637df-kube-api-access-kstm4\") pod \"authorino-5d4b67c446-mwclw\" (UID: \"924c3bde-dfb8-4336-ac42-a83e82c637df\") " pod="kuadrant-system/authorino-5d4b67c446-mwclw"
Jul 07 18:02:38.461460 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:38.461430    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mwclw"]
Jul 07 18:02:38.461650 ip-10-0-128-53 kubenswrapper[2566]: E0707 18:02:38.461631    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-kstm4], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-mwclw" podUID="924c3bde-dfb8-4336-ac42-a83e82c637df"
Jul 07 18:02:38.461961 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:38.461940    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kstm4\" (UniqueName: \"kubernetes.io/projected/924c3bde-dfb8-4336-ac42-a83e82c637df-kube-api-access-kstm4\") pod \"authorino-5d4b67c446-mwclw\" (UID: \"924c3bde-dfb8-4336-ac42-a83e82c637df\") " pod="kuadrant-system/authorino-5d4b67c446-mwclw"
Jul 07 18:02:38.525264 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:38.525224    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6b8967c4d7-mkx87"]
Jul 07 18:02:38.528378 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:38.528361    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b8967c4d7-mkx87"
Jul 07 18:02:38.555206 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:38.555171    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b8967c4d7-mkx87"]
Jul 07 18:02:38.635357 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:38.635314    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg2wz\" (UniqueName: \"kubernetes.io/projected/29c8c3d5-d56b-4dba-8232-9a00a213aec5-kube-api-access-hg2wz\") pod \"authorino-6b8967c4d7-mkx87\" (UID: \"29c8c3d5-d56b-4dba-8232-9a00a213aec5\") " pod="kuadrant-system/authorino-6b8967c4d7-mkx87"
Jul 07 18:02:38.713294 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:38.713261    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6b8967c4d7-mkx87"]
Jul 07 18:02:38.713520 ip-10-0-128-53 kubenswrapper[2566]: E0707 18:02:38.713499    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-hg2wz], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6b8967c4d7-mkx87" podUID="29c8c3d5-d56b-4dba-8232-9a00a213aec5"
Jul 07 18:02:38.736185 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:38.736155    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg2wz\" (UniqueName: \"kubernetes.io/projected/29c8c3d5-d56b-4dba-8232-9a00a213aec5-kube-api-access-hg2wz\") pod \"authorino-6b8967c4d7-mkx87\" (UID: \"29c8c3d5-d56b-4dba-8232-9a00a213aec5\") " pod="kuadrant-system/authorino-6b8967c4d7-mkx87"
Jul 07 18:02:38.758503 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:38.758470    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg2wz\" (UniqueName: \"kubernetes.io/projected/29c8c3d5-d56b-4dba-8232-9a00a213aec5-kube-api-access-hg2wz\") pod \"authorino-6b8967c4d7-mkx87\" (UID: \"29c8c3d5-d56b-4dba-8232-9a00a213aec5\") " pod="kuadrant-system/authorino-6b8967c4d7-mkx87"
Jul 07 18:02:38.772804 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:38.772773    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-664bfdcdf5-ppsrw"]
Jul 07 18:02:38.776120 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:38.776098    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-664bfdcdf5-ppsrw"
Jul 07 18:02:38.782275 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:38.782241    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 07 18:02:38.790870 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:38.790842    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-664bfdcdf5-ppsrw"]
Jul 07 18:02:38.937747 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:38.937706    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6383e5c2-6d39-451e-be95-231698acbfb0-tls-cert\") pod \"authorino-664bfdcdf5-ppsrw\" (UID: \"6383e5c2-6d39-451e-be95-231698acbfb0\") " pod="kuadrant-system/authorino-664bfdcdf5-ppsrw"
Jul 07 18:02:38.937961 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:38.937755    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msz48\" (UniqueName: \"kubernetes.io/projected/6383e5c2-6d39-451e-be95-231698acbfb0-kube-api-access-msz48\") pod \"authorino-664bfdcdf5-ppsrw\" (UID: \"6383e5c2-6d39-451e-be95-231698acbfb0\") " pod="kuadrant-system/authorino-664bfdcdf5-ppsrw"
Jul 07 18:02:39.039110 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:39.039016    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6383e5c2-6d39-451e-be95-231698acbfb0-tls-cert\") pod \"authorino-664bfdcdf5-ppsrw\" (UID: \"6383e5c2-6d39-451e-be95-231698acbfb0\") " pod="kuadrant-system/authorino-664bfdcdf5-ppsrw"
Jul 07 18:02:39.039110 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:39.039064    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msz48\" (UniqueName: \"kubernetes.io/projected/6383e5c2-6d39-451e-be95-231698acbfb0-kube-api-access-msz48\") pod \"authorino-664bfdcdf5-ppsrw\" (UID: \"6383e5c2-6d39-451e-be95-231698acbfb0\") " pod="kuadrant-system/authorino-664bfdcdf5-ppsrw"
Jul 07 18:02:39.041649 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:39.041624    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6383e5c2-6d39-451e-be95-231698acbfb0-tls-cert\") pod \"authorino-664bfdcdf5-ppsrw\" (UID: \"6383e5c2-6d39-451e-be95-231698acbfb0\") " pod="kuadrant-system/authorino-664bfdcdf5-ppsrw"
Jul 07 18:02:39.051652 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:39.051627    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msz48\" (UniqueName: \"kubernetes.io/projected/6383e5c2-6d39-451e-be95-231698acbfb0-kube-api-access-msz48\") pod \"authorino-664bfdcdf5-ppsrw\" (UID: \"6383e5c2-6d39-451e-be95-231698acbfb0\") " pod="kuadrant-system/authorino-664bfdcdf5-ppsrw"
Jul 07 18:02:39.085698 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:39.085648    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-664bfdcdf5-ppsrw"
Jul 07 18:02:39.201487 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:39.201425    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b8967c4d7-mkx87"
Jul 07 18:02:39.201487 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:39.201448    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mwclw"
Jul 07 18:02:39.209072 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:39.209037    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mwclw"
Jul 07 18:02:39.211924 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:39.211893    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b8967c4d7-mkx87"
Jul 07 18:02:39.227541 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:39.227514    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-664bfdcdf5-ppsrw"]
Jul 07 18:02:39.231095 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:02:39.231069    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6383e5c2_6d39_451e_be95_231698acbfb0.slice/crio-5ed78c2cafd8fe3101c6a85b9d8f7336021297d662fa0adaeca8fc73d43c51f3 WatchSource:0}: Error finding container 5ed78c2cafd8fe3101c6a85b9d8f7336021297d662fa0adaeca8fc73d43c51f3: Status 404 returned error can't find the container with id 5ed78c2cafd8fe3101c6a85b9d8f7336021297d662fa0adaeca8fc73d43c51f3
Jul 07 18:02:39.341784 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:39.341692    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hg2wz\" (UniqueName: \"kubernetes.io/projected/29c8c3d5-d56b-4dba-8232-9a00a213aec5-kube-api-access-hg2wz\") pod \"29c8c3d5-d56b-4dba-8232-9a00a213aec5\" (UID: \"29c8c3d5-d56b-4dba-8232-9a00a213aec5\") "
Jul 07 18:02:39.341784 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:39.341755    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kstm4\" (UniqueName: \"kubernetes.io/projected/924c3bde-dfb8-4336-ac42-a83e82c637df-kube-api-access-kstm4\") pod \"924c3bde-dfb8-4336-ac42-a83e82c637df\" (UID: \"924c3bde-dfb8-4336-ac42-a83e82c637df\") "
Jul 07 18:02:39.344070 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:39.344038    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/924c3bde-dfb8-4336-ac42-a83e82c637df-kube-api-access-kstm4" (OuterVolumeSpecName: "kube-api-access-kstm4") pod "924c3bde-dfb8-4336-ac42-a83e82c637df" (UID: "924c3bde-dfb8-4336-ac42-a83e82c637df"). InnerVolumeSpecName "kube-api-access-kstm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:02:39.344186 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:39.344115    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29c8c3d5-d56b-4dba-8232-9a00a213aec5-kube-api-access-hg2wz" (OuterVolumeSpecName: "kube-api-access-hg2wz") pod "29c8c3d5-d56b-4dba-8232-9a00a213aec5" (UID: "29c8c3d5-d56b-4dba-8232-9a00a213aec5"). InnerVolumeSpecName "kube-api-access-hg2wz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:02:39.442702 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:39.442664    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hg2wz\" (UniqueName: \"kubernetes.io/projected/29c8c3d5-d56b-4dba-8232-9a00a213aec5-kube-api-access-hg2wz\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:02:39.442702 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:39.442693    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kstm4\" (UniqueName: \"kubernetes.io/projected/924c3bde-dfb8-4336-ac42-a83e82c637df-kube-api-access-kstm4\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:02:40.207958 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:40.207923    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-664bfdcdf5-ppsrw" event={"ID":"6383e5c2-6d39-451e-be95-231698acbfb0","Type":"ContainerStarted","Data":"c0c82019422f940e7acda846f8720f5e2dba4132436db85a63d1ee3f4fe69c17"}
Jul 07 18:02:40.208404 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:40.207966    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-664bfdcdf5-ppsrw" event={"ID":"6383e5c2-6d39-451e-be95-231698acbfb0","Type":"ContainerStarted","Data":"5ed78c2cafd8fe3101c6a85b9d8f7336021297d662fa0adaeca8fc73d43c51f3"}
Jul 07 18:02:40.208404 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:40.208060    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b8967c4d7-mkx87"
Jul 07 18:02:40.208404 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:40.208078    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mwclw"
Jul 07 18:02:40.231255 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:40.231209    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-664bfdcdf5-ppsrw" podStartSLOduration=1.741308664 podStartE2EDuration="2.231194285s" totalImagesPullingTime="489.885621ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:02:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:02:40.229800005 +0000 UTC m=+550.987360877" watchObservedRunningTime="2026-07-07 18:02:40.231194285 +0000 UTC m=+550.988755199"
Jul 07 18:02:40.316565 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:40.316531    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mwclw"]
Jul 07 18:02:40.318225 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:40.318196    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-djwkc"]
Jul 07 18:02:40.318394 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:40.318373    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-djwkc" podUID="64b46b5a-b0e5-4325-907f-e42cdd7fa2cf" containerName="authorino" containerID="cri-o://218103b2fdd9bc6e4a645290e9ea83a87e137d9ae7b82a4651753715f1a591b6" gracePeriod=30
Jul 07 18:02:40.350074 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:40.350043    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mwclw"]
Jul 07 18:02:40.401247 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:40.401216    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6b8967c4d7-mkx87"]
Jul 07 18:02:40.414789 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:40.414761    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6b8967c4d7-mkx87"]
Jul 07 18:02:40.570498 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:40.570476    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-djwkc"
Jul 07 18:02:40.752282 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:40.752166    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrvkk\" (UniqueName: \"kubernetes.io/projected/64b46b5a-b0e5-4325-907f-e42cdd7fa2cf-kube-api-access-nrvkk\") pod \"64b46b5a-b0e5-4325-907f-e42cdd7fa2cf\" (UID: \"64b46b5a-b0e5-4325-907f-e42cdd7fa2cf\") "
Jul 07 18:02:40.754400 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:40.754374    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64b46b5a-b0e5-4325-907f-e42cdd7fa2cf-kube-api-access-nrvkk" (OuterVolumeSpecName: "kube-api-access-nrvkk") pod "64b46b5a-b0e5-4325-907f-e42cdd7fa2cf" (UID: "64b46b5a-b0e5-4325-907f-e42cdd7fa2cf"). InnerVolumeSpecName "kube-api-access-nrvkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:02:40.853181 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:40.853127    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrvkk\" (UniqueName: \"kubernetes.io/projected/64b46b5a-b0e5-4325-907f-e42cdd7fa2cf-kube-api-access-nrvkk\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:02:41.214693 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:41.214655    2566 generic.go:356] "Generic (PLEG): container finished" podID="64b46b5a-b0e5-4325-907f-e42cdd7fa2cf" containerID="218103b2fdd9bc6e4a645290e9ea83a87e137d9ae7b82a4651753715f1a591b6" exitCode=0
Jul 07 18:02:41.215119 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:41.214707    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-djwkc"
Jul 07 18:02:41.215119 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:41.214744    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-djwkc" event={"ID":"64b46b5a-b0e5-4325-907f-e42cdd7fa2cf","Type":"ContainerDied","Data":"218103b2fdd9bc6e4a645290e9ea83a87e137d9ae7b82a4651753715f1a591b6"}
Jul 07 18:02:41.215119 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:41.214790    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-djwkc" event={"ID":"64b46b5a-b0e5-4325-907f-e42cdd7fa2cf","Type":"ContainerDied","Data":"533a44298841798de1300666b016259f5aceb1c40f48503c6ad6f7ab1e7e6b80"}
Jul 07 18:02:41.215119 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:41.214809    2566 scope.go:117] "RemoveContainer" containerID="218103b2fdd9bc6e4a645290e9ea83a87e137d9ae7b82a4651753715f1a591b6"
Jul 07 18:02:41.223538 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:41.223518    2566 scope.go:117] "RemoveContainer" containerID="218103b2fdd9bc6e4a645290e9ea83a87e137d9ae7b82a4651753715f1a591b6"
Jul 07 18:02:41.223785 ip-10-0-128-53 kubenswrapper[2566]: E0707 18:02:41.223764    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"218103b2fdd9bc6e4a645290e9ea83a87e137d9ae7b82a4651753715f1a591b6\": container with ID starting with 218103b2fdd9bc6e4a645290e9ea83a87e137d9ae7b82a4651753715f1a591b6 not found: ID does not exist" containerID="218103b2fdd9bc6e4a645290e9ea83a87e137d9ae7b82a4651753715f1a591b6"
Jul 07 18:02:41.223871 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:41.223794    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"218103b2fdd9bc6e4a645290e9ea83a87e137d9ae7b82a4651753715f1a591b6"} err="failed to get container status \"218103b2fdd9bc6e4a645290e9ea83a87e137d9ae7b82a4651753715f1a591b6\": rpc error: code = NotFound desc = could not find container \"218103b2fdd9bc6e4a645290e9ea83a87e137d9ae7b82a4651753715f1a591b6\": container with ID starting with 218103b2fdd9bc6e4a645290e9ea83a87e137d9ae7b82a4651753715f1a591b6 not found: ID does not exist"
Jul 07 18:02:41.265329 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:41.265289    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-djwkc"]
Jul 07 18:02:41.269873 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:41.269819    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-djwkc"]
Jul 07 18:02:41.801658 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:41.801624    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29c8c3d5-d56b-4dba-8232-9a00a213aec5" path="/var/lib/kubelet/pods/29c8c3d5-d56b-4dba-8232-9a00a213aec5/volumes"
Jul 07 18:02:41.801872 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:41.801859    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64b46b5a-b0e5-4325-907f-e42cdd7fa2cf" path="/var/lib/kubelet/pods/64b46b5a-b0e5-4325-907f-e42cdd7fa2cf/volumes"
Jul 07 18:02:41.802137 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:41.802125    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="924c3bde-dfb8-4336-ac42-a83e82c637df" path="/var/lib/kubelet/pods/924c3bde-dfb8-4336-ac42-a83e82c637df/volumes"
Jul 07 18:02:46.537489 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:46.537456    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-889554864-gpqvq"]
Jul 07 18:02:46.537983 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:46.537741    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64b46b5a-b0e5-4325-907f-e42cdd7fa2cf" containerName="authorino"
Jul 07 18:02:46.537983 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:46.537753    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="64b46b5a-b0e5-4325-907f-e42cdd7fa2cf" containerName="authorino"
Jul 07 18:02:46.537983 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:46.537804    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="64b46b5a-b0e5-4325-907f-e42cdd7fa2cf" containerName="authorino"
Jul 07 18:02:46.543059 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:46.543035    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-889554864-gpqvq"
Jul 07 18:02:46.559389 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:46.559347    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 18:02:46.559642 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:46.559349    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 18:02:46.559865 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:46.559349    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-zc9xp\""
Jul 07 18:02:46.597166 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:46.597131    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-889554864-gpqvq"]
Jul 07 18:02:46.599785 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:46.599752    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ed2cd40d-6820-4b0e-b32a-664b378dff86-webhook-cert\") pod \"maas-controller-889554864-gpqvq\" (UID: \"ed2cd40d-6820-4b0e-b32a-664b378dff86\") " pod="opendatahub/maas-controller-889554864-gpqvq"
Jul 07 18:02:46.599933 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:46.599809    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jg9l\" (UniqueName: \"kubernetes.io/projected/ed2cd40d-6820-4b0e-b32a-664b378dff86-kube-api-access-2jg9l\") pod \"maas-controller-889554864-gpqvq\" (UID: \"ed2cd40d-6820-4b0e-b32a-664b378dff86\") " pod="opendatahub/maas-controller-889554864-gpqvq"
Jul 07 18:02:46.700431 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:46.700390    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ed2cd40d-6820-4b0e-b32a-664b378dff86-webhook-cert\") pod \"maas-controller-889554864-gpqvq\" (UID: \"ed2cd40d-6820-4b0e-b32a-664b378dff86\") " pod="opendatahub/maas-controller-889554864-gpqvq"
Jul 07 18:02:46.700617 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:46.700444    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jg9l\" (UniqueName: \"kubernetes.io/projected/ed2cd40d-6820-4b0e-b32a-664b378dff86-kube-api-access-2jg9l\") pod \"maas-controller-889554864-gpqvq\" (UID: \"ed2cd40d-6820-4b0e-b32a-664b378dff86\") " pod="opendatahub/maas-controller-889554864-gpqvq"
Jul 07 18:02:46.703189 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:46.703163    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ed2cd40d-6820-4b0e-b32a-664b378dff86-webhook-cert\") pod \"maas-controller-889554864-gpqvq\" (UID: \"ed2cd40d-6820-4b0e-b32a-664b378dff86\") " pod="opendatahub/maas-controller-889554864-gpqvq"
Jul 07 18:02:46.725395 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:46.725361    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jg9l\" (UniqueName: \"kubernetes.io/projected/ed2cd40d-6820-4b0e-b32a-664b378dff86-kube-api-access-2jg9l\") pod \"maas-controller-889554864-gpqvq\" (UID: \"ed2cd40d-6820-4b0e-b32a-664b378dff86\") " pod="opendatahub/maas-controller-889554864-gpqvq"
Jul 07 18:02:46.853279 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:46.853182    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-889554864-gpqvq"
Jul 07 18:02:47.020294 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:02:47.020265    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2cd40d_6820_4b0e_b32a_664b378dff86.slice/crio-2da5e6f45a9eabb32d3875198f51d0e5570773cff56956408a4f43d572969845 WatchSource:0}: Error finding container 2da5e6f45a9eabb32d3875198f51d0e5570773cff56956408a4f43d572969845: Status 404 returned error can't find the container with id 2da5e6f45a9eabb32d3875198f51d0e5570773cff56956408a4f43d572969845
Jul 07 18:02:47.039527 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:47.039490    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-889554864-gpqvq"]
Jul 07 18:02:47.244260 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:47.244224    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-889554864-gpqvq" event={"ID":"ed2cd40d-6820-4b0e-b32a-664b378dff86","Type":"ContainerStarted","Data":"2da5e6f45a9eabb32d3875198f51d0e5570773cff56956408a4f43d572969845"}
Jul 07 18:02:50.259012 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:50.258977    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-889554864-gpqvq" event={"ID":"ed2cd40d-6820-4b0e-b32a-664b378dff86","Type":"ContainerStarted","Data":"ecb748df32890550801d4a4ca5eb5d5905694de974bc2b21df78caedb9af8de5"}
Jul 07 18:02:50.259396 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:50.259046    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-889554864-gpqvq"
Jul 07 18:02:50.313752 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:02:50.313695    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-889554864-gpqvq" podStartSLOduration=2.053635838 podStartE2EDuration="4.313677545s" totalImagesPullingTime="2.260041707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:02:50.307285569 +0000 UTC m=+561.064846481" watchObservedRunningTime="2026-07-07 18:02:50.313677545 +0000 UTC m=+561.071238416"
Jul 07 18:03:01.271908 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:01.271870    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-889554864-gpqvq"
Jul 07 18:03:22.359707 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:22.359662    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-zqd2b"]
Jul 07 18:03:22.363501 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:22.363485    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-zqd2b"
Jul 07 18:03:22.366779 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:22.366755    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-8tntk\""
Jul 07 18:03:22.367309 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:22.367290    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 07 18:03:22.389603 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:22.389576    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-zqd2b"]
Jul 07 18:03:22.482158 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:22.482119    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c129d715-41a9-4d84-9b23-626d20b017c5-plugins-config-volume\") pod \"payload-pre-processing-7964457696-zqd2b\" (UID: \"c129d715-41a9-4d84-9b23-626d20b017c5\") " pod="openshift-ingress/payload-pre-processing-7964457696-zqd2b"
Jul 07 18:03:22.482323 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:22.482191    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vq4w\" (UniqueName: \"kubernetes.io/projected/c129d715-41a9-4d84-9b23-626d20b017c5-kube-api-access-6vq4w\") pod \"payload-pre-processing-7964457696-zqd2b\" (UID: \"c129d715-41a9-4d84-9b23-626d20b017c5\") " pod="openshift-ingress/payload-pre-processing-7964457696-zqd2b"
Jul 07 18:03:22.583254 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:22.583216    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c129d715-41a9-4d84-9b23-626d20b017c5-plugins-config-volume\") pod \"payload-pre-processing-7964457696-zqd2b\" (UID: \"c129d715-41a9-4d84-9b23-626d20b017c5\") " pod="openshift-ingress/payload-pre-processing-7964457696-zqd2b"
Jul 07 18:03:22.583416 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:22.583260    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vq4w\" (UniqueName: \"kubernetes.io/projected/c129d715-41a9-4d84-9b23-626d20b017c5-kube-api-access-6vq4w\") pod \"payload-pre-processing-7964457696-zqd2b\" (UID: \"c129d715-41a9-4d84-9b23-626d20b017c5\") " pod="openshift-ingress/payload-pre-processing-7964457696-zqd2b"
Jul 07 18:03:22.583935 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:22.583916    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c129d715-41a9-4d84-9b23-626d20b017c5-plugins-config-volume\") pod \"payload-pre-processing-7964457696-zqd2b\" (UID: \"c129d715-41a9-4d84-9b23-626d20b017c5\") " pod="openshift-ingress/payload-pre-processing-7964457696-zqd2b"
Jul 07 18:03:22.607537 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:22.607506    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vq4w\" (UniqueName: \"kubernetes.io/projected/c129d715-41a9-4d84-9b23-626d20b017c5-kube-api-access-6vq4w\") pod \"payload-pre-processing-7964457696-zqd2b\" (UID: \"c129d715-41a9-4d84-9b23-626d20b017c5\") " pod="openshift-ingress/payload-pre-processing-7964457696-zqd2b"
Jul 07 18:03:22.673735 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:22.673648    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-zqd2b"
Jul 07 18:03:22.809691 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:22.809665    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-zqd2b"]
Jul 07 18:03:22.811407 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:03:22.811375    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc129d715_41a9_4d84_9b23_626d20b017c5.slice/crio-bedd9f1b5471e540b3da199129fb3d7b4320bd96976841ebc746c37be51a6b35 WatchSource:0}: Error finding container bedd9f1b5471e540b3da199129fb3d7b4320bd96976841ebc746c37be51a6b35: Status 404 returned error can't find the container with id bedd9f1b5471e540b3da199129fb3d7b4320bd96976841ebc746c37be51a6b35
Jul 07 18:03:23.413346 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:23.413308    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-zqd2b" event={"ID":"c129d715-41a9-4d84-9b23-626d20b017c5","Type":"ContainerStarted","Data":"bedd9f1b5471e540b3da199129fb3d7b4320bd96976841ebc746c37be51a6b35"}
Jul 07 18:03:25.424318 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:25.424273    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-zqd2b" event={"ID":"c129d715-41a9-4d84-9b23-626d20b017c5","Type":"ContainerStarted","Data":"2cae0cf9458fb1aa62d07cc8ad08d3674635678d2000ec492f56d3d2be3648f5"}
Jul 07 18:03:25.424716 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:25.424383    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-zqd2b"
Jul 07 18:03:25.448638 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:25.448579    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-zqd2b" podStartSLOduration=1.563621554 podStartE2EDuration="3.448559955s" totalImagesPullingTime="1.884938401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:03:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:03:25.445715236 +0000 UTC m=+596.203276120" watchObservedRunningTime="2026-07-07 18:03:25.448559955 +0000 UTC m=+596.206120826"
Jul 07 18:03:29.703559 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:29.703529    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lcfnl_9bc45238-7341-43fe-a75f-231dbf7a3704/console-operator/1.log"
Jul 07 18:03:29.704109 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:29.703597    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lcfnl_9bc45238-7341-43fe-a75f-231dbf7a3704/console-operator/1.log"
Jul 07 18:03:36.430716 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:36.430682    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-zqd2b"
Jul 07 18:03:54.641668 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:54.641594    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq"]
Jul 07 18:03:54.644862 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:54.644840    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq"
Jul 07 18:03:54.647928 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:54.647906    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dbltm\""
Jul 07 18:03:54.649922 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:54.649901    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 18:03:54.650000 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:54.649903    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 07 18:03:54.650000 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:54.649912    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 18:03:54.660778 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:54.660754    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq"]
Jul 07 18:03:54.748914 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:54.748875    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/146477be-d746-4745-a113-bcf1617f05f1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2sldq\" (UID: \"146477be-d746-4745-a113-bcf1617f05f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq"
Jul 07 18:03:54.749089 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:54.748937    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr6g4\" (UniqueName: \"kubernetes.io/projected/146477be-d746-4745-a113-bcf1617f05f1-kube-api-access-gr6g4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2sldq\" (UID: \"146477be-d746-4745-a113-bcf1617f05f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq"
Jul 07 18:03:54.749089 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:54.749000    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/146477be-d746-4745-a113-bcf1617f05f1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2sldq\" (UID: \"146477be-d746-4745-a113-bcf1617f05f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq"
Jul 07 18:03:54.749089 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:54.749038    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/146477be-d746-4745-a113-bcf1617f05f1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2sldq\" (UID: \"146477be-d746-4745-a113-bcf1617f05f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq"
Jul 07 18:03:54.749089 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:54.749065    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/146477be-d746-4745-a113-bcf1617f05f1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2sldq\" (UID: \"146477be-d746-4745-a113-bcf1617f05f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq"
Jul 07 18:03:54.749231 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:54.749099    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/146477be-d746-4745-a113-bcf1617f05f1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2sldq\" (UID: \"146477be-d746-4745-a113-bcf1617f05f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq"
Jul 07 18:03:54.850525 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:54.850485    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/146477be-d746-4745-a113-bcf1617f05f1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2sldq\" (UID: \"146477be-d746-4745-a113-bcf1617f05f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq"
Jul 07 18:03:54.850719 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:54.850537    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/146477be-d746-4745-a113-bcf1617f05f1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2sldq\" (UID: \"146477be-d746-4745-a113-bcf1617f05f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq"
Jul 07 18:03:54.850719 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:54.850564    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/146477be-d746-4745-a113-bcf1617f05f1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2sldq\" (UID: \"146477be-d746-4745-a113-bcf1617f05f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq"
Jul 07 18:03:54.850719 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:54.850591    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/146477be-d746-4745-a113-bcf1617f05f1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2sldq\" (UID: \"146477be-d746-4745-a113-bcf1617f05f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq"
Jul 07 18:03:54.850719 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:54.850624    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/146477be-d746-4745-a113-bcf1617f05f1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2sldq\" (UID: \"146477be-d746-4745-a113-bcf1617f05f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq"
Jul 07 18:03:54.850719 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:54.850687    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr6g4\" (UniqueName: \"kubernetes.io/projected/146477be-d746-4745-a113-bcf1617f05f1-kube-api-access-gr6g4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2sldq\" (UID: \"146477be-d746-4745-a113-bcf1617f05f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq"
Jul 07 18:03:54.851102 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:54.851077    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/146477be-d746-4745-a113-bcf1617f05f1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2sldq\" (UID: \"146477be-d746-4745-a113-bcf1617f05f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq"
Jul 07 18:03:54.851180 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:54.851144    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/146477be-d746-4745-a113-bcf1617f05f1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2sldq\" (UID: \"146477be-d746-4745-a113-bcf1617f05f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq"
Jul 07 18:03:54.851221 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:54.851147    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/146477be-d746-4745-a113-bcf1617f05f1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2sldq\" (UID: \"146477be-d746-4745-a113-bcf1617f05f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq"
Jul 07 18:03:54.852987 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:54.852964    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/146477be-d746-4745-a113-bcf1617f05f1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2sldq\" (UID: \"146477be-d746-4745-a113-bcf1617f05f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq"
Jul 07 18:03:54.853238 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:54.853223    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/146477be-d746-4745-a113-bcf1617f05f1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2sldq\" (UID: \"146477be-d746-4745-a113-bcf1617f05f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq"
Jul 07 18:03:54.860296 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:54.860259    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr6g4\" (UniqueName: \"kubernetes.io/projected/146477be-d746-4745-a113-bcf1617f05f1-kube-api-access-gr6g4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2sldq\" (UID: \"146477be-d746-4745-a113-bcf1617f05f1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq"
Jul 07 18:03:54.955588 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:54.955505    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq"
Jul 07 18:03:55.092063 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:55.092038    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq"]
Jul 07 18:03:55.094045 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:03:55.094020    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod146477be_d746_4745_a113_bcf1617f05f1.slice/crio-a2ef00473851e6edb42987c074ba58a8f1ff1744f20540b1746e6bfec046c7f1 WatchSource:0}: Error finding container a2ef00473851e6edb42987c074ba58a8f1ff1744f20540b1746e6bfec046c7f1: Status 404 returned error can't find the container with id a2ef00473851e6edb42987c074ba58a8f1ff1744f20540b1746e6bfec046c7f1
Jul 07 18:03:55.095367 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:55.095351    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 18:03:55.570960 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:55.570815    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq" event={"ID":"146477be-d746-4745-a113-bcf1617f05f1","Type":"ContainerStarted","Data":"a2ef00473851e6edb42987c074ba58a8f1ff1744f20540b1746e6bfec046c7f1"}
Jul 07 18:03:56.577124 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:56.577090    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq" event={"ID":"146477be-d746-4745-a113-bcf1617f05f1","Type":"ContainerStarted","Data":"6edbf36a2dad1f4468e907a967be24ac6a51c75876933d0c4f2db9b3450a483b"}
Jul 07 18:03:56.598902 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:03:56.598847    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq" podStartSLOduration=1.331306119 podStartE2EDuration="2.598814889s" totalImagesPullingTime="1.26750877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:03:56.597343287 +0000 UTC m=+627.354904179" watchObservedRunningTime="2026-07-07 18:03:56.598814889 +0000 UTC m=+627.356375761"
Jul 07 18:04:04.955950 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:04:04.955904    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq"
Jul 07 18:04:04.956434 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:04:04.955973    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq"
Jul 07 18:04:04.968637 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:04:04.968602    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq"
Jul 07 18:04:05.633353 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:04:05.633317    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2sldq"
Jul 07 18:05:56.380629 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:56.380591    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7b8b6fd7c8-9lkzk"]
Jul 07 18:05:56.383813 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:56.383794    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b8b6fd7c8-9lkzk"
Jul 07 18:05:56.401783 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:56.401745    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b8b6fd7c8-9lkzk"]
Jul 07 18:05:56.578919 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:56.578877    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/633006b0-5ab9-4e1a-b365-381fba1043c7-tls-cert\") pod \"authorino-7b8b6fd7c8-9lkzk\" (UID: \"633006b0-5ab9-4e1a-b365-381fba1043c7\") " pod="kuadrant-system/authorino-7b8b6fd7c8-9lkzk"
Jul 07 18:05:56.579093 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:56.578932    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnbdf\" (UniqueName: \"kubernetes.io/projected/633006b0-5ab9-4e1a-b365-381fba1043c7-kube-api-access-pnbdf\") pod \"authorino-7b8b6fd7c8-9lkzk\" (UID: \"633006b0-5ab9-4e1a-b365-381fba1043c7\") " pod="kuadrant-system/authorino-7b8b6fd7c8-9lkzk"
Jul 07 18:05:56.680388 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:56.680299    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/633006b0-5ab9-4e1a-b365-381fba1043c7-tls-cert\") pod \"authorino-7b8b6fd7c8-9lkzk\" (UID: \"633006b0-5ab9-4e1a-b365-381fba1043c7\") " pod="kuadrant-system/authorino-7b8b6fd7c8-9lkzk"
Jul 07 18:05:56.680388 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:56.680353    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnbdf\" (UniqueName: \"kubernetes.io/projected/633006b0-5ab9-4e1a-b365-381fba1043c7-kube-api-access-pnbdf\") pod \"authorino-7b8b6fd7c8-9lkzk\" (UID: \"633006b0-5ab9-4e1a-b365-381fba1043c7\") " pod="kuadrant-system/authorino-7b8b6fd7c8-9lkzk"
Jul 07 18:05:56.682984 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:56.682962    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/633006b0-5ab9-4e1a-b365-381fba1043c7-tls-cert\") pod \"authorino-7b8b6fd7c8-9lkzk\" (UID: \"633006b0-5ab9-4e1a-b365-381fba1043c7\") " pod="kuadrant-system/authorino-7b8b6fd7c8-9lkzk"
Jul 07 18:05:56.700533 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:56.700499    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnbdf\" (UniqueName: \"kubernetes.io/projected/633006b0-5ab9-4e1a-b365-381fba1043c7-kube-api-access-pnbdf\") pod \"authorino-7b8b6fd7c8-9lkzk\" (UID: \"633006b0-5ab9-4e1a-b365-381fba1043c7\") " pod="kuadrant-system/authorino-7b8b6fd7c8-9lkzk"
Jul 07 18:05:56.992251 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:56.992220    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b8b6fd7c8-9lkzk"
Jul 07 18:05:57.129076 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:57.129040    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b8b6fd7c8-9lkzk"]
Jul 07 18:05:57.130991 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:05:57.130960    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod633006b0_5ab9_4e1a_b365_381fba1043c7.slice/crio-2bf67ab23eca24197a9ccccebce5321f64c81f783b06d5acbc5063e8edd04597 WatchSource:0}: Error finding container 2bf67ab23eca24197a9ccccebce5321f64c81f783b06d5acbc5063e8edd04597: Status 404 returned error can't find the container with id 2bf67ab23eca24197a9ccccebce5321f64c81f783b06d5acbc5063e8edd04597
Jul 07 18:05:57.147216 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:57.147182    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b8b6fd7c8-9lkzk" event={"ID":"633006b0-5ab9-4e1a-b365-381fba1043c7","Type":"ContainerStarted","Data":"2bf67ab23eca24197a9ccccebce5321f64c81f783b06d5acbc5063e8edd04597"}
Jul 07 18:05:58.155465 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:58.155354    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b8b6fd7c8-9lkzk" event={"ID":"633006b0-5ab9-4e1a-b365-381fba1043c7","Type":"ContainerStarted","Data":"485a2523f3920ae3b91ee7cd4334978cdfaf0e04833d5515956488ace83cbb7b"}
Jul 07 18:05:58.177846 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:58.177765    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7b8b6fd7c8-9lkzk" podStartSLOduration=1.550345882 podStartE2EDuration="2.177743171s" totalImagesPullingTime="627.397289ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:05:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:05:58.17481369 +0000 UTC m=+748.932374568" watchObservedRunningTime="2026-07-07 18:05:58.177743171 +0000 UTC m=+748.935304043"
Jul 07 18:05:58.225363 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:58.225325    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-664bfdcdf5-ppsrw"]
Jul 07 18:05:58.225545 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:58.225520    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-664bfdcdf5-ppsrw" podUID="6383e5c2-6d39-451e-be95-231698acbfb0" containerName="authorino" containerID="cri-o://c0c82019422f940e7acda846f8720f5e2dba4132436db85a63d1ee3f4fe69c17" gracePeriod=30
Jul 07 18:05:58.491781 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:58.491749    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-664bfdcdf5-ppsrw"
Jul 07 18:05:58.597211 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:58.597179    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6383e5c2-6d39-451e-be95-231698acbfb0-tls-cert\") pod \"6383e5c2-6d39-451e-be95-231698acbfb0\" (UID: \"6383e5c2-6d39-451e-be95-231698acbfb0\") "
Jul 07 18:05:58.597413 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:58.597263    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msz48\" (UniqueName: \"kubernetes.io/projected/6383e5c2-6d39-451e-be95-231698acbfb0-kube-api-access-msz48\") pod \"6383e5c2-6d39-451e-be95-231698acbfb0\" (UID: \"6383e5c2-6d39-451e-be95-231698acbfb0\") "
Jul 07 18:05:58.599997 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:58.599961    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6383e5c2-6d39-451e-be95-231698acbfb0-kube-api-access-msz48" (OuterVolumeSpecName: "kube-api-access-msz48") pod "6383e5c2-6d39-451e-be95-231698acbfb0" (UID: "6383e5c2-6d39-451e-be95-231698acbfb0"). InnerVolumeSpecName "kube-api-access-msz48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:05:58.608152 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:58.608121    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6383e5c2-6d39-451e-be95-231698acbfb0-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6383e5c2-6d39-451e-be95-231698acbfb0" (UID: "6383e5c2-6d39-451e-be95-231698acbfb0"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:05:58.698928 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:58.698887    2566 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6383e5c2-6d39-451e-be95-231698acbfb0-tls-cert\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:05:58.698928 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:58.698930    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msz48\" (UniqueName: \"kubernetes.io/projected/6383e5c2-6d39-451e-be95-231698acbfb0-kube-api-access-msz48\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:05:59.161767 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:59.161667    2566 generic.go:356] "Generic (PLEG): container finished" podID="6383e5c2-6d39-451e-be95-231698acbfb0" containerID="c0c82019422f940e7acda846f8720f5e2dba4132436db85a63d1ee3f4fe69c17" exitCode=0
Jul 07 18:05:59.161767 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:59.161712    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-664bfdcdf5-ppsrw"
Jul 07 18:05:59.161767 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:59.161746    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-664bfdcdf5-ppsrw" event={"ID":"6383e5c2-6d39-451e-be95-231698acbfb0","Type":"ContainerDied","Data":"c0c82019422f940e7acda846f8720f5e2dba4132436db85a63d1ee3f4fe69c17"}
Jul 07 18:05:59.162361 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:59.161789    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-664bfdcdf5-ppsrw" event={"ID":"6383e5c2-6d39-451e-be95-231698acbfb0","Type":"ContainerDied","Data":"5ed78c2cafd8fe3101c6a85b9d8f7336021297d662fa0adaeca8fc73d43c51f3"}
Jul 07 18:05:59.162361 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:59.161812    2566 scope.go:117] "RemoveContainer" containerID="c0c82019422f940e7acda846f8720f5e2dba4132436db85a63d1ee3f4fe69c17"
Jul 07 18:05:59.171984 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:59.171965    2566 scope.go:117] "RemoveContainer" containerID="c0c82019422f940e7acda846f8720f5e2dba4132436db85a63d1ee3f4fe69c17"
Jul 07 18:05:59.172249 ip-10-0-128-53 kubenswrapper[2566]: E0707 18:05:59.172232    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0c82019422f940e7acda846f8720f5e2dba4132436db85a63d1ee3f4fe69c17\": container with ID starting with c0c82019422f940e7acda846f8720f5e2dba4132436db85a63d1ee3f4fe69c17 not found: ID does not exist" containerID="c0c82019422f940e7acda846f8720f5e2dba4132436db85a63d1ee3f4fe69c17"
Jul 07 18:05:59.172295 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:59.172256    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0c82019422f940e7acda846f8720f5e2dba4132436db85a63d1ee3f4fe69c17"} err="failed to get container status \"c0c82019422f940e7acda846f8720f5e2dba4132436db85a63d1ee3f4fe69c17\": rpc error: code = NotFound desc = could not find container \"c0c82019422f940e7acda846f8720f5e2dba4132436db85a63d1ee3f4fe69c17\": container with ID starting with c0c82019422f940e7acda846f8720f5e2dba4132436db85a63d1ee3f4fe69c17 not found: ID does not exist"
Jul 07 18:05:59.186787 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:59.186729    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-664bfdcdf5-ppsrw"]
Jul 07 18:05:59.194975 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:59.189853    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-664bfdcdf5-ppsrw"]
Jul 07 18:05:59.801319 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:05:59.801287    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6383e5c2-6d39-451e-be95-231698acbfb0" path="/var/lib/kubelet/pods/6383e5c2-6d39-451e-be95-231698acbfb0/volumes"
Jul 07 18:07:11.075005 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:11.074968    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-889554864-gpqvq"]
Jul 07 18:07:11.075459 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:11.075161    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-889554864-gpqvq" podUID="ed2cd40d-6820-4b0e-b32a-664b378dff86" containerName="manager" containerID="cri-o://ecb748df32890550801d4a4ca5eb5d5905694de974bc2b21df78caedb9af8de5" gracePeriod=30
Jul 07 18:07:11.330793 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:11.330735    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-889554864-gpqvq"
Jul 07 18:07:11.398413 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:11.398383    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ed2cd40d-6820-4b0e-b32a-664b378dff86-webhook-cert\") pod \"ed2cd40d-6820-4b0e-b32a-664b378dff86\" (UID: \"ed2cd40d-6820-4b0e-b32a-664b378dff86\") "
Jul 07 18:07:11.398413 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:11.398417    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jg9l\" (UniqueName: \"kubernetes.io/projected/ed2cd40d-6820-4b0e-b32a-664b378dff86-kube-api-access-2jg9l\") pod \"ed2cd40d-6820-4b0e-b32a-664b378dff86\" (UID: \"ed2cd40d-6820-4b0e-b32a-664b378dff86\") "
Jul 07 18:07:11.400848 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:11.400792    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed2cd40d-6820-4b0e-b32a-664b378dff86-kube-api-access-2jg9l" (OuterVolumeSpecName: "kube-api-access-2jg9l") pod "ed2cd40d-6820-4b0e-b32a-664b378dff86" (UID: "ed2cd40d-6820-4b0e-b32a-664b378dff86"). InnerVolumeSpecName "kube-api-access-2jg9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:07:11.400848 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:11.400796    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed2cd40d-6820-4b0e-b32a-664b378dff86-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ed2cd40d-6820-4b0e-b32a-664b378dff86" (UID: "ed2cd40d-6820-4b0e-b32a-664b378dff86"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:07:11.499035 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:11.498996    2566 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ed2cd40d-6820-4b0e-b32a-664b378dff86-webhook-cert\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:07:11.499035 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:11.499033    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jg9l\" (UniqueName: \"kubernetes.io/projected/ed2cd40d-6820-4b0e-b32a-664b378dff86-kube-api-access-2jg9l\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:07:11.509454 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:11.509424    2566 generic.go:356] "Generic (PLEG): container finished" podID="ed2cd40d-6820-4b0e-b32a-664b378dff86" containerID="ecb748df32890550801d4a4ca5eb5d5905694de974bc2b21df78caedb9af8de5" exitCode=0
Jul 07 18:07:11.509598 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:11.509462    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-889554864-gpqvq" event={"ID":"ed2cd40d-6820-4b0e-b32a-664b378dff86","Type":"ContainerDied","Data":"ecb748df32890550801d4a4ca5eb5d5905694de974bc2b21df78caedb9af8de5"}
Jul 07 18:07:11.509598 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:11.509476    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-889554864-gpqvq"
Jul 07 18:07:11.509598 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:11.509501    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-889554864-gpqvq" event={"ID":"ed2cd40d-6820-4b0e-b32a-664b378dff86","Type":"ContainerDied","Data":"2da5e6f45a9eabb32d3875198f51d0e5570773cff56956408a4f43d572969845"}
Jul 07 18:07:11.509598 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:11.509526    2566 scope.go:117] "RemoveContainer" containerID="ecb748df32890550801d4a4ca5eb5d5905694de974bc2b21df78caedb9af8de5"
Jul 07 18:07:11.519032 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:11.519015    2566 scope.go:117] "RemoveContainer" containerID="ecb748df32890550801d4a4ca5eb5d5905694de974bc2b21df78caedb9af8de5"
Jul 07 18:07:11.519308 ip-10-0-128-53 kubenswrapper[2566]: E0707 18:07:11.519287    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecb748df32890550801d4a4ca5eb5d5905694de974bc2b21df78caedb9af8de5\": container with ID starting with ecb748df32890550801d4a4ca5eb5d5905694de974bc2b21df78caedb9af8de5 not found: ID does not exist" containerID="ecb748df32890550801d4a4ca5eb5d5905694de974bc2b21df78caedb9af8de5"
Jul 07 18:07:11.519353 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:11.519316    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecb748df32890550801d4a4ca5eb5d5905694de974bc2b21df78caedb9af8de5"} err="failed to get container status \"ecb748df32890550801d4a4ca5eb5d5905694de974bc2b21df78caedb9af8de5\": rpc error: code = NotFound desc = could not find container \"ecb748df32890550801d4a4ca5eb5d5905694de974bc2b21df78caedb9af8de5\": container with ID starting with ecb748df32890550801d4a4ca5eb5d5905694de974bc2b21df78caedb9af8de5 not found: ID does not exist"
Jul 07 18:07:11.534713 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:11.534681    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-889554864-gpqvq"]
Jul 07 18:07:11.539549 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:11.539527    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-889554864-gpqvq"]
Jul 07 18:07:11.801149 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:11.801114    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed2cd40d-6820-4b0e-b32a-664b378dff86" path="/var/lib/kubelet/pods/ed2cd40d-6820-4b0e-b32a-664b378dff86/volumes"
Jul 07 18:07:12.264768 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:12.264725    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-889554864-gpqvq" podUID="ed2cd40d-6820-4b0e-b32a-664b378dff86" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.34:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 18:07:12.342105 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:12.342071    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-889554864-vtnkt"]
Jul 07 18:07:12.342370 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:12.342359    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6383e5c2-6d39-451e-be95-231698acbfb0" containerName="authorino"
Jul 07 18:07:12.342411 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:12.342372    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6383e5c2-6d39-451e-be95-231698acbfb0" containerName="authorino"
Jul 07 18:07:12.342411 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:12.342394    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed2cd40d-6820-4b0e-b32a-664b378dff86" containerName="manager"
Jul 07 18:07:12.342411 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:12.342400    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed2cd40d-6820-4b0e-b32a-664b378dff86" containerName="manager"
Jul 07 18:07:12.342504 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:12.342443    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6383e5c2-6d39-451e-be95-231698acbfb0" containerName="authorino"
Jul 07 18:07:12.342504 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:12.342452    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed2cd40d-6820-4b0e-b32a-664b378dff86" containerName="manager"
Jul 07 18:07:12.346776 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:12.346759    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-889554864-vtnkt"
Jul 07 18:07:12.351550 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:12.351526    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 18:07:12.351668 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:12.351608    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-zc9xp\""
Jul 07 18:07:12.351668 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:12.351634    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 18:07:12.355770 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:12.355743    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-889554864-vtnkt"]
Jul 07 18:07:12.406747 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:12.406709    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfwnb\" (UniqueName: \"kubernetes.io/projected/04ff5f7b-2f0d-4fa7-8d94-74bc3d170d43-kube-api-access-pfwnb\") pod \"maas-controller-889554864-vtnkt\" (UID: \"04ff5f7b-2f0d-4fa7-8d94-74bc3d170d43\") " pod="opendatahub/maas-controller-889554864-vtnkt"
Jul 07 18:07:12.406939 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:12.406761    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04ff5f7b-2f0d-4fa7-8d94-74bc3d170d43-webhook-cert\") pod \"maas-controller-889554864-vtnkt\" (UID: \"04ff5f7b-2f0d-4fa7-8d94-74bc3d170d43\") " pod="opendatahub/maas-controller-889554864-vtnkt"
Jul 07 18:07:12.507747 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:12.507709    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfwnb\" (UniqueName: \"kubernetes.io/projected/04ff5f7b-2f0d-4fa7-8d94-74bc3d170d43-kube-api-access-pfwnb\") pod \"maas-controller-889554864-vtnkt\" (UID: \"04ff5f7b-2f0d-4fa7-8d94-74bc3d170d43\") " pod="opendatahub/maas-controller-889554864-vtnkt"
Jul 07 18:07:12.507747 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:12.507758    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04ff5f7b-2f0d-4fa7-8d94-74bc3d170d43-webhook-cert\") pod \"maas-controller-889554864-vtnkt\" (UID: \"04ff5f7b-2f0d-4fa7-8d94-74bc3d170d43\") " pod="opendatahub/maas-controller-889554864-vtnkt"
Jul 07 18:07:12.510356 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:12.510333    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04ff5f7b-2f0d-4fa7-8d94-74bc3d170d43-webhook-cert\") pod \"maas-controller-889554864-vtnkt\" (UID: \"04ff5f7b-2f0d-4fa7-8d94-74bc3d170d43\") " pod="opendatahub/maas-controller-889554864-vtnkt"
Jul 07 18:07:12.523941 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:12.523877    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfwnb\" (UniqueName: \"kubernetes.io/projected/04ff5f7b-2f0d-4fa7-8d94-74bc3d170d43-kube-api-access-pfwnb\") pod \"maas-controller-889554864-vtnkt\" (UID: \"04ff5f7b-2f0d-4fa7-8d94-74bc3d170d43\") " pod="opendatahub/maas-controller-889554864-vtnkt"
Jul 07 18:07:12.657316 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:12.657277    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-889554864-vtnkt"
Jul 07 18:07:12.798026 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:12.797999    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-889554864-vtnkt"]
Jul 07 18:07:12.799973 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:07:12.799940    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04ff5f7b_2f0d_4fa7_8d94_74bc3d170d43.slice/crio-404412d1f391a2585d93daf0b8ebff439bea4785e25b6d419a6d20d648f5988d WatchSource:0}: Error finding container 404412d1f391a2585d93daf0b8ebff439bea4785e25b6d419a6d20d648f5988d: Status 404 returned error can't find the container with id 404412d1f391a2585d93daf0b8ebff439bea4785e25b6d419a6d20d648f5988d
Jul 07 18:07:13.522197 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:13.522161    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-889554864-vtnkt" event={"ID":"04ff5f7b-2f0d-4fa7-8d94-74bc3d170d43","Type":"ContainerStarted","Data":"36509d5b861fb46c6a1fc689a9ab085a033f112cb30f1d0b0084a8758da5a8b9"}
Jul 07 18:07:13.522567 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:13.522217    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-889554864-vtnkt" event={"ID":"04ff5f7b-2f0d-4fa7-8d94-74bc3d170d43","Type":"ContainerStarted","Data":"404412d1f391a2585d93daf0b8ebff439bea4785e25b6d419a6d20d648f5988d"}
Jul 07 18:07:13.522567 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:13.522248    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-889554864-vtnkt"
Jul 07 18:07:13.543914 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:13.543855    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-889554864-vtnkt" podStartSLOduration=0.959970579 podStartE2EDuration="1.543839353s" totalImagesPullingTime="583.868774ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:07:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:07:13.541780605 +0000 UTC m=+824.299341507" watchObservedRunningTime="2026-07-07 18:07:13.543839353 +0000 UTC m=+824.301400215"
Jul 07 18:07:24.534186 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:07:24.534144    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-889554864-vtnkt"
Jul 07 18:08:29.737584 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:08:29.737498    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lcfnl_9bc45238-7341-43fe-a75f-231dbf7a3704/console-operator/1.log"
Jul 07 18:08:29.738287 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:08:29.738246    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lcfnl_9bc45238-7341-43fe-a75f-231dbf7a3704/console-operator/1.log"
Jul 07 18:13:29.768660 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:13:29.768627    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lcfnl_9bc45238-7341-43fe-a75f-231dbf7a3704/console-operator/1.log"
Jul 07 18:13:29.770111 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:13:29.770085    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lcfnl_9bc45238-7341-43fe-a75f-231dbf7a3704/console-operator/1.log"
Jul 07 18:15:00.168105 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:15:00.168064    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29724135-qcbqz"]
Jul 07 18:15:00.171479 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:15:00.171457    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724135-qcbqz"
Jul 07 18:15:00.175513 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:15:00.175494    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-9jzgv\""
Jul 07 18:15:00.195842 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:15:00.195803    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724135-qcbqz"]
Jul 07 18:15:00.249609 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:15:00.249570    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rtbg\" (UniqueName: \"kubernetes.io/projected/f435401c-28a9-4a57-b84f-9c1fc5e55cdf-kube-api-access-6rtbg\") pod \"maas-api-key-cleanup-29724135-qcbqz\" (UID: \"f435401c-28a9-4a57-b84f-9c1fc5e55cdf\") " pod="opendatahub/maas-api-key-cleanup-29724135-qcbqz"
Jul 07 18:15:00.350008 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:15:00.349974    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rtbg\" (UniqueName: \"kubernetes.io/projected/f435401c-28a9-4a57-b84f-9c1fc5e55cdf-kube-api-access-6rtbg\") pod \"maas-api-key-cleanup-29724135-qcbqz\" (UID: \"f435401c-28a9-4a57-b84f-9c1fc5e55cdf\") " pod="opendatahub/maas-api-key-cleanup-29724135-qcbqz"
Jul 07 18:15:00.360027 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:15:00.360000    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rtbg\" (UniqueName: \"kubernetes.io/projected/f435401c-28a9-4a57-b84f-9c1fc5e55cdf-kube-api-access-6rtbg\") pod \"maas-api-key-cleanup-29724135-qcbqz\" (UID: \"f435401c-28a9-4a57-b84f-9c1fc5e55cdf\") " pod="opendatahub/maas-api-key-cleanup-29724135-qcbqz"
Jul 07 18:15:00.480943 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:15:00.480912    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724135-qcbqz"
Jul 07 18:15:00.615530 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:15:00.615489    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724135-qcbqz"]
Jul 07 18:15:00.617772 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:15:00.617737    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf435401c_28a9_4a57_b84f_9c1fc5e55cdf.slice/crio-e5a2311c009864227bbb2736ea93143d16bc63adcf337a75e0f23644a76f1d48 WatchSource:0}: Error finding container e5a2311c009864227bbb2736ea93143d16bc63adcf337a75e0f23644a76f1d48: Status 404 returned error can't find the container with id e5a2311c009864227bbb2736ea93143d16bc63adcf337a75e0f23644a76f1d48
Jul 07 18:15:00.619586 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:15:00.619567    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 18:15:00.739413 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:15:00.739320    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724135-qcbqz" event={"ID":"f435401c-28a9-4a57-b84f-9c1fc5e55cdf","Type":"ContainerStarted","Data":"e5a2311c009864227bbb2736ea93143d16bc63adcf337a75e0f23644a76f1d48"}
Jul 07 18:15:03.755701 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:15:03.755657    2566 generic.go:356] "Generic (PLEG): container finished" podID="f435401c-28a9-4a57-b84f-9c1fc5e55cdf" containerID="253fb005c344906829395574c08c464ae8e0d317849414d47fb154c87f08ff19" exitCode=0
Jul 07 18:15:03.756124 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:15:03.755743    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724135-qcbqz" event={"ID":"f435401c-28a9-4a57-b84f-9c1fc5e55cdf","Type":"ContainerDied","Data":"253fb005c344906829395574c08c464ae8e0d317849414d47fb154c87f08ff19"}
Jul 07 18:15:04.893500 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:15:04.893477    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724135-qcbqz"
Jul 07 18:15:04.990963 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:15:04.990932    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rtbg\" (UniqueName: \"kubernetes.io/projected/f435401c-28a9-4a57-b84f-9c1fc5e55cdf-kube-api-access-6rtbg\") pod \"f435401c-28a9-4a57-b84f-9c1fc5e55cdf\" (UID: \"f435401c-28a9-4a57-b84f-9c1fc5e55cdf\") "
Jul 07 18:15:04.993064 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:15:04.993038    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f435401c-28a9-4a57-b84f-9c1fc5e55cdf-kube-api-access-6rtbg" (OuterVolumeSpecName: "kube-api-access-6rtbg") pod "f435401c-28a9-4a57-b84f-9c1fc5e55cdf" (UID: "f435401c-28a9-4a57-b84f-9c1fc5e55cdf"). InnerVolumeSpecName "kube-api-access-6rtbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:15:05.091711 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:15:05.091622    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rtbg\" (UniqueName: \"kubernetes.io/projected/f435401c-28a9-4a57-b84f-9c1fc5e55cdf-kube-api-access-6rtbg\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:15:05.771394 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:15:05.771365    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724135-qcbqz"
Jul 07 18:15:05.771659 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:15:05.771409    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724135-qcbqz" event={"ID":"f435401c-28a9-4a57-b84f-9c1fc5e55cdf","Type":"ContainerDied","Data":"e5a2311c009864227bbb2736ea93143d16bc63adcf337a75e0f23644a76f1d48"}
Jul 07 18:15:05.771659 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:15:05.771488    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e5a2311c009864227bbb2736ea93143d16bc63adcf337a75e0f23644a76f1d48"
Jul 07 18:18:29.801005 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:18:29.800977    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lcfnl_9bc45238-7341-43fe-a75f-231dbf7a3704/console-operator/1.log"
Jul 07 18:18:29.807271 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:18:29.807248    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lcfnl_9bc45238-7341-43fe-a75f-231dbf7a3704/console-operator/1.log"
Jul 07 18:23:08.894966 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:08.894925    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"]
Jul 07 18:23:08.895463 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:08.895241    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f435401c-28a9-4a57-b84f-9c1fc5e55cdf" containerName="cleanup"
Jul 07 18:23:08.895463 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:08.895253    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f435401c-28a9-4a57-b84f-9c1fc5e55cdf" containerName="cleanup"
Jul 07 18:23:08.895463 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:08.895317    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f435401c-28a9-4a57-b84f-9c1fc5e55cdf" containerName="cleanup"
Jul 07 18:23:08.897923 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:08.897907    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"
Jul 07 18:23:08.903967 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:08.903943    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-ab291522\"/\"default-dockercfg-lng5h\""
Jul 07 18:23:08.904117 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:08.903945    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-ab291522\"/\"kube-root-ca.crt\""
Jul 07 18:23:08.904117 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:08.903981    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-ab291522\"/\"openshift-service-ca.crt\""
Jul 07 18:23:08.904117 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:08.903981    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-ab291522\"/\"e2e-lifecycle-model-ab291522-kserve-self-signed-certs\""
Jul 07 18:23:08.949766 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:08.949731    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"]
Jul 07 18:23:09.021891 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:09.021845    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d02234f2-30f3-4a70-9aae-64a80c361e4b-tls-certs\") pod \"e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7\" (UID: \"d02234f2-30f3-4a70-9aae-64a80c361e4b\") " pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"
Jul 07 18:23:09.022076 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:09.021919    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d02234f2-30f3-4a70-9aae-64a80c361e4b-dshm\") pod \"e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7\" (UID: \"d02234f2-30f3-4a70-9aae-64a80c361e4b\") " pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"
Jul 07 18:23:09.022076 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:09.021947    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lb7v\" (UniqueName: \"kubernetes.io/projected/d02234f2-30f3-4a70-9aae-64a80c361e4b-kube-api-access-6lb7v\") pod \"e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7\" (UID: \"d02234f2-30f3-4a70-9aae-64a80c361e4b\") " pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"
Jul 07 18:23:09.022076 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:09.021985    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d02234f2-30f3-4a70-9aae-64a80c361e4b-tmp-dir\") pod \"e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7\" (UID: \"d02234f2-30f3-4a70-9aae-64a80c361e4b\") " pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"
Jul 07 18:23:09.022076 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:09.022008    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d02234f2-30f3-4a70-9aae-64a80c361e4b-home\") pod \"e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7\" (UID: \"d02234f2-30f3-4a70-9aae-64a80c361e4b\") " pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"
Jul 07 18:23:09.022076 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:09.022028    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d02234f2-30f3-4a70-9aae-64a80c361e4b-model-cache\") pod \"e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7\" (UID: \"d02234f2-30f3-4a70-9aae-64a80c361e4b\") " pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"
Jul 07 18:23:09.123279 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:09.123249    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d02234f2-30f3-4a70-9aae-64a80c361e4b-dshm\") pod \"e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7\" (UID: \"d02234f2-30f3-4a70-9aae-64a80c361e4b\") " pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"
Jul 07 18:23:09.123474 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:09.123290    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lb7v\" (UniqueName: \"kubernetes.io/projected/d02234f2-30f3-4a70-9aae-64a80c361e4b-kube-api-access-6lb7v\") pod \"e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7\" (UID: \"d02234f2-30f3-4a70-9aae-64a80c361e4b\") " pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"
Jul 07 18:23:09.123474 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:09.123334    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d02234f2-30f3-4a70-9aae-64a80c361e4b-tmp-dir\") pod \"e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7\" (UID: \"d02234f2-30f3-4a70-9aae-64a80c361e4b\") " pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"
Jul 07 18:23:09.123474 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:09.123354    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d02234f2-30f3-4a70-9aae-64a80c361e4b-home\") pod \"e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7\" (UID: \"d02234f2-30f3-4a70-9aae-64a80c361e4b\") " pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"
Jul 07 18:23:09.123474 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:09.123371    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d02234f2-30f3-4a70-9aae-64a80c361e4b-model-cache\") pod \"e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7\" (UID: \"d02234f2-30f3-4a70-9aae-64a80c361e4b\") " pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"
Jul 07 18:23:09.123474 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:09.123410    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d02234f2-30f3-4a70-9aae-64a80c361e4b-tls-certs\") pod \"e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7\" (UID: \"d02234f2-30f3-4a70-9aae-64a80c361e4b\") " pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"
Jul 07 18:23:09.123809 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:09.123784    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d02234f2-30f3-4a70-9aae-64a80c361e4b-tmp-dir\") pod \"e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7\" (UID: \"d02234f2-30f3-4a70-9aae-64a80c361e4b\") " pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"
Jul 07 18:23:09.123916 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:09.123796    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d02234f2-30f3-4a70-9aae-64a80c361e4b-model-cache\") pod \"e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7\" (UID: \"d02234f2-30f3-4a70-9aae-64a80c361e4b\") " pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"
Jul 07 18:23:09.123976 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:09.123923    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d02234f2-30f3-4a70-9aae-64a80c361e4b-home\") pod \"e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7\" (UID: \"d02234f2-30f3-4a70-9aae-64a80c361e4b\") " pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"
Jul 07 18:23:09.125768 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:09.125749    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d02234f2-30f3-4a70-9aae-64a80c361e4b-dshm\") pod \"e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7\" (UID: \"d02234f2-30f3-4a70-9aae-64a80c361e4b\") " pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"
Jul 07 18:23:09.126082 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:09.126065    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d02234f2-30f3-4a70-9aae-64a80c361e4b-tls-certs\") pod \"e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7\" (UID: \"d02234f2-30f3-4a70-9aae-64a80c361e4b\") " pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"
Jul 07 18:23:09.133572 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:09.133548    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lb7v\" (UniqueName: \"kubernetes.io/projected/d02234f2-30f3-4a70-9aae-64a80c361e4b-kube-api-access-6lb7v\") pod \"e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7\" (UID: \"d02234f2-30f3-4a70-9aae-64a80c361e4b\") " pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"
Jul 07 18:23:09.207006 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:09.206974    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"
Jul 07 18:23:09.359080 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:09.359047    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"]
Jul 07 18:23:09.362050 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:23:09.362021    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd02234f2_30f3_4a70_9aae_64a80c361e4b.slice/crio-41cd1ed918e937f13b0aef4a7d15bb16e357252c880375de665603566f6f2373 WatchSource:0}: Error finding container 41cd1ed918e937f13b0aef4a7d15bb16e357252c880375de665603566f6f2373: Status 404 returned error can't find the container with id 41cd1ed918e937f13b0aef4a7d15bb16e357252c880375de665603566f6f2373
Jul 07 18:23:10.058784 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:10.058748    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7" event={"ID":"d02234f2-30f3-4a70-9aae-64a80c361e4b","Type":"ContainerStarted","Data":"cefab64cde3269c6f4f5fe273dd2a9ae3a024141920df7635778f4bd06640e59"}
Jul 07 18:23:10.059181 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:10.058796    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7" event={"ID":"d02234f2-30f3-4a70-9aae-64a80c361e4b","Type":"ContainerStarted","Data":"41cd1ed918e937f13b0aef4a7d15bb16e357252c880375de665603566f6f2373"}
Jul 07 18:23:10.081092 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:10.081038    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7" podStartSLOduration=2.0810234420000002 podStartE2EDuration="2.081023442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:23:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:23:10.078194109 +0000 UTC m=+1780.835754979" watchObservedRunningTime="2026-07-07 18:23:10.081023442 +0000 UTC m=+1780.838584312"
Jul 07 18:23:19.208153 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:19.208114    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"
Jul 07 18:23:19.208601 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:19.208163    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"
Jul 07 18:23:19.220142 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:19.220119    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"
Jul 07 18:23:20.115951 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:20.115922    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"
Jul 07 18:23:29.842147 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:29.842033    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lcfnl_9bc45238-7341-43fe-a75f-231dbf7a3704/console-operator/1.log"
Jul 07 18:23:29.857582 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:29.848989    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lcfnl_9bc45238-7341-43fe-a75f-231dbf7a3704/console-operator/1.log"
Jul 07 18:23:39.988259 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:39.988225    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"]
Jul 07 18:23:55.008961 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.008893    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7" podUID="d02234f2-30f3-4a70-9aae-64a80c361e4b" containerName="main" containerID="cri-o://cefab64cde3269c6f4f5fe273dd2a9ae3a024141920df7635778f4bd06640e59" gracePeriod=45
Jul 07 18:23:55.249382 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.249354    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"
Jul 07 18:23:55.282346 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.282264    2566 generic.go:356] "Generic (PLEG): container finished" podID="d02234f2-30f3-4a70-9aae-64a80c361e4b" containerID="cefab64cde3269c6f4f5fe273dd2a9ae3a024141920df7635778f4bd06640e59" exitCode=0
Jul 07 18:23:55.282346 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.282306    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"
Jul 07 18:23:55.282520 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.282337    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7" event={"ID":"d02234f2-30f3-4a70-9aae-64a80c361e4b","Type":"ContainerDied","Data":"cefab64cde3269c6f4f5fe273dd2a9ae3a024141920df7635778f4bd06640e59"}
Jul 07 18:23:55.282520 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.282394    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7" event={"ID":"d02234f2-30f3-4a70-9aae-64a80c361e4b","Type":"ContainerDied","Data":"41cd1ed918e937f13b0aef4a7d15bb16e357252c880375de665603566f6f2373"}
Jul 07 18:23:55.282520 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.282419    2566 scope.go:117] "RemoveContainer" containerID="cefab64cde3269c6f4f5fe273dd2a9ae3a024141920df7635778f4bd06640e59"
Jul 07 18:23:55.293190 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.293168    2566 scope.go:117] "RemoveContainer" containerID="cefab64cde3269c6f4f5fe273dd2a9ae3a024141920df7635778f4bd06640e59"
Jul 07 18:23:55.293547 ip-10-0-128-53 kubenswrapper[2566]: E0707 18:23:55.293508    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cefab64cde3269c6f4f5fe273dd2a9ae3a024141920df7635778f4bd06640e59\": container with ID starting with cefab64cde3269c6f4f5fe273dd2a9ae3a024141920df7635778f4bd06640e59 not found: ID does not exist" containerID="cefab64cde3269c6f4f5fe273dd2a9ae3a024141920df7635778f4bd06640e59"
Jul 07 18:23:55.293625 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.293561    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cefab64cde3269c6f4f5fe273dd2a9ae3a024141920df7635778f4bd06640e59"} err="failed to get container status \"cefab64cde3269c6f4f5fe273dd2a9ae3a024141920df7635778f4bd06640e59\": rpc error: code = NotFound desc = could not find container \"cefab64cde3269c6f4f5fe273dd2a9ae3a024141920df7635778f4bd06640e59\": container with ID starting with cefab64cde3269c6f4f5fe273dd2a9ae3a024141920df7635778f4bd06640e59 not found: ID does not exist"
Jul 07 18:23:55.310985 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.310945    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d02234f2-30f3-4a70-9aae-64a80c361e4b-tmp-dir\") pod \"d02234f2-30f3-4a70-9aae-64a80c361e4b\" (UID: \"d02234f2-30f3-4a70-9aae-64a80c361e4b\") "
Jul 07 18:23:55.311162 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.311003    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lb7v\" (UniqueName: \"kubernetes.io/projected/d02234f2-30f3-4a70-9aae-64a80c361e4b-kube-api-access-6lb7v\") pod \"d02234f2-30f3-4a70-9aae-64a80c361e4b\" (UID: \"d02234f2-30f3-4a70-9aae-64a80c361e4b\") "
Jul 07 18:23:55.311162 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.311037    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d02234f2-30f3-4a70-9aae-64a80c361e4b-home\") pod \"d02234f2-30f3-4a70-9aae-64a80c361e4b\" (UID: \"d02234f2-30f3-4a70-9aae-64a80c361e4b\") "
Jul 07 18:23:55.311162 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.311091    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d02234f2-30f3-4a70-9aae-64a80c361e4b-model-cache\") pod \"d02234f2-30f3-4a70-9aae-64a80c361e4b\" (UID: \"d02234f2-30f3-4a70-9aae-64a80c361e4b\") "
Jul 07 18:23:55.311162 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.311140    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d02234f2-30f3-4a70-9aae-64a80c361e4b-tls-certs\") pod \"d02234f2-30f3-4a70-9aae-64a80c361e4b\" (UID: \"d02234f2-30f3-4a70-9aae-64a80c361e4b\") "
Jul 07 18:23:55.311375 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.311169    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d02234f2-30f3-4a70-9aae-64a80c361e4b-dshm\") pod \"d02234f2-30f3-4a70-9aae-64a80c361e4b\" (UID: \"d02234f2-30f3-4a70-9aae-64a80c361e4b\") "
Jul 07 18:23:55.311375 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.311285    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d02234f2-30f3-4a70-9aae-64a80c361e4b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d02234f2-30f3-4a70-9aae-64a80c361e4b" (UID: "d02234f2-30f3-4a70-9aae-64a80c361e4b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:23:55.311375 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.311360    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d02234f2-30f3-4a70-9aae-64a80c361e4b-home" (OuterVolumeSpecName: "home") pod "d02234f2-30f3-4a70-9aae-64a80c361e4b" (UID: "d02234f2-30f3-4a70-9aae-64a80c361e4b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:23:55.311530 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.311381    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d02234f2-30f3-4a70-9aae-64a80c361e4b-model-cache" (OuterVolumeSpecName: "model-cache") pod "d02234f2-30f3-4a70-9aae-64a80c361e4b" (UID: "d02234f2-30f3-4a70-9aae-64a80c361e4b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:23:55.311530 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.311423    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d02234f2-30f3-4a70-9aae-64a80c361e4b-tmp-dir\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:23:55.313574 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.313534    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d02234f2-30f3-4a70-9aae-64a80c361e4b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d02234f2-30f3-4a70-9aae-64a80c361e4b" (UID: "d02234f2-30f3-4a70-9aae-64a80c361e4b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:23:55.313716 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.313582    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d02234f2-30f3-4a70-9aae-64a80c361e4b-kube-api-access-6lb7v" (OuterVolumeSpecName: "kube-api-access-6lb7v") pod "d02234f2-30f3-4a70-9aae-64a80c361e4b" (UID: "d02234f2-30f3-4a70-9aae-64a80c361e4b"). InnerVolumeSpecName "kube-api-access-6lb7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:23:55.313716 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.313607    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d02234f2-30f3-4a70-9aae-64a80c361e4b-dshm" (OuterVolumeSpecName: "dshm") pod "d02234f2-30f3-4a70-9aae-64a80c361e4b" (UID: "d02234f2-30f3-4a70-9aae-64a80c361e4b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:23:55.411942 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.411907    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d02234f2-30f3-4a70-9aae-64a80c361e4b-tls-certs\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:23:55.411942 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.411935    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d02234f2-30f3-4a70-9aae-64a80c361e4b-dshm\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:23:55.411942 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.411945    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lb7v\" (UniqueName: \"kubernetes.io/projected/d02234f2-30f3-4a70-9aae-64a80c361e4b-kube-api-access-6lb7v\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:23:55.411942 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.411953    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d02234f2-30f3-4a70-9aae-64a80c361e4b-home\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:23:55.412203 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.411961    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d02234f2-30f3-4a70-9aae-64a80c361e4b-model-cache\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:23:55.607268 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.607236    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"]
Jul 07 18:23:55.611312 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.611279    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-ab291522/e2e-lifecycle-model-ab291522-kserve-665cd79979-p8ds7"]
Jul 07 18:23:55.801372 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:23:55.801341    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d02234f2-30f3-4a70-9aae-64a80c361e4b" path="/var/lib/kubelet/pods/d02234f2-30f3-4a70-9aae-64a80c361e4b/volumes"
Jul 07 18:25:33.014359 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.014327    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"]
Jul 07 18:25:33.014776 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.014628    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d02234f2-30f3-4a70-9aae-64a80c361e4b" containerName="main"
Jul 07 18:25:33.014776 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.014639    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d02234f2-30f3-4a70-9aae-64a80c361e4b" containerName="main"
Jul 07 18:25:33.014776 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.014701    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d02234f2-30f3-4a70-9aae-64a80c361e4b" containerName="main"
Jul 07 18:25:33.017591 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.017576    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.021442 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.021421    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 18:25:33.021675 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.021659    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-8481d0-openshift-default-dockercfg-745zv\""
Jul 07 18:25:33.035195 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.035172    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"]
Jul 07 18:25:33.105499 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.105464    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmg88\" (UniqueName: \"kubernetes.io/projected/72387232-685f-42e5-9c3e-55faf78940b4-kube-api-access-bmg88\") pod \"e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") " pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.105667 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.105525    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72387232-685f-42e5-9c3e-55faf78940b4-istiod-ca-cert\") pod \"e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") " pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.105667 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.105584    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-workload-socket\") pod \"e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") " pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.105667 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.105604    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-workload-certs\") pod \"e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") " pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.105667 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.105652    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-istio-envoy\") pod \"e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") " pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.105806 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.105670    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72387232-685f-42e5-9c3e-55faf78940b4-istio-token\") pod \"e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") " pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.105806 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.105688    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72387232-685f-42e5-9c3e-55faf78940b4-istio-podinfo\") pod \"e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") " pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.105806 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.105707    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-credential-socket\") pod \"e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") " pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.105806 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.105724    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-istio-data\") pod \"e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") " pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.206092 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.206058    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-istio-data\") pod \"e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") " pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.206254 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.206102    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmg88\" (UniqueName: \"kubernetes.io/projected/72387232-685f-42e5-9c3e-55faf78940b4-kube-api-access-bmg88\") pod \"e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") " pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.206254 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.206128    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72387232-685f-42e5-9c3e-55faf78940b4-istiod-ca-cert\") pod \"e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") " pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.206254 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.206152    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-workload-socket\") pod \"e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") " pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.206370 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.206267    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-workload-certs\") pod \"e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") " pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.206411 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.206381    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-istio-envoy\") pod \"e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") " pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.206450 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.206417    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72387232-685f-42e5-9c3e-55faf78940b4-istio-token\") pod \"e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") " pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.206450 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.206445    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72387232-685f-42e5-9c3e-55faf78940b4-istio-podinfo\") pod \"e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") " pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.206550 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.206479    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-credential-socket\") pod \"e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") " pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.206550 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.206510    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-istio-data\") pod \"e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") " pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.206651 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.206558    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-workload-socket\") pod \"e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") " pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.206651 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.206623    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-workload-certs\") pod \"e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") " pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.206933 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.206901    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-credential-socket\") pod \"e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") " pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.207006 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.206917    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72387232-685f-42e5-9c3e-55faf78940b4-istiod-ca-cert\") pod \"e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") " pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.208817 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.208796    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-istio-envoy\") pod \"e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") " pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.209127 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.209109    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72387232-685f-42e5-9c3e-55faf78940b4-istio-podinfo\") pod \"e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") " pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.222528 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.222495    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmg88\" (UniqueName: \"kubernetes.io/projected/72387232-685f-42e5-9c3e-55faf78940b4-kube-api-access-bmg88\") pod \"e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") " pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.223798 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.223777    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72387232-685f-42e5-9c3e-55faf78940b4-istio-token\") pod \"e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") " pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.327850 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.327749    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:33.483722 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.483692    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"]
Jul 07 18:25:33.485863 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:25:33.485798    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72387232_685f_42e5_9c3e_55faf78940b4.slice/crio-9f42e63853b67b0a92e27c0a41e8503b67183a5820606fc8c2bde53e873f81cc WatchSource:0}: Error finding container 9f42e63853b67b0a92e27c0a41e8503b67183a5820606fc8c2bde53e873f81cc: Status 404 returned error can't find the container with id 9f42e63853b67b0a92e27c0a41e8503b67183a5820606fc8c2bde53e873f81cc
Jul 07 18:25:33.487814 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.487800    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 18:25:33.750135 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:33.750103    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l" event={"ID":"72387232-685f-42e5-9c3e-55faf78940b4","Type":"ContainerStarted","Data":"9f42e63853b67b0a92e27c0a41e8503b67183a5820606fc8c2bde53e873f81cc"}
Jul 07 18:25:36.058251 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:36.058210    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 18:25:36.058651 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:36.058297    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 18:25:36.058651 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:36.058343    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 18:25:36.767306 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:36.767265    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l" event={"ID":"72387232-685f-42e5-9c3e-55faf78940b4","Type":"ContainerStarted","Data":"13aa0df8672f480a4bb70d2638443d19335209ccda13f8e239babcf78341f91c"}
Jul 07 18:25:36.794688 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:36.794637    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l" podStartSLOduration=2.224679217 podStartE2EDuration="4.79462372s" totalImagesPullingTime="2.569944503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:25:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:25:36.793396211 +0000 UTC m=+1927.550957082" watchObservedRunningTime="2026-07-07 18:25:36.79462372 +0000 UTC m=+1927.552184591"
Jul 07 18:25:37.328849 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:37.328796    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:37.333494 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:37.333470    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:37.771880 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:37.771851    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:37.772793 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:37.772775    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:52.773452 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:52.773420    2566 patch_prober.go:28] interesting pod/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 07 18:25:52.773771 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:52.773482    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l" podUID="72387232-685f-42e5-9c3e-55faf78940b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 07 18:25:52.846443 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:52.846411    2566 generic.go:356] "Generic (PLEG): container finished" podID="72387232-685f-42e5-9c3e-55faf78940b4" containerID="13aa0df8672f480a4bb70d2638443d19335209ccda13f8e239babcf78341f91c" exitCode=0
Jul 07 18:25:52.846560 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:52.846480    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l" event={"ID":"72387232-685f-42e5-9c3e-55faf78940b4","Type":"ContainerDied","Data":"13aa0df8672f480a4bb70d2638443d19335209ccda13f8e239babcf78341f91c"}
Jul 07 18:25:52.846859 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:52.846846    2566 scope.go:117] "RemoveContainer" containerID="13aa0df8672f480a4bb70d2638443d19335209ccda13f8e239babcf78341f91c"
Jul 07 18:25:52.850218 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:52.849934    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 18:25:52.850218 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:52.850055    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 18:25:52.850218 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:52.850096    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 18:25:53.853705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:53.853671    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l" event={"ID":"72387232-685f-42e5-9c3e-55faf78940b4","Type":"ContainerStarted","Data":"2273054856c063a7e84eaee340fdba19e9b68599427070e6b937db4e5bd93033"}
Jul 07 18:25:54.328510 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:54.328476    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:54.328670 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:54.328629    2566 patch_prober.go:28] interesting pod/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 07 18:25:54.328712 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:54.328670    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l" podUID="72387232-685f-42e5-9c3e-55faf78940b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 07 18:25:55.328375 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:55.328336    2566 patch_prober.go:28] interesting pod/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 07 18:25:55.328766 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:55.328394    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l" podUID="72387232-685f-42e5-9c3e-55faf78940b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 07 18:25:56.328156 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:56.328117    2566 patch_prober.go:28] interesting pod/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 07 18:25:56.328344 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:56.328174    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l" podUID="72387232-685f-42e5-9c3e-55faf78940b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 07 18:25:57.328465 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:57.328430    2566 patch_prober.go:28] interesting pod/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 07 18:25:57.328875 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:57.328493    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l" podUID="72387232-685f-42e5-9c3e-55faf78940b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 07 18:25:58.328748 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:58.328710    2566 patch_prober.go:28] interesting pod/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 07 18:25:58.329154 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:58.328781    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l" podUID="72387232-685f-42e5-9c3e-55faf78940b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 07 18:25:59.332074 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:59.332044    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:59.332505 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:59.332354    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:25:59.333034 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:25:59.333005    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:26:00.642971 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:00.642936    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"]
Jul 07 18:26:00.650408 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:00.650387    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"
Jul 07 18:26:00.653311 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:00.653290    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2ac3c6\"/\"kube-root-ca.crt\""
Jul 07 18:26:00.654478 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:00.654452    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2ac3c6\"/\"test-model-2ac3c6-kserve-self-signed-certs\""
Jul 07 18:26:00.654478 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:00.654473    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2ac3c6\"/\"openshift-service-ca.crt\""
Jul 07 18:26:00.654654 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:00.654535    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2ac3c6\"/\"default-dockercfg-tkcpt\""
Jul 07 18:26:00.657962 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:00.657941    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"]
Jul 07 18:26:00.741140 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:00.741104    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57aeca72-f43d-409e-a866-601a5e6b9443-model-cache\") pod \"test-model-2ac3c6-kserve-65766f4857-626nx\" (UID: \"57aeca72-f43d-409e-a866-601a5e6b9443\") " pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"
Jul 07 18:26:00.741140 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:00.741143    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57aeca72-f43d-409e-a866-601a5e6b9443-dshm\") pod \"test-model-2ac3c6-kserve-65766f4857-626nx\" (UID: \"57aeca72-f43d-409e-a866-601a5e6b9443\") " pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"
Jul 07 18:26:00.741406 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:00.741177    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8hzz\" (UniqueName: \"kubernetes.io/projected/57aeca72-f43d-409e-a866-601a5e6b9443-kube-api-access-c8hzz\") pod \"test-model-2ac3c6-kserve-65766f4857-626nx\" (UID: \"57aeca72-f43d-409e-a866-601a5e6b9443\") " pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"
Jul 07 18:26:00.741406 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:00.741201    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57aeca72-f43d-409e-a866-601a5e6b9443-tmp-dir\") pod \"test-model-2ac3c6-kserve-65766f4857-626nx\" (UID: \"57aeca72-f43d-409e-a866-601a5e6b9443\") " pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"
Jul 07 18:26:00.741406 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:00.741225    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57aeca72-f43d-409e-a866-601a5e6b9443-home\") pod \"test-model-2ac3c6-kserve-65766f4857-626nx\" (UID: \"57aeca72-f43d-409e-a866-601a5e6b9443\") " pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"
Jul 07 18:26:00.741406 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:00.741274    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57aeca72-f43d-409e-a866-601a5e6b9443-tls-certs\") pod \"test-model-2ac3c6-kserve-65766f4857-626nx\" (UID: \"57aeca72-f43d-409e-a866-601a5e6b9443\") " pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"
Jul 07 18:26:00.841638 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:00.841605    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57aeca72-f43d-409e-a866-601a5e6b9443-model-cache\") pod \"test-model-2ac3c6-kserve-65766f4857-626nx\" (UID: \"57aeca72-f43d-409e-a866-601a5e6b9443\") " pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"
Jul 07 18:26:00.841638 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:00.841642    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57aeca72-f43d-409e-a866-601a5e6b9443-dshm\") pod \"test-model-2ac3c6-kserve-65766f4857-626nx\" (UID: \"57aeca72-f43d-409e-a866-601a5e6b9443\") " pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"
Jul 07 18:26:00.841919 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:00.841673    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8hzz\" (UniqueName: \"kubernetes.io/projected/57aeca72-f43d-409e-a866-601a5e6b9443-kube-api-access-c8hzz\") pod \"test-model-2ac3c6-kserve-65766f4857-626nx\" (UID: \"57aeca72-f43d-409e-a866-601a5e6b9443\") " pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"
Jul 07 18:26:00.841919 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:00.841694    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57aeca72-f43d-409e-a866-601a5e6b9443-tmp-dir\") pod \"test-model-2ac3c6-kserve-65766f4857-626nx\" (UID: \"57aeca72-f43d-409e-a866-601a5e6b9443\") " pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"
Jul 07 18:26:00.841919 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:00.841716    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57aeca72-f43d-409e-a866-601a5e6b9443-home\") pod \"test-model-2ac3c6-kserve-65766f4857-626nx\" (UID: \"57aeca72-f43d-409e-a866-601a5e6b9443\") " pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"
Jul 07 18:26:00.841919 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:00.841737    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57aeca72-f43d-409e-a866-601a5e6b9443-tls-certs\") pod \"test-model-2ac3c6-kserve-65766f4857-626nx\" (UID: \"57aeca72-f43d-409e-a866-601a5e6b9443\") " pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"
Jul 07 18:26:00.842156 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:00.842132    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57aeca72-f43d-409e-a866-601a5e6b9443-model-cache\") pod \"test-model-2ac3c6-kserve-65766f4857-626nx\" (UID: \"57aeca72-f43d-409e-a866-601a5e6b9443\") " pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"
Jul 07 18:26:00.842219 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:00.842155    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57aeca72-f43d-409e-a866-601a5e6b9443-tmp-dir\") pod \"test-model-2ac3c6-kserve-65766f4857-626nx\" (UID: \"57aeca72-f43d-409e-a866-601a5e6b9443\") " pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"
Jul 07 18:26:00.842275 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:00.842252    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57aeca72-f43d-409e-a866-601a5e6b9443-home\") pod \"test-model-2ac3c6-kserve-65766f4857-626nx\" (UID: \"57aeca72-f43d-409e-a866-601a5e6b9443\") " pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"
Jul 07 18:26:00.844207 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:00.844185    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57aeca72-f43d-409e-a866-601a5e6b9443-dshm\") pod \"test-model-2ac3c6-kserve-65766f4857-626nx\" (UID: \"57aeca72-f43d-409e-a866-601a5e6b9443\") " pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"
Jul 07 18:26:00.844463 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:00.844445    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57aeca72-f43d-409e-a866-601a5e6b9443-tls-certs\") pod \"test-model-2ac3c6-kserve-65766f4857-626nx\" (UID: \"57aeca72-f43d-409e-a866-601a5e6b9443\") " pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"
Jul 07 18:26:00.852013 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:00.851983    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8hzz\" (UniqueName: \"kubernetes.io/projected/57aeca72-f43d-409e-a866-601a5e6b9443-kube-api-access-c8hzz\") pod \"test-model-2ac3c6-kserve-65766f4857-626nx\" (UID: \"57aeca72-f43d-409e-a866-601a5e6b9443\") " pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"
Jul 07 18:26:00.961207 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:00.961165    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"
Jul 07 18:26:01.106166 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:01.106130    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"]
Jul 07 18:26:01.109737 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:26:01.109710    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57aeca72_f43d_409e_a866_601a5e6b9443.slice/crio-7009b35e8ba2adb4aeec007408c83dcae2edd94d68e42315b86d07402b1a27e9 WatchSource:0}: Error finding container 7009b35e8ba2adb4aeec007408c83dcae2edd94d68e42315b86d07402b1a27e9: Status 404 returned error can't find the container with id 7009b35e8ba2adb4aeec007408c83dcae2edd94d68e42315b86d07402b1a27e9
Jul 07 18:26:01.899481 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:01.899446    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx" event={"ID":"57aeca72-f43d-409e-a866-601a5e6b9443","Type":"ContainerStarted","Data":"fe0a7c543accb391d0b3b9fe52236fc039215cfa0d8797e88e399138d53b90b7"}
Jul 07 18:26:01.899898 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:01.899497    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx" event={"ID":"57aeca72-f43d-409e-a866-601a5e6b9443","Type":"ContainerStarted","Data":"7009b35e8ba2adb4aeec007408c83dcae2edd94d68e42315b86d07402b1a27e9"}
Jul 07 18:26:01.938146 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:01.938094    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx" podStartSLOduration=1.938077744 podStartE2EDuration="1.938077744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:26:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:26:01.937085303 +0000 UTC m=+1952.694646174" watchObservedRunningTime="2026-07-07 18:26:01.938077744 +0000 UTC m=+1952.695638614"
Jul 07 18:26:10.962231 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:10.962187    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"
Jul 07 18:26:10.962625 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:10.962258    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"
Jul 07 18:26:10.974810 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:10.974780    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"
Jul 07 18:26:11.962695 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:11.962662    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"
Jul 07 18:26:47.984115 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:47.984083    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"]
Jul 07 18:26:47.987707 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:47.987684    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"
Jul 07 18:26:47.991926 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:47.991906    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-8481d0\"/\"kube-root-ca.crt\""
Jul 07 18:26:47.992964 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:47.992942    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-8481d0\"/\"openshift-service-ca.crt\""
Jul 07 18:26:47.993141 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:47.992969    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-8481d0\"/\"default-dockercfg-hlclv\""
Jul 07 18:26:47.993141 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:47.993080    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-8481d0\"/\"test-model-8481d0-kserve-self-signed-certs\""
Jul 07 18:26:48.010623 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:48.010598    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"]
Jul 07 18:26:48.145219 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:48.145186    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a740d8b-4fcb-4300-8186-bc4f6154945a-home\") pod \"test-model-8481d0-kserve-5fb96bd8ff-hdkbx\" (UID: \"9a740d8b-4fcb-4300-8186-bc4f6154945a\") " pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"
Jul 07 18:26:48.145390 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:48.145228    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a740d8b-4fcb-4300-8186-bc4f6154945a-dshm\") pod \"test-model-8481d0-kserve-5fb96bd8ff-hdkbx\" (UID: \"9a740d8b-4fcb-4300-8186-bc4f6154945a\") " pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"
Jul 07 18:26:48.145390 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:48.145260    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8crp\" (UniqueName: \"kubernetes.io/projected/9a740d8b-4fcb-4300-8186-bc4f6154945a-kube-api-access-f8crp\") pod \"test-model-8481d0-kserve-5fb96bd8ff-hdkbx\" (UID: \"9a740d8b-4fcb-4300-8186-bc4f6154945a\") " pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"
Jul 07 18:26:48.145390 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:48.145318    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a740d8b-4fcb-4300-8186-bc4f6154945a-model-cache\") pod \"test-model-8481d0-kserve-5fb96bd8ff-hdkbx\" (UID: \"9a740d8b-4fcb-4300-8186-bc4f6154945a\") " pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"
Jul 07 18:26:48.145390 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:48.145357    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a740d8b-4fcb-4300-8186-bc4f6154945a-tmp-dir\") pod \"test-model-8481d0-kserve-5fb96bd8ff-hdkbx\" (UID: \"9a740d8b-4fcb-4300-8186-bc4f6154945a\") " pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"
Jul 07 18:26:48.145390 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:48.145384    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a740d8b-4fcb-4300-8186-bc4f6154945a-tls-certs\") pod \"test-model-8481d0-kserve-5fb96bd8ff-hdkbx\" (UID: \"9a740d8b-4fcb-4300-8186-bc4f6154945a\") " pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"
Jul 07 18:26:48.246005 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:48.245927    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a740d8b-4fcb-4300-8186-bc4f6154945a-home\") pod \"test-model-8481d0-kserve-5fb96bd8ff-hdkbx\" (UID: \"9a740d8b-4fcb-4300-8186-bc4f6154945a\") " pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"
Jul 07 18:26:48.246005 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:48.245960    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a740d8b-4fcb-4300-8186-bc4f6154945a-dshm\") pod \"test-model-8481d0-kserve-5fb96bd8ff-hdkbx\" (UID: \"9a740d8b-4fcb-4300-8186-bc4f6154945a\") " pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"
Jul 07 18:26:48.246005 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:48.245995    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8crp\" (UniqueName: \"kubernetes.io/projected/9a740d8b-4fcb-4300-8186-bc4f6154945a-kube-api-access-f8crp\") pod \"test-model-8481d0-kserve-5fb96bd8ff-hdkbx\" (UID: \"9a740d8b-4fcb-4300-8186-bc4f6154945a\") " pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"
Jul 07 18:26:48.246209 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:48.246038    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a740d8b-4fcb-4300-8186-bc4f6154945a-model-cache\") pod \"test-model-8481d0-kserve-5fb96bd8ff-hdkbx\" (UID: \"9a740d8b-4fcb-4300-8186-bc4f6154945a\") " pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"
Jul 07 18:26:48.246209 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:48.246080    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a740d8b-4fcb-4300-8186-bc4f6154945a-tmp-dir\") pod \"test-model-8481d0-kserve-5fb96bd8ff-hdkbx\" (UID: \"9a740d8b-4fcb-4300-8186-bc4f6154945a\") " pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"
Jul 07 18:26:48.246209 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:48.246111    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a740d8b-4fcb-4300-8186-bc4f6154945a-tls-certs\") pod \"test-model-8481d0-kserve-5fb96bd8ff-hdkbx\" (UID: \"9a740d8b-4fcb-4300-8186-bc4f6154945a\") " pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"
Jul 07 18:26:48.246480 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:48.246457    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a740d8b-4fcb-4300-8186-bc4f6154945a-home\") pod \"test-model-8481d0-kserve-5fb96bd8ff-hdkbx\" (UID: \"9a740d8b-4fcb-4300-8186-bc4f6154945a\") " pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"
Jul 07 18:26:48.246480 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:48.246468    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a740d8b-4fcb-4300-8186-bc4f6154945a-tmp-dir\") pod \"test-model-8481d0-kserve-5fb96bd8ff-hdkbx\" (UID: \"9a740d8b-4fcb-4300-8186-bc4f6154945a\") " pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"
Jul 07 18:26:48.246725 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:48.246502    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a740d8b-4fcb-4300-8186-bc4f6154945a-model-cache\") pod \"test-model-8481d0-kserve-5fb96bd8ff-hdkbx\" (UID: \"9a740d8b-4fcb-4300-8186-bc4f6154945a\") " pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"
Jul 07 18:26:48.248286 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:48.248267    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a740d8b-4fcb-4300-8186-bc4f6154945a-dshm\") pod \"test-model-8481d0-kserve-5fb96bd8ff-hdkbx\" (UID: \"9a740d8b-4fcb-4300-8186-bc4f6154945a\") " pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"
Jul 07 18:26:48.248590 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:48.248575    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a740d8b-4fcb-4300-8186-bc4f6154945a-tls-certs\") pod \"test-model-8481d0-kserve-5fb96bd8ff-hdkbx\" (UID: \"9a740d8b-4fcb-4300-8186-bc4f6154945a\") " pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"
Jul 07 18:26:48.256728 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:48.256702    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8crp\" (UniqueName: \"kubernetes.io/projected/9a740d8b-4fcb-4300-8186-bc4f6154945a-kube-api-access-f8crp\") pod \"test-model-8481d0-kserve-5fb96bd8ff-hdkbx\" (UID: \"9a740d8b-4fcb-4300-8186-bc4f6154945a\") " pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"
Jul 07 18:26:48.297038 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:48.297012    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"
Jul 07 18:26:48.445465 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:48.445433    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"]
Jul 07 18:26:48.448750 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:26:48.448722    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a740d8b_4fcb_4300_8186_bc4f6154945a.slice/crio-6c9426a9303eb7460e88b0eff4c84a9e70ff1514f6a6201a7bfabda4af608d5c WatchSource:0}: Error finding container 6c9426a9303eb7460e88b0eff4c84a9e70ff1514f6a6201a7bfabda4af608d5c: Status 404 returned error can't find the container with id 6c9426a9303eb7460e88b0eff4c84a9e70ff1514f6a6201a7bfabda4af608d5c
Jul 07 18:26:49.139173 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:49.139136    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx" event={"ID":"9a740d8b-4fcb-4300-8186-bc4f6154945a","Type":"ContainerStarted","Data":"6682dfab13f84093c213067f47021dc5d28eea355aac617110db29911394fce1"}
Jul 07 18:26:49.139598 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:49.139184    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx" event={"ID":"9a740d8b-4fcb-4300-8186-bc4f6154945a","Type":"ContainerStarted","Data":"6c9426a9303eb7460e88b0eff4c84a9e70ff1514f6a6201a7bfabda4af608d5c"}
Jul 07 18:26:49.186459 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:49.186418    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx" podStartSLOduration=2.186403717 podStartE2EDuration="2.186403717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:26:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:26:49.185504712 +0000 UTC m=+1999.943065583" watchObservedRunningTime="2026-07-07 18:26:49.186403717 +0000 UTC m=+1999.943964618"
Jul 07 18:26:58.297430 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:58.297386    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"
Jul 07 18:26:58.297430 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:58.297430    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"
Jul 07 18:26:58.310120 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:58.310096    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"
Jul 07 18:26:59.200574 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:26:59.200543    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"
Jul 07 18:27:05.472232 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:05.472195    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"]
Jul 07 18:27:06.523110 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:06.523074    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"]
Jul 07 18:27:20.492287 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:20.492223    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx" podUID="57aeca72-f43d-409e-a866-601a5e6b9443" containerName="main" containerID="cri-o://fe0a7c543accb391d0b3b9fe52236fc039215cfa0d8797e88e399138d53b90b7" gracePeriod=45
Jul 07 18:27:20.738421 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:20.738397    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"
Jul 07 18:27:20.791041 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:20.790969    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8hzz\" (UniqueName: \"kubernetes.io/projected/57aeca72-f43d-409e-a866-601a5e6b9443-kube-api-access-c8hzz\") pod \"57aeca72-f43d-409e-a866-601a5e6b9443\" (UID: \"57aeca72-f43d-409e-a866-601a5e6b9443\") "
Jul 07 18:27:20.791041 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:20.791007    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57aeca72-f43d-409e-a866-601a5e6b9443-home\") pod \"57aeca72-f43d-409e-a866-601a5e6b9443\" (UID: \"57aeca72-f43d-409e-a866-601a5e6b9443\") "
Jul 07 18:27:20.791229 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:20.791042    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57aeca72-f43d-409e-a866-601a5e6b9443-tls-certs\") pod \"57aeca72-f43d-409e-a866-601a5e6b9443\" (UID: \"57aeca72-f43d-409e-a866-601a5e6b9443\") "
Jul 07 18:27:20.791229 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:20.791078    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57aeca72-f43d-409e-a866-601a5e6b9443-dshm\") pod \"57aeca72-f43d-409e-a866-601a5e6b9443\" (UID: \"57aeca72-f43d-409e-a866-601a5e6b9443\") "
Jul 07 18:27:20.791229 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:20.791094    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57aeca72-f43d-409e-a866-601a5e6b9443-tmp-dir\") pod \"57aeca72-f43d-409e-a866-601a5e6b9443\" (UID: \"57aeca72-f43d-409e-a866-601a5e6b9443\") "
Jul 07 18:27:20.791229 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:20.791126    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57aeca72-f43d-409e-a866-601a5e6b9443-model-cache\") pod \"57aeca72-f43d-409e-a866-601a5e6b9443\" (UID: \"57aeca72-f43d-409e-a866-601a5e6b9443\") "
Jul 07 18:27:20.791433 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:20.791284    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57aeca72-f43d-409e-a866-601a5e6b9443-home" (OuterVolumeSpecName: "home") pod "57aeca72-f43d-409e-a866-601a5e6b9443" (UID: "57aeca72-f43d-409e-a866-601a5e6b9443"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:27:20.791433 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:20.791381    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57aeca72-f43d-409e-a866-601a5e6b9443-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "57aeca72-f43d-409e-a866-601a5e6b9443" (UID: "57aeca72-f43d-409e-a866-601a5e6b9443"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:27:20.791433 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:20.791421    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57aeca72-f43d-409e-a866-601a5e6b9443-model-cache" (OuterVolumeSpecName: "model-cache") pod "57aeca72-f43d-409e-a866-601a5e6b9443" (UID: "57aeca72-f43d-409e-a866-601a5e6b9443"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:27:20.791560 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:20.791434    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57aeca72-f43d-409e-a866-601a5e6b9443-home\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:27:20.793419 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:20.793392    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57aeca72-f43d-409e-a866-601a5e6b9443-dshm" (OuterVolumeSpecName: "dshm") pod "57aeca72-f43d-409e-a866-601a5e6b9443" (UID: "57aeca72-f43d-409e-a866-601a5e6b9443"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:27:20.793519 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:20.793421    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57aeca72-f43d-409e-a866-601a5e6b9443-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "57aeca72-f43d-409e-a866-601a5e6b9443" (UID: "57aeca72-f43d-409e-a866-601a5e6b9443"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:27:20.793519 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:20.793433    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57aeca72-f43d-409e-a866-601a5e6b9443-kube-api-access-c8hzz" (OuterVolumeSpecName: "kube-api-access-c8hzz") pod "57aeca72-f43d-409e-a866-601a5e6b9443" (UID: "57aeca72-f43d-409e-a866-601a5e6b9443"). InnerVolumeSpecName "kube-api-access-c8hzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:27:20.892215 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:20.892165    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57aeca72-f43d-409e-a866-601a5e6b9443-dshm\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:27:20.892215 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:20.892225    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57aeca72-f43d-409e-a866-601a5e6b9443-tmp-dir\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:27:20.892425 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:20.892234    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57aeca72-f43d-409e-a866-601a5e6b9443-model-cache\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:27:20.892425 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:20.892243    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8hzz\" (UniqueName: \"kubernetes.io/projected/57aeca72-f43d-409e-a866-601a5e6b9443-kube-api-access-c8hzz\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:27:20.892425 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:20.892261    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57aeca72-f43d-409e-a866-601a5e6b9443-tls-certs\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:27:21.298255 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.298217    2566 generic.go:356] "Generic (PLEG): container finished" podID="57aeca72-f43d-409e-a866-601a5e6b9443" containerID="fe0a7c543accb391d0b3b9fe52236fc039215cfa0d8797e88e399138d53b90b7" exitCode=0
Jul 07 18:27:21.298414 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.298259    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"
Jul 07 18:27:21.298414 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.298258    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx" event={"ID":"57aeca72-f43d-409e-a866-601a5e6b9443","Type":"ContainerDied","Data":"fe0a7c543accb391d0b3b9fe52236fc039215cfa0d8797e88e399138d53b90b7"}
Jul 07 18:27:21.298414 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.298381    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx" event={"ID":"57aeca72-f43d-409e-a866-601a5e6b9443","Type":"ContainerDied","Data":"7009b35e8ba2adb4aeec007408c83dcae2edd94d68e42315b86d07402b1a27e9"}
Jul 07 18:27:21.298414 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.298400    2566 scope.go:117] "RemoveContainer" containerID="fe0a7c543accb391d0b3b9fe52236fc039215cfa0d8797e88e399138d53b90b7"
Jul 07 18:27:21.307910 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.307809    2566 scope.go:117] "RemoveContainer" containerID="fe0a7c543accb391d0b3b9fe52236fc039215cfa0d8797e88e399138d53b90b7"
Jul 07 18:27:21.308158 ip-10-0-128-53 kubenswrapper[2566]: E0707 18:27:21.308138    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe0a7c543accb391d0b3b9fe52236fc039215cfa0d8797e88e399138d53b90b7\": container with ID starting with fe0a7c543accb391d0b3b9fe52236fc039215cfa0d8797e88e399138d53b90b7 not found: ID does not exist" containerID="fe0a7c543accb391d0b3b9fe52236fc039215cfa0d8797e88e399138d53b90b7"
Jul 07 18:27:21.308212 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.308167    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe0a7c543accb391d0b3b9fe52236fc039215cfa0d8797e88e399138d53b90b7"} err="failed to get container status \"fe0a7c543accb391d0b3b9fe52236fc039215cfa0d8797e88e399138d53b90b7\": rpc error: code = NotFound desc = could not find container \"fe0a7c543accb391d0b3b9fe52236fc039215cfa0d8797e88e399138d53b90b7\": container with ID starting with fe0a7c543accb391d0b3b9fe52236fc039215cfa0d8797e88e399138d53b90b7 not found: ID does not exist"
Jul 07 18:27:21.320281 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.320256    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"]
Jul 07 18:27:21.324143 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.324125    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-2ac3c6/test-model-2ac3c6-kserve-65766f4857-626nx"]
Jul 07 18:27:21.543321 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.543284    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx" podUID="9a740d8b-4fcb-4300-8186-bc4f6154945a" containerName="main" containerID="cri-o://6682dfab13f84093c213067f47021dc5d28eea355aac617110db29911394fce1" gracePeriod=45
Jul 07 18:27:21.793371 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.793345    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"
Jul 07 18:27:21.796368 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.796352    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8crp\" (UniqueName: \"kubernetes.io/projected/9a740d8b-4fcb-4300-8186-bc4f6154945a-kube-api-access-f8crp\") pod \"9a740d8b-4fcb-4300-8186-bc4f6154945a\" (UID: \"9a740d8b-4fcb-4300-8186-bc4f6154945a\") "
Jul 07 18:27:21.796421 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.796387    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a740d8b-4fcb-4300-8186-bc4f6154945a-model-cache\") pod \"9a740d8b-4fcb-4300-8186-bc4f6154945a\" (UID: \"9a740d8b-4fcb-4300-8186-bc4f6154945a\") "
Jul 07 18:27:21.796457 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.796440    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a740d8b-4fcb-4300-8186-bc4f6154945a-home\") pod \"9a740d8b-4fcb-4300-8186-bc4f6154945a\" (UID: \"9a740d8b-4fcb-4300-8186-bc4f6154945a\") "
Jul 07 18:27:21.796500 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.796459    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a740d8b-4fcb-4300-8186-bc4f6154945a-dshm\") pod \"9a740d8b-4fcb-4300-8186-bc4f6154945a\" (UID: \"9a740d8b-4fcb-4300-8186-bc4f6154945a\") "
Jul 07 18:27:21.796500 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.796480    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a740d8b-4fcb-4300-8186-bc4f6154945a-tls-certs\") pod \"9a740d8b-4fcb-4300-8186-bc4f6154945a\" (UID: \"9a740d8b-4fcb-4300-8186-bc4f6154945a\") "
Jul 07 18:27:21.796599 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.796522    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a740d8b-4fcb-4300-8186-bc4f6154945a-tmp-dir\") pod \"9a740d8b-4fcb-4300-8186-bc4f6154945a\" (UID: \"9a740d8b-4fcb-4300-8186-bc4f6154945a\") "
Jul 07 18:27:21.796736 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.796708    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a740d8b-4fcb-4300-8186-bc4f6154945a-home" (OuterVolumeSpecName: "home") pod "9a740d8b-4fcb-4300-8186-bc4f6154945a" (UID: "9a740d8b-4fcb-4300-8186-bc4f6154945a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:27:21.796878 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.796736    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a740d8b-4fcb-4300-8186-bc4f6154945a-model-cache" (OuterVolumeSpecName: "model-cache") pod "9a740d8b-4fcb-4300-8186-bc4f6154945a" (UID: "9a740d8b-4fcb-4300-8186-bc4f6154945a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:27:21.796944 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.796884    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a740d8b-4fcb-4300-8186-bc4f6154945a-model-cache\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:27:21.796944 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.796936    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a740d8b-4fcb-4300-8186-bc4f6154945a-home\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:27:21.797021 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.796957    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a740d8b-4fcb-4300-8186-bc4f6154945a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9a740d8b-4fcb-4300-8186-bc4f6154945a" (UID: "9a740d8b-4fcb-4300-8186-bc4f6154945a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:27:21.798977 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.798953    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a740d8b-4fcb-4300-8186-bc4f6154945a-kube-api-access-f8crp" (OuterVolumeSpecName: "kube-api-access-f8crp") pod "9a740d8b-4fcb-4300-8186-bc4f6154945a" (UID: "9a740d8b-4fcb-4300-8186-bc4f6154945a"). InnerVolumeSpecName "kube-api-access-f8crp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:27:21.798977 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.798955    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a740d8b-4fcb-4300-8186-bc4f6154945a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9a740d8b-4fcb-4300-8186-bc4f6154945a" (UID: "9a740d8b-4fcb-4300-8186-bc4f6154945a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:27:21.799149 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.799010    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a740d8b-4fcb-4300-8186-bc4f6154945a-dshm" (OuterVolumeSpecName: "dshm") pod "9a740d8b-4fcb-4300-8186-bc4f6154945a" (UID: "9a740d8b-4fcb-4300-8186-bc4f6154945a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:27:21.801222 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.801179    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57aeca72-f43d-409e-a866-601a5e6b9443" path="/var/lib/kubelet/pods/57aeca72-f43d-409e-a866-601a5e6b9443/volumes"
Jul 07 18:27:21.897262 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.897236    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a740d8b-4fcb-4300-8186-bc4f6154945a-tls-certs\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:27:21.897262 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.897260    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a740d8b-4fcb-4300-8186-bc4f6154945a-tmp-dir\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:27:21.897262 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.897269    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8crp\" (UniqueName: \"kubernetes.io/projected/9a740d8b-4fcb-4300-8186-bc4f6154945a-kube-api-access-f8crp\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:27:21.897490 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:21.897278    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a740d8b-4fcb-4300-8186-bc4f6154945a-dshm\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:27:22.304558 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:22.304523    2566 generic.go:356] "Generic (PLEG): container finished" podID="9a740d8b-4fcb-4300-8186-bc4f6154945a" containerID="6682dfab13f84093c213067f47021dc5d28eea355aac617110db29911394fce1" exitCode=0
Jul 07 18:27:22.304735 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:22.304574    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"
Jul 07 18:27:22.304735 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:22.304584    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx" event={"ID":"9a740d8b-4fcb-4300-8186-bc4f6154945a","Type":"ContainerDied","Data":"6682dfab13f84093c213067f47021dc5d28eea355aac617110db29911394fce1"}
Jul 07 18:27:22.304735 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:22.304628    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx" event={"ID":"9a740d8b-4fcb-4300-8186-bc4f6154945a","Type":"ContainerDied","Data":"6c9426a9303eb7460e88b0eff4c84a9e70ff1514f6a6201a7bfabda4af608d5c"}
Jul 07 18:27:22.304735 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:22.304651    2566 scope.go:117] "RemoveContainer" containerID="6682dfab13f84093c213067f47021dc5d28eea355aac617110db29911394fce1"
Jul 07 18:27:22.313482 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:22.313465    2566 scope.go:117] "RemoveContainer" containerID="6682dfab13f84093c213067f47021dc5d28eea355aac617110db29911394fce1"
Jul 07 18:27:22.313749 ip-10-0-128-53 kubenswrapper[2566]: E0707 18:27:22.313729    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6682dfab13f84093c213067f47021dc5d28eea355aac617110db29911394fce1\": container with ID starting with 6682dfab13f84093c213067f47021dc5d28eea355aac617110db29911394fce1 not found: ID does not exist" containerID="6682dfab13f84093c213067f47021dc5d28eea355aac617110db29911394fce1"
Jul 07 18:27:22.313811 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:22.313758    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6682dfab13f84093c213067f47021dc5d28eea355aac617110db29911394fce1"} err="failed to get container status \"6682dfab13f84093c213067f47021dc5d28eea355aac617110db29911394fce1\": rpc error: code = NotFound desc = could not find container \"6682dfab13f84093c213067f47021dc5d28eea355aac617110db29911394fce1\": container with ID starting with 6682dfab13f84093c213067f47021dc5d28eea355aac617110db29911394fce1 not found: ID does not exist"
Jul 07 18:27:22.322225 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:22.322203    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"]
Jul 07 18:27:22.326084 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:22.326065    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-8481d0/test-model-8481d0-kserve-5fb96bd8ff-hdkbx"]
Jul 07 18:27:23.800836 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:23.800790    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a740d8b-4fcb-4300-8186-bc4f6154945a" path="/var/lib/kubelet/pods/9a740d8b-4fcb-4300-8186-bc4f6154945a/volumes"
Jul 07 18:27:56.994457 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:56.994370    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"]
Jul 07 18:27:56.995517 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:56.995487    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l" podUID="72387232-685f-42e5-9c3e-55faf78940b4" containerName="istio-proxy" containerID="cri-o://2273054856c063a7e84eaee340fdba19e9b68599427070e6b937db4e5bd93033" gracePeriod=30
Jul 07 18:27:57.974388 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:57.974355    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"]
Jul 07 18:27:57.974756 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:57.974737    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57aeca72-f43d-409e-a866-601a5e6b9443" containerName="main"
Jul 07 18:27:57.974816 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:57.974760    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="57aeca72-f43d-409e-a866-601a5e6b9443" containerName="main"
Jul 07 18:27:57.974816 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:57.974793    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a740d8b-4fcb-4300-8186-bc4f6154945a" containerName="main"
Jul 07 18:27:57.974816 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:57.974801    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a740d8b-4fcb-4300-8186-bc4f6154945a" containerName="main"
Jul 07 18:27:57.974991 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:57.974900    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="57aeca72-f43d-409e-a866-601a5e6b9443" containerName="main"
Jul 07 18:27:57.974991 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:57.974912    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a740d8b-4fcb-4300-8186-bc4f6154945a" containerName="main"
Jul 07 18:27:57.977941 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:57.977919    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:57.980672 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:57.980655    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-32f803-openshift-default-dockercfg-9t585\""
Jul 07 18:27:57.993152 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:57.993127    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"]
Jul 07 18:27:58.090282 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.090246    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0da45355-2760-4d5a-86e2-65ebd78de090-istio-podinfo\") pod \"e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") " pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:58.090651 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.090289    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwtpq\" (UniqueName: \"kubernetes.io/projected/0da45355-2760-4d5a-86e2-65ebd78de090-kube-api-access-rwtpq\") pod \"e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") " pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:58.090651 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.090321    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-istio-data\") pod \"e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") " pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:58.090651 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.090364    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0da45355-2760-4d5a-86e2-65ebd78de090-istiod-ca-cert\") pod \"e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") " pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:58.090651 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.090386    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-workload-socket\") pod \"e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") " pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:58.090651 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.090401    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-credential-socket\") pod \"e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") " pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:58.090651 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.090418    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-workload-certs\") pod \"e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") " pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:58.090651 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.090435    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-istio-envoy\") pod \"e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") " pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:58.090651 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.090450    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0da45355-2760-4d5a-86e2-65ebd78de090-istio-token\") pod \"e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") " pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:58.191068 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.191035    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwtpq\" (UniqueName: \"kubernetes.io/projected/0da45355-2760-4d5a-86e2-65ebd78de090-kube-api-access-rwtpq\") pod \"e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") " pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:58.191254 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.191098    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-istio-data\") pod \"e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") " pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:58.191254 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.191134    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0da45355-2760-4d5a-86e2-65ebd78de090-istiod-ca-cert\") pod \"e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") " pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:58.191254 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.191159    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-workload-socket\") pod \"e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") " pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:58.191254 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.191175    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-credential-socket\") pod \"e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") " pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:58.191254 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.191193    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-workload-certs\") pod \"e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") " pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:58.191254 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.191214    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-istio-envoy\") pod \"e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") " pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:58.191254 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.191240    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0da45355-2760-4d5a-86e2-65ebd78de090-istio-token\") pod \"e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") " pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:58.191619 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.191300    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0da45355-2760-4d5a-86e2-65ebd78de090-istio-podinfo\") pod \"e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") " pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:58.191678 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.191630    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-credential-socket\") pod \"e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") " pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:58.191731 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.191686    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-workload-socket\") pod \"e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") " pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:58.191791 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.191772    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-workload-certs\") pod \"e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") " pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:58.191939 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.191922    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-istio-data\") pod \"e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") " pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:58.192004 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.191957    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0da45355-2760-4d5a-86e2-65ebd78de090-istiod-ca-cert\") pod \"e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") " pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:58.193783 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.193761    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-istio-envoy\") pod \"e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") " pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:58.193897 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.193882    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0da45355-2760-4d5a-86e2-65ebd78de090-istio-podinfo\") pod \"e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") " pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:58.203106 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.203078    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0da45355-2760-4d5a-86e2-65ebd78de090-istio-token\") pod \"e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") " pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:58.203215 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.203126    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwtpq\" (UniqueName: \"kubernetes.io/projected/0da45355-2760-4d5a-86e2-65ebd78de090-kube-api-access-rwtpq\") pod \"e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") " pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:58.288049 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.287955    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:27:58.435688 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.435664    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"]
Jul 07 18:27:58.437170 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:27:58.437136    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0da45355_2760_4d5a_86e2_65ebd78de090.slice/crio-8ea9da5da9821f5058e0d1bec56a3c39907c0a72a7d66acdd6b0d46ac236ca8f WatchSource:0}: Error finding container 8ea9da5da9821f5058e0d1bec56a3c39907c0a72a7d66acdd6b0d46ac236ca8f: Status 404 returned error can't find the container with id 8ea9da5da9821f5058e0d1bec56a3c39907c0a72a7d66acdd6b0d46ac236ca8f
Jul 07 18:27:58.439182 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.439151    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 18:27:58.439256 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.439213    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 18:27:58.439256 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.439242    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 18:27:58.480888 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:58.480857    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx" event={"ID":"0da45355-2760-4d5a-86e2-65ebd78de090","Type":"ContainerStarted","Data":"8ea9da5da9821f5058e0d1bec56a3c39907c0a72a7d66acdd6b0d46ac236ca8f"}
Jul 07 18:27:59.334703 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:59.334663    2566 patch_prober.go:28] interesting pod/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 18:27:59.335075 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:59.334725    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l" podUID="72387232-685f-42e5-9c3e-55faf78940b4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 18:27:59.488984 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:59.488950    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx" event={"ID":"0da45355-2760-4d5a-86e2-65ebd78de090","Type":"ContainerStarted","Data":"d9363685d08d2603f4b8971956a9bfb0bcd37564cf530890d554697e456eb52f"}
Jul 07 18:27:59.512132 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:27:59.512080    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx" podStartSLOduration=2.5120622 podStartE2EDuration="2.5120622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:27:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:27:59.510526637 +0000 UTC m=+2070.268087541" watchObservedRunningTime="2026-07-07 18:27:59.5120622 +0000 UTC m=+2070.269623127"
Jul 07 18:28:00.288126 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:00.288093    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:28:00.293921 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:00.293895    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:28:00.494873 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:00.494846    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:28:00.495924 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:00.495904    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:28:02.245958 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.245930    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:28:02.328102 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.328016    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72387232-685f-42e5-9c3e-55faf78940b4-istiod-ca-cert\") pod \"72387232-685f-42e5-9c3e-55faf78940b4\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") "
Jul 07 18:28:02.328102 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.328050    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-workload-socket\") pod \"72387232-685f-42e5-9c3e-55faf78940b4\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") "
Jul 07 18:28:02.328102 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.328071    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72387232-685f-42e5-9c3e-55faf78940b4-istio-token\") pod \"72387232-685f-42e5-9c3e-55faf78940b4\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") "
Jul 07 18:28:02.328383 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.328111    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-istio-data\") pod \"72387232-685f-42e5-9c3e-55faf78940b4\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") "
Jul 07 18:28:02.328383 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.328143    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-workload-certs\") pod \"72387232-685f-42e5-9c3e-55faf78940b4\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") "
Jul 07 18:28:02.328383 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.328195    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmg88\" (UniqueName: \"kubernetes.io/projected/72387232-685f-42e5-9c3e-55faf78940b4-kube-api-access-bmg88\") pod \"72387232-685f-42e5-9c3e-55faf78940b4\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") "
Jul 07 18:28:02.328383 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.328273    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72387232-685f-42e5-9c3e-55faf78940b4-istio-podinfo\") pod \"72387232-685f-42e5-9c3e-55faf78940b4\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") "
Jul 07 18:28:02.328383 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.328301    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-istio-envoy\") pod \"72387232-685f-42e5-9c3e-55faf78940b4\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") "
Jul 07 18:28:02.328383 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.328323    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-credential-socket\") pod \"72387232-685f-42e5-9c3e-55faf78940b4\" (UID: \"72387232-685f-42e5-9c3e-55faf78940b4\") "
Jul 07 18:28:02.328673 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.328518    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "72387232-685f-42e5-9c3e-55faf78940b4" (UID: "72387232-685f-42e5-9c3e-55faf78940b4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:28:02.328673 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.328537    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72387232-685f-42e5-9c3e-55faf78940b4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "72387232-685f-42e5-9c3e-55faf78940b4" (UID: "72387232-685f-42e5-9c3e-55faf78940b4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:28:02.328800 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.328779    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "72387232-685f-42e5-9c3e-55faf78940b4" (UID: "72387232-685f-42e5-9c3e-55faf78940b4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:28:02.329003 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.328969    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "72387232-685f-42e5-9c3e-55faf78940b4" (UID: "72387232-685f-42e5-9c3e-55faf78940b4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:28:02.329559 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.329116    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-istio-data" (OuterVolumeSpecName: "istio-data") pod "72387232-685f-42e5-9c3e-55faf78940b4" (UID: "72387232-685f-42e5-9c3e-55faf78940b4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:28:02.331051 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.331012    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72387232-685f-42e5-9c3e-55faf78940b4-istio-token" (OuterVolumeSpecName: "istio-token") pod "72387232-685f-42e5-9c3e-55faf78940b4" (UID: "72387232-685f-42e5-9c3e-55faf78940b4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:28:02.331231 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.331212    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/72387232-685f-42e5-9c3e-55faf78940b4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "72387232-685f-42e5-9c3e-55faf78940b4" (UID: "72387232-685f-42e5-9c3e-55faf78940b4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:28:02.331518 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.331501    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72387232-685f-42e5-9c3e-55faf78940b4-kube-api-access-bmg88" (OuterVolumeSpecName: "kube-api-access-bmg88") pod "72387232-685f-42e5-9c3e-55faf78940b4" (UID: "72387232-685f-42e5-9c3e-55faf78940b4"). InnerVolumeSpecName "kube-api-access-bmg88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:28:02.331582 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.331522    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "72387232-685f-42e5-9c3e-55faf78940b4" (UID: "72387232-685f-42e5-9c3e-55faf78940b4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:28:02.429764 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.429726    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72387232-685f-42e5-9c3e-55faf78940b4-istio-podinfo\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:28:02.429764 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.429757    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-istio-envoy\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:28:02.429764 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.429765    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-credential-socket\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:28:02.429764 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.429773    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72387232-685f-42e5-9c3e-55faf78940b4-istiod-ca-cert\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:28:02.430133 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.429782    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-workload-socket\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:28:02.430133 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.429789    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72387232-685f-42e5-9c3e-55faf78940b4-istio-token\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:28:02.430133 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.429797    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-istio-data\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:28:02.430133 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.429803    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72387232-685f-42e5-9c3e-55faf78940b4-workload-certs\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:28:02.430133 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.429811    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmg88\" (UniqueName: \"kubernetes.io/projected/72387232-685f-42e5-9c3e-55faf78940b4-kube-api-access-bmg88\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:28:02.506450 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.506417    2566 generic.go:356] "Generic (PLEG): container finished" podID="72387232-685f-42e5-9c3e-55faf78940b4" containerID="2273054856c063a7e84eaee340fdba19e9b68599427070e6b937db4e5bd93033" exitCode=0
Jul 07 18:28:02.506615 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.506475    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"
Jul 07 18:28:02.506615 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.506499    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l" event={"ID":"72387232-685f-42e5-9c3e-55faf78940b4","Type":"ContainerDied","Data":"2273054856c063a7e84eaee340fdba19e9b68599427070e6b937db4e5bd93033"}
Jul 07 18:28:02.506615 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.506551    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l" event={"ID":"72387232-685f-42e5-9c3e-55faf78940b4","Type":"ContainerDied","Data":"9f42e63853b67b0a92e27c0a41e8503b67183a5820606fc8c2bde53e873f81cc"}
Jul 07 18:28:02.506615 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.506573    2566 scope.go:117] "RemoveContainer" containerID="2273054856c063a7e84eaee340fdba19e9b68599427070e6b937db4e5bd93033"
Jul 07 18:28:02.516149 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.516132    2566 scope.go:117] "RemoveContainer" containerID="13aa0df8672f480a4bb70d2638443d19335209ccda13f8e239babcf78341f91c"
Jul 07 18:28:02.524277 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.524258    2566 scope.go:117] "RemoveContainer" containerID="2273054856c063a7e84eaee340fdba19e9b68599427070e6b937db4e5bd93033"
Jul 07 18:28:02.524517 ip-10-0-128-53 kubenswrapper[2566]: E0707 18:28:02.524499    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2273054856c063a7e84eaee340fdba19e9b68599427070e6b937db4e5bd93033\": container with ID starting with 2273054856c063a7e84eaee340fdba19e9b68599427070e6b937db4e5bd93033 not found: ID does not exist" containerID="2273054856c063a7e84eaee340fdba19e9b68599427070e6b937db4e5bd93033"
Jul 07 18:28:02.524562 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.524525    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2273054856c063a7e84eaee340fdba19e9b68599427070e6b937db4e5bd93033"} err="failed to get container status \"2273054856c063a7e84eaee340fdba19e9b68599427070e6b937db4e5bd93033\": rpc error: code = NotFound desc = could not find container \"2273054856c063a7e84eaee340fdba19e9b68599427070e6b937db4e5bd93033\": container with ID starting with 2273054856c063a7e84eaee340fdba19e9b68599427070e6b937db4e5bd93033 not found: ID does not exist"
Jul 07 18:28:02.524562 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.524541    2566 scope.go:117] "RemoveContainer" containerID="13aa0df8672f480a4bb70d2638443d19335209ccda13f8e239babcf78341f91c"
Jul 07 18:28:02.524786 ip-10-0-128-53 kubenswrapper[2566]: E0707 18:28:02.524766    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13aa0df8672f480a4bb70d2638443d19335209ccda13f8e239babcf78341f91c\": container with ID starting with 13aa0df8672f480a4bb70d2638443d19335209ccda13f8e239babcf78341f91c not found: ID does not exist" containerID="13aa0df8672f480a4bb70d2638443d19335209ccda13f8e239babcf78341f91c"
Jul 07 18:28:02.524851 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.524793    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13aa0df8672f480a4bb70d2638443d19335209ccda13f8e239babcf78341f91c"} err="failed to get container status \"13aa0df8672f480a4bb70d2638443d19335209ccda13f8e239babcf78341f91c\": rpc error: code = NotFound desc = could not find container \"13aa0df8672f480a4bb70d2638443d19335209ccda13f8e239babcf78341f91c\": container with ID starting with 13aa0df8672f480a4bb70d2638443d19335209ccda13f8e239babcf78341f91c not found: ID does not exist"
Jul 07 18:28:02.530127 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.530105    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"]
Jul 07 18:28:02.537339 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:02.537317    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-8481d0-openshift-default-7567fcf6d5-gbn5l"]
Jul 07 18:28:03.800858 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:03.800806    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72387232-685f-42e5-9c3e-55faf78940b4" path="/var/lib/kubelet/pods/72387232-685f-42e5-9c3e-55faf78940b4/volumes"
Jul 07 18:28:06.839899 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:06.835229    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"]
Jul 07 18:28:06.839899 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:06.836002    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72387232-685f-42e5-9c3e-55faf78940b4" containerName="istio-proxy"
Jul 07 18:28:06.839899 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:06.836022    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="72387232-685f-42e5-9c3e-55faf78940b4" containerName="istio-proxy"
Jul 07 18:28:06.839899 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:06.836059    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72387232-685f-42e5-9c3e-55faf78940b4" containerName="istio-proxy"
Jul 07 18:28:06.839899 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:06.836067    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="72387232-685f-42e5-9c3e-55faf78940b4" containerName="istio-proxy"
Jul 07 18:28:06.839899 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:06.836213    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="72387232-685f-42e5-9c3e-55faf78940b4" containerName="istio-proxy"
Jul 07 18:28:06.839899 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:06.836225    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="72387232-685f-42e5-9c3e-55faf78940b4" containerName="istio-proxy"
Jul 07 18:28:06.841315 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:06.841291    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:06.845695 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:06.845677    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-c0421f-openshift-default-dockercfg-dvjq6\""
Jul 07 18:28:06.858911 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:06.858882    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"]
Jul 07 18:28:06.972796 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:06.972758    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-istio-data\") pod \"e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") " pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:06.973010 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:06.972799    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68111cec-f06c-4de2-9000-f1aee2579792-istio-podinfo\") pod \"e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") " pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:06.973010 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:06.972909    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trd2q\" (UniqueName: \"kubernetes.io/projected/68111cec-f06c-4de2-9000-f1aee2579792-kube-api-access-trd2q\") pod \"e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") " pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:06.973010 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:06.972942    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-workload-socket\") pod \"e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") " pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:06.973010 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:06.972971    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-istio-envoy\") pod \"e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") " pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:06.973184 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:06.973063    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-workload-certs\") pod \"e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") " pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:06.973184 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:06.973090    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-credential-socket\") pod \"e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") " pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:06.973184 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:06.973113    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68111cec-f06c-4de2-9000-f1aee2579792-istio-token\") pod \"e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") " pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:06.973184 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:06.973131    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68111cec-f06c-4de2-9000-f1aee2579792-istiod-ca-cert\") pod \"e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") " pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:07.074185 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:07.074142    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trd2q\" (UniqueName: \"kubernetes.io/projected/68111cec-f06c-4de2-9000-f1aee2579792-kube-api-access-trd2q\") pod \"e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") " pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:07.074185 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:07.074189    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-workload-socket\") pod \"e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") " pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:07.074449 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:07.074314    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-istio-envoy\") pod \"e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") " pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:07.074449 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:07.074410    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-workload-certs\") pod \"e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") " pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:07.074561 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:07.074453    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-credential-socket\") pod \"e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") " pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:07.074561 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:07.074485    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68111cec-f06c-4de2-9000-f1aee2579792-istio-token\") pod \"e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") " pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:07.074561 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:07.074511    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68111cec-f06c-4de2-9000-f1aee2579792-istiod-ca-cert\") pod \"e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") " pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:07.074561 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:07.074547    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-istio-data\") pod \"e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") " pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:07.074753 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:07.074576    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68111cec-f06c-4de2-9000-f1aee2579792-istio-podinfo\") pod \"e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") " pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:07.074753 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:07.074604    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-workload-socket\") pod \"e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") " pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:07.074879 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:07.074783    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-workload-certs\") pod \"e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") " pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:07.074879 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:07.074839    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-credential-socket\") pod \"e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") " pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:07.075071 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:07.075051    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-istio-data\") pod \"e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") " pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:07.075220 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:07.075203    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68111cec-f06c-4de2-9000-f1aee2579792-istiod-ca-cert\") pod \"e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") " pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:07.076682 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:07.076661    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-istio-envoy\") pod \"e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") " pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:07.077166 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:07.077149    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68111cec-f06c-4de2-9000-f1aee2579792-istio-podinfo\") pod \"e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") " pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:07.083041 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:07.083018    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68111cec-f06c-4de2-9000-f1aee2579792-istio-token\") pod \"e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") " pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:07.083233 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:07.083213    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trd2q\" (UniqueName: \"kubernetes.io/projected/68111cec-f06c-4de2-9000-f1aee2579792-kube-api-access-trd2q\") pod \"e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") " pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:07.151321 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:07.151230    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:07.310539 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:07.310506    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"]
Jul 07 18:28:07.313726 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:28:07.313696    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68111cec_f06c_4de2_9000_f1aee2579792.slice/crio-c3911afd6a9a3953f65df006c55976ae1b4f1f2381c7373e8cc099245dbef5bb WatchSource:0}: Error finding container c3911afd6a9a3953f65df006c55976ae1b4f1f2381c7373e8cc099245dbef5bb: Status 404 returned error can't find the container with id c3911afd6a9a3953f65df006c55976ae1b4f1f2381c7373e8cc099245dbef5bb
Jul 07 18:28:07.316369 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:07.316327    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 18:28:07.316459 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:07.316442    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 18:28:07.316505 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:07.316490    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 18:28:07.534234 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:07.534194    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9" event={"ID":"68111cec-f06c-4de2-9000-f1aee2579792","Type":"ContainerStarted","Data":"f4ff6ced60b3414b853c67d5f4f415b2b7edd729ebf65f42e6c34624dd2bacd3"}
Jul 07 18:28:07.534451 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:07.534257    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9" event={"ID":"68111cec-f06c-4de2-9000-f1aee2579792","Type":"ContainerStarted","Data":"c3911afd6a9a3953f65df006c55976ae1b4f1f2381c7373e8cc099245dbef5bb"}
Jul 07 18:28:07.560178 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:07.560126    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9" podStartSLOduration=1.560106776 podStartE2EDuration="1.560106776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:28:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:28:07.556429059 +0000 UTC m=+2078.313989931" watchObservedRunningTime="2026-07-07 18:28:07.560106776 +0000 UTC m=+2078.317667646"
Jul 07 18:28:08.154319 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:08.154277    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:08.168781 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:08.168716    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:08.541436 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:08.541401    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:08.542798 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:08.542763    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:15.496885 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:15.496819    2566 patch_prober.go:28] interesting pod/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 07 18:28:15.497332 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:15.496906    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx" podUID="0da45355-2760-4d5a-86e2-65ebd78de090" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 07 18:28:15.586627 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:15.586588    2566 generic.go:356] "Generic (PLEG): container finished" podID="0da45355-2760-4d5a-86e2-65ebd78de090" containerID="d9363685d08d2603f4b8971956a9bfb0bcd37564cf530890d554697e456eb52f" exitCode=0
Jul 07 18:28:15.586813 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:15.586666    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx" event={"ID":"0da45355-2760-4d5a-86e2-65ebd78de090","Type":"ContainerDied","Data":"d9363685d08d2603f4b8971956a9bfb0bcd37564cf530890d554697e456eb52f"}
Jul 07 18:28:15.587112 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:15.587098    2566 scope.go:117] "RemoveContainer" containerID="d9363685d08d2603f4b8971956a9bfb0bcd37564cf530890d554697e456eb52f"
Jul 07 18:28:15.588252 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:15.588221    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 18:28:15.588326 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:15.588309    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 18:28:15.588377 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:15.588358    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 18:28:16.593305 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:16.593271    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx" event={"ID":"0da45355-2760-4d5a-86e2-65ebd78de090","Type":"ContainerStarted","Data":"e74a93c44e8e6098588a12421e2090676cc1c8e3dc455afe749b819ac5fb671d"}
Jul 07 18:28:17.289405 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:17.289357    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:28:17.289644 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:17.289497    2566 patch_prober.go:28] interesting pod/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 07 18:28:17.289644 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:17.289539    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx" podUID="0da45355-2760-4d5a-86e2-65ebd78de090" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 07 18:28:18.289218 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:18.289175    2566 patch_prober.go:28] interesting pod/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 07 18:28:18.289578 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:18.289248    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx" podUID="0da45355-2760-4d5a-86e2-65ebd78de090" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 07 18:28:19.289351 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:19.289305    2566 patch_prober.go:28] interesting pod/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 07 18:28:19.289898 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:19.289373    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx" podUID="0da45355-2760-4d5a-86e2-65ebd78de090" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 07 18:28:20.288423 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:20.288303    2566 patch_prober.go:28] interesting pod/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 07 18:28:20.288423 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:20.288364    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx" podUID="0da45355-2760-4d5a-86e2-65ebd78de090" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 07 18:28:21.292665 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:21.292635    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:28:21.293084 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:21.293019    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:28:21.293848 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:21.293807    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:28:21.620938 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:21.620853    2566 generic.go:356] "Generic (PLEG): container finished" podID="68111cec-f06c-4de2-9000-f1aee2579792" containerID="f4ff6ced60b3414b853c67d5f4f415b2b7edd729ebf65f42e6c34624dd2bacd3" exitCode=0
Jul 07 18:28:21.620938 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:21.620915    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9" event={"ID":"68111cec-f06c-4de2-9000-f1aee2579792","Type":"ContainerDied","Data":"f4ff6ced60b3414b853c67d5f4f415b2b7edd729ebf65f42e6c34624dd2bacd3"}
Jul 07 18:28:21.621399 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:21.621381    2566 scope.go:117] "RemoveContainer" containerID="f4ff6ced60b3414b853c67d5f4f415b2b7edd729ebf65f42e6c34624dd2bacd3"
Jul 07 18:28:21.622373 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:21.622349    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 18:28:21.622427 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:21.622412    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 18:28:21.622462 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:21.622444    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 18:28:22.630013 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:22.629978    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9" event={"ID":"68111cec-f06c-4de2-9000-f1aee2579792","Type":"ContainerStarted","Data":"5067a487a3ccdd11b36b32c4ba94fc68b64b337dc4e90c63ef6f4fa9844352e7"}
Jul 07 18:28:23.152335 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:23.152299    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:23.154209 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:23.153783    2566 patch_prober.go:28] interesting pod/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 07 18:28:23.154209 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:23.153911    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9" podUID="68111cec-f06c-4de2-9000-f1aee2579792" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 07 18:28:23.541972 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:23.541925    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:24.152159 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:24.152114    2566 patch_prober.go:28] interesting pod/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 07 18:28:24.152790 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:24.152754    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9" podUID="68111cec-f06c-4de2-9000-f1aee2579792" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 07 18:28:25.151657 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:25.151610    2566 patch_prober.go:28] interesting pod/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 07 18:28:25.151890 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:25.151677    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9" podUID="68111cec-f06c-4de2-9000-f1aee2579792" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 07 18:28:26.152503 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:26.152449    2566 patch_prober.go:28] interesting pod/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 07 18:28:26.153071 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:26.152528    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9" podUID="68111cec-f06c-4de2-9000-f1aee2579792" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 07 18:28:27.155646 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:27.155615    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:27.156787 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:27.156767    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:29.855299 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:29.855262    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"]
Jul 07 18:28:29.855719 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:29.855518    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx" podUID="0da45355-2760-4d5a-86e2-65ebd78de090" containerName="istio-proxy" containerID="cri-o://e74a93c44e8e6098588a12421e2090676cc1c8e3dc455afe749b819ac5fb671d" gracePeriod=30
Jul 07 18:28:29.876889 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:29.876863    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lcfnl_9bc45238-7341-43fe-a75f-231dbf7a3704/console-operator/1.log"
Jul 07 18:28:29.883111 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:29.883082    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lcfnl_9bc45238-7341-43fe-a75f-231dbf7a3704/console-operator/1.log"
Jul 07 18:28:35.114989 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.114916    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:28:35.143085 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.143050    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-workload-certs\") pod \"0da45355-2760-4d5a-86e2-65ebd78de090\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") "
Jul 07 18:28:35.143276 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.143098    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0da45355-2760-4d5a-86e2-65ebd78de090-istio-token\") pod \"0da45355-2760-4d5a-86e2-65ebd78de090\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") "
Jul 07 18:28:35.143276 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.143133    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-istio-envoy\") pod \"0da45355-2760-4d5a-86e2-65ebd78de090\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") "
Jul 07 18:28:35.143276 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.143182    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwtpq\" (UniqueName: \"kubernetes.io/projected/0da45355-2760-4d5a-86e2-65ebd78de090-kube-api-access-rwtpq\") pod \"0da45355-2760-4d5a-86e2-65ebd78de090\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") "
Jul 07 18:28:35.143276 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.143228    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0da45355-2760-4d5a-86e2-65ebd78de090-istiod-ca-cert\") pod \"0da45355-2760-4d5a-86e2-65ebd78de090\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") "
Jul 07 18:28:35.143276 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.143251    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-istio-data\") pod \"0da45355-2760-4d5a-86e2-65ebd78de090\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") "
Jul 07 18:28:35.143550 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.143376    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-workload-socket\") pod \"0da45355-2760-4d5a-86e2-65ebd78de090\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") "
Jul 07 18:28:35.143550 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.143404    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-credential-socket\") pod \"0da45355-2760-4d5a-86e2-65ebd78de090\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") "
Jul 07 18:28:35.143550 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.143402    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0da45355-2760-4d5a-86e2-65ebd78de090" (UID: "0da45355-2760-4d5a-86e2-65ebd78de090"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:28:35.143550 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.143469    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0da45355-2760-4d5a-86e2-65ebd78de090-istio-podinfo\") pod \"0da45355-2760-4d5a-86e2-65ebd78de090\" (UID: \"0da45355-2760-4d5a-86e2-65ebd78de090\") "
Jul 07 18:28:35.143764 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.143613    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0da45355-2760-4d5a-86e2-65ebd78de090" (UID: "0da45355-2760-4d5a-86e2-65ebd78de090"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:28:35.143764 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.143630    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0da45355-2760-4d5a-86e2-65ebd78de090-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0da45355-2760-4d5a-86e2-65ebd78de090" (UID: "0da45355-2760-4d5a-86e2-65ebd78de090"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:28:35.143764 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.143726    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0da45355-2760-4d5a-86e2-65ebd78de090" (UID: "0da45355-2760-4d5a-86e2-65ebd78de090"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:28:35.143955 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.143800    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-workload-socket\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:28:35.143955 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.143819    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-credential-socket\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:28:35.143955 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.143861    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-workload-certs\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:28:35.144113 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.143950    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0da45355-2760-4d5a-86e2-65ebd78de090-istiod-ca-cert\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:28:35.144848 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.144784    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-istio-data" (OuterVolumeSpecName: "istio-data") pod "0da45355-2760-4d5a-86e2-65ebd78de090" (UID: "0da45355-2760-4d5a-86e2-65ebd78de090"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:28:35.145859 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.145807    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0da45355-2760-4d5a-86e2-65ebd78de090-istio-token" (OuterVolumeSpecName: "istio-token") pod "0da45355-2760-4d5a-86e2-65ebd78de090" (UID: "0da45355-2760-4d5a-86e2-65ebd78de090"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:28:35.146022 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.145999    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0da45355-2760-4d5a-86e2-65ebd78de090-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0da45355-2760-4d5a-86e2-65ebd78de090" (UID: "0da45355-2760-4d5a-86e2-65ebd78de090"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:28:35.146268 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.146244    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0da45355-2760-4d5a-86e2-65ebd78de090" (UID: "0da45355-2760-4d5a-86e2-65ebd78de090"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:28:35.146396 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.146310    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0da45355-2760-4d5a-86e2-65ebd78de090-kube-api-access-rwtpq" (OuterVolumeSpecName: "kube-api-access-rwtpq") pod "0da45355-2760-4d5a-86e2-65ebd78de090" (UID: "0da45355-2760-4d5a-86e2-65ebd78de090"). InnerVolumeSpecName "kube-api-access-rwtpq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:28:35.245380 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.245348    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0da45355-2760-4d5a-86e2-65ebd78de090-istio-podinfo\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:28:35.245380 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.245377    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0da45355-2760-4d5a-86e2-65ebd78de090-istio-token\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:28:35.245380 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.245388    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-istio-envoy\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:28:35.245617 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.245399    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwtpq\" (UniqueName: \"kubernetes.io/projected/0da45355-2760-4d5a-86e2-65ebd78de090-kube-api-access-rwtpq\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:28:35.245617 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.245411    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0da45355-2760-4d5a-86e2-65ebd78de090-istio-data\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:28:35.704889 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.704853    2566 generic.go:356] "Generic (PLEG): container finished" podID="0da45355-2760-4d5a-86e2-65ebd78de090" containerID="e74a93c44e8e6098588a12421e2090676cc1c8e3dc455afe749b819ac5fb671d" exitCode=0
Jul 07 18:28:35.704889 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.704894    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"
Jul 07 18:28:35.705154 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.704932    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx" event={"ID":"0da45355-2760-4d5a-86e2-65ebd78de090","Type":"ContainerDied","Data":"e74a93c44e8e6098588a12421e2090676cc1c8e3dc455afe749b819ac5fb671d"}
Jul 07 18:28:35.705154 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.704989    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx" event={"ID":"0da45355-2760-4d5a-86e2-65ebd78de090","Type":"ContainerDied","Data":"8ea9da5da9821f5058e0d1bec56a3c39907c0a72a7d66acdd6b0d46ac236ca8f"}
Jul 07 18:28:35.705154 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.705017    2566 scope.go:117] "RemoveContainer" containerID="e74a93c44e8e6098588a12421e2090676cc1c8e3dc455afe749b819ac5fb671d"
Jul 07 18:28:35.715346 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.715319    2566 scope.go:117] "RemoveContainer" containerID="d9363685d08d2603f4b8971956a9bfb0bcd37564cf530890d554697e456eb52f"
Jul 07 18:28:35.723796 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.723770    2566 scope.go:117] "RemoveContainer" containerID="e74a93c44e8e6098588a12421e2090676cc1c8e3dc455afe749b819ac5fb671d"
Jul 07 18:28:35.724103 ip-10-0-128-53 kubenswrapper[2566]: E0707 18:28:35.724085    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e74a93c44e8e6098588a12421e2090676cc1c8e3dc455afe749b819ac5fb671d\": container with ID starting with e74a93c44e8e6098588a12421e2090676cc1c8e3dc455afe749b819ac5fb671d not found: ID does not exist" containerID="e74a93c44e8e6098588a12421e2090676cc1c8e3dc455afe749b819ac5fb671d"
Jul 07 18:28:35.724165 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.724117    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e74a93c44e8e6098588a12421e2090676cc1c8e3dc455afe749b819ac5fb671d"} err="failed to get container status \"e74a93c44e8e6098588a12421e2090676cc1c8e3dc455afe749b819ac5fb671d\": rpc error: code = NotFound desc = could not find container \"e74a93c44e8e6098588a12421e2090676cc1c8e3dc455afe749b819ac5fb671d\": container with ID starting with e74a93c44e8e6098588a12421e2090676cc1c8e3dc455afe749b819ac5fb671d not found: ID does not exist"
Jul 07 18:28:35.724165 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.724136    2566 scope.go:117] "RemoveContainer" containerID="d9363685d08d2603f4b8971956a9bfb0bcd37564cf530890d554697e456eb52f"
Jul 07 18:28:35.724341 ip-10-0-128-53 kubenswrapper[2566]: E0707 18:28:35.724325    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9363685d08d2603f4b8971956a9bfb0bcd37564cf530890d554697e456eb52f\": container with ID starting with d9363685d08d2603f4b8971956a9bfb0bcd37564cf530890d554697e456eb52f not found: ID does not exist" containerID="d9363685d08d2603f4b8971956a9bfb0bcd37564cf530890d554697e456eb52f"
Jul 07 18:28:35.724379 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.724345    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9363685d08d2603f4b8971956a9bfb0bcd37564cf530890d554697e456eb52f"} err="failed to get container status \"d9363685d08d2603f4b8971956a9bfb0bcd37564cf530890d554697e456eb52f\": rpc error: code = NotFound desc = could not find container \"d9363685d08d2603f4b8971956a9bfb0bcd37564cf530890d554697e456eb52f\": container with ID starting with d9363685d08d2603f4b8971956a9bfb0bcd37564cf530890d554697e456eb52f not found: ID does not exist"
Jul 07 18:28:35.730179 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.730157    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"]
Jul 07 18:28:35.734294 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.734272    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-32f803-openshift-default-7d6c9c98dc-2d8dx"]
Jul 07 18:28:35.801074 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:35.801038    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0da45355-2760-4d5a-86e2-65ebd78de090" path="/var/lib/kubelet/pods/0da45355-2760-4d5a-86e2-65ebd78de090/volumes"
Jul 07 18:28:37.448381 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:37.448347    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"]
Jul 07 18:28:37.448796 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:37.448589    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9" podUID="68111cec-f06c-4de2-9000-f1aee2579792" containerName="istio-proxy" containerID="cri-o://5067a487a3ccdd11b36b32c4ba94fc68b64b337dc4e90c63ef6f4fa9844352e7" gracePeriod=30
Jul 07 18:28:38.440392 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.440354    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"]
Jul 07 18:28:38.440688 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.440674    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0da45355-2760-4d5a-86e2-65ebd78de090" containerName="istio-proxy"
Jul 07 18:28:38.440741 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.440690    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0da45355-2760-4d5a-86e2-65ebd78de090" containerName="istio-proxy"
Jul 07 18:28:38.440741 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.440714    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0da45355-2760-4d5a-86e2-65ebd78de090" containerName="istio-proxy"
Jul 07 18:28:38.440741 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.440719    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0da45355-2760-4d5a-86e2-65ebd78de090" containerName="istio-proxy"
Jul 07 18:28:38.440850 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.440780    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0da45355-2760-4d5a-86e2-65ebd78de090" containerName="istio-proxy"
Jul 07 18:28:38.440850 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.440792    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0da45355-2760-4d5a-86e2-65ebd78de090" containerName="istio-proxy"
Jul 07 18:28:38.445055 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.445039    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.451002 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.450978    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-a6b471-openshift-default-dockercfg-2gqq8\""
Jul 07 18:28:38.459241 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.459213    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"]
Jul 07 18:28:38.471203 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.471171    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-istio-envoy\") pod \"e2e-shared-a-a6b471-openshift-default-564885d44c-8trng\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") " pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.471354 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.471227    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-credential-socket\") pod \"e2e-shared-a-a6b471-openshift-default-564885d44c-8trng\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") " pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.471354 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.471285    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-workload-socket\") pod \"e2e-shared-a-a6b471-openshift-default-564885d44c-8trng\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") " pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.471354 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.471323    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/846c0923-1b5a-471d-9d50-133cb1ea60ab-istio-token\") pod \"e2e-shared-a-a6b471-openshift-default-564885d44c-8trng\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") " pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.471461 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.471368    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-workload-certs\") pod \"e2e-shared-a-a6b471-openshift-default-564885d44c-8trng\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") " pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.471461 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.471420    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/846c0923-1b5a-471d-9d50-133cb1ea60ab-istiod-ca-cert\") pod \"e2e-shared-a-a6b471-openshift-default-564885d44c-8trng\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") " pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.471461 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.471435    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv4k5\" (UniqueName: \"kubernetes.io/projected/846c0923-1b5a-471d-9d50-133cb1ea60ab-kube-api-access-mv4k5\") pod \"e2e-shared-a-a6b471-openshift-default-564885d44c-8trng\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") " pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.471559 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.471502    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-istio-data\") pod \"e2e-shared-a-a6b471-openshift-default-564885d44c-8trng\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") " pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.471559 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.471547    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/846c0923-1b5a-471d-9d50-133cb1ea60ab-istio-podinfo\") pod \"e2e-shared-a-a6b471-openshift-default-564885d44c-8trng\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") " pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.572966 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.572925    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-istio-data\") pod \"e2e-shared-a-a6b471-openshift-default-564885d44c-8trng\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") " pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.572966 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.572972    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/846c0923-1b5a-471d-9d50-133cb1ea60ab-istio-podinfo\") pod \"e2e-shared-a-a6b471-openshift-default-564885d44c-8trng\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") " pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.573267 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.572994    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-istio-envoy\") pod \"e2e-shared-a-a6b471-openshift-default-564885d44c-8trng\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") " pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.573267 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.573028    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-credential-socket\") pod \"e2e-shared-a-a6b471-openshift-default-564885d44c-8trng\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") " pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.573267 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.573056    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-workload-socket\") pod \"e2e-shared-a-a6b471-openshift-default-564885d44c-8trng\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") " pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.573267 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.573172    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/846c0923-1b5a-471d-9d50-133cb1ea60ab-istio-token\") pod \"e2e-shared-a-a6b471-openshift-default-564885d44c-8trng\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") " pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.573267 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.573218    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-workload-certs\") pod \"e2e-shared-a-a6b471-openshift-default-564885d44c-8trng\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") " pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.573267 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.573268    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/846c0923-1b5a-471d-9d50-133cb1ea60ab-istiod-ca-cert\") pod \"e2e-shared-a-a6b471-openshift-default-564885d44c-8trng\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") " pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.573576 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.573292    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv4k5\" (UniqueName: \"kubernetes.io/projected/846c0923-1b5a-471d-9d50-133cb1ea60ab-kube-api-access-mv4k5\") pod \"e2e-shared-a-a6b471-openshift-default-564885d44c-8trng\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") " pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.573576 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.573412    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-istio-data\") pod \"e2e-shared-a-a6b471-openshift-default-564885d44c-8trng\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") " pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.573662 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.573630    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-credential-socket\") pod \"e2e-shared-a-a6b471-openshift-default-564885d44c-8trng\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") " pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.573662 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.573647    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-workload-socket\") pod \"e2e-shared-a-a6b471-openshift-default-564885d44c-8trng\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") " pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.573782 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.573707    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-workload-certs\") pod \"e2e-shared-a-a6b471-openshift-default-564885d44c-8trng\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") " pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.574152 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.574130    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/846c0923-1b5a-471d-9d50-133cb1ea60ab-istiod-ca-cert\") pod \"e2e-shared-a-a6b471-openshift-default-564885d44c-8trng\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") " pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.575579 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.575556    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-istio-envoy\") pod \"e2e-shared-a-a6b471-openshift-default-564885d44c-8trng\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") " pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.575717 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.575701    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/846c0923-1b5a-471d-9d50-133cb1ea60ab-istio-podinfo\") pod \"e2e-shared-a-a6b471-openshift-default-564885d44c-8trng\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") " pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.582858 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.582813    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/846c0923-1b5a-471d-9d50-133cb1ea60ab-istio-token\") pod \"e2e-shared-a-a6b471-openshift-default-564885d44c-8trng\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") " pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.583117 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.583096    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv4k5\" (UniqueName: \"kubernetes.io/projected/846c0923-1b5a-471d-9d50-133cb1ea60ab-kube-api-access-mv4k5\") pod \"e2e-shared-a-a6b471-openshift-default-564885d44c-8trng\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") " pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.755388 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.755349    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:38.914971 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.914689    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"]
Jul 07 18:28:38.917855 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:28:38.917782    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod846c0923_1b5a_471d_9d50_133cb1ea60ab.slice/crio-ce2a1ad4e70849b063bbb8ce938cdb05ff09a069134d8129eba4c6fda4abb0c7 WatchSource:0}: Error finding container ce2a1ad4e70849b063bbb8ce938cdb05ff09a069134d8129eba4c6fda4abb0c7: Status 404 returned error can't find the container with id ce2a1ad4e70849b063bbb8ce938cdb05ff09a069134d8129eba4c6fda4abb0c7
Jul 07 18:28:38.920141 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.920106    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 18:28:38.920253 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.920194    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 18:28:38.920253 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:38.920242    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 18:28:39.725798 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:39.725756    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng" event={"ID":"846c0923-1b5a-471d-9d50-133cb1ea60ab","Type":"ContainerStarted","Data":"063a6602c2c4868465e38d2c52b835ebd866f1acb45d38efd3c2f48f5c1025e0"}
Jul 07 18:28:39.726310 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:39.725815    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng" event={"ID":"846c0923-1b5a-471d-9d50-133cb1ea60ab","Type":"ContainerStarted","Data":"ce2a1ad4e70849b063bbb8ce938cdb05ff09a069134d8129eba4c6fda4abb0c7"}
Jul 07 18:28:39.747425 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:39.747358    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng" podStartSLOduration=1.747337462 podStartE2EDuration="1.747337462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:28:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:28:39.74613721 +0000 UTC m=+2110.503698097" watchObservedRunningTime="2026-07-07 18:28:39.747337462 +0000 UTC m=+2110.504898334"
Jul 07 18:28:39.755881 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:39.755858    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:39.761336 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:39.761314    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:40.731364 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:40.731336    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:40.732457 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:40.732438    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:42.158683 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.158638    2566 patch_prober.go:28] interesting pod/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 18:28:42.159101 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.158721    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9" podUID="68111cec-f06c-4de2-9000-f1aee2579792" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 18:28:42.694680 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.694653    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:42.743260 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.743177    2566 generic.go:356] "Generic (PLEG): container finished" podID="68111cec-f06c-4de2-9000-f1aee2579792" containerID="5067a487a3ccdd11b36b32c4ba94fc68b64b337dc4e90c63ef6f4fa9844352e7" exitCode=0
Jul 07 18:28:42.743260 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.743225    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"
Jul 07 18:28:42.743457 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.743260    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9" event={"ID":"68111cec-f06c-4de2-9000-f1aee2579792","Type":"ContainerDied","Data":"5067a487a3ccdd11b36b32c4ba94fc68b64b337dc4e90c63ef6f4fa9844352e7"}
Jul 07 18:28:42.743457 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.743312    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9" event={"ID":"68111cec-f06c-4de2-9000-f1aee2579792","Type":"ContainerDied","Data":"c3911afd6a9a3953f65df006c55976ae1b4f1f2381c7373e8cc099245dbef5bb"}
Jul 07 18:28:42.743457 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.743342    2566 scope.go:117] "RemoveContainer" containerID="5067a487a3ccdd11b36b32c4ba94fc68b64b337dc4e90c63ef6f4fa9844352e7"
Jul 07 18:28:42.754006 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.753979    2566 scope.go:117] "RemoveContainer" containerID="f4ff6ced60b3414b853c67d5f4f415b2b7edd729ebf65f42e6c34624dd2bacd3"
Jul 07 18:28:42.762453 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.762420    2566 scope.go:117] "RemoveContainer" containerID="5067a487a3ccdd11b36b32c4ba94fc68b64b337dc4e90c63ef6f4fa9844352e7"
Jul 07 18:28:42.762729 ip-10-0-128-53 kubenswrapper[2566]: E0707 18:28:42.762709    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5067a487a3ccdd11b36b32c4ba94fc68b64b337dc4e90c63ef6f4fa9844352e7\": container with ID starting with 5067a487a3ccdd11b36b32c4ba94fc68b64b337dc4e90c63ef6f4fa9844352e7 not found: ID does not exist" containerID="5067a487a3ccdd11b36b32c4ba94fc68b64b337dc4e90c63ef6f4fa9844352e7"
Jul 07 18:28:42.762798 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.762738    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5067a487a3ccdd11b36b32c4ba94fc68b64b337dc4e90c63ef6f4fa9844352e7"} err="failed to get container status \"5067a487a3ccdd11b36b32c4ba94fc68b64b337dc4e90c63ef6f4fa9844352e7\": rpc error: code = NotFound desc = could not find container \"5067a487a3ccdd11b36b32c4ba94fc68b64b337dc4e90c63ef6f4fa9844352e7\": container with ID starting with 5067a487a3ccdd11b36b32c4ba94fc68b64b337dc4e90c63ef6f4fa9844352e7 not found: ID does not exist"
Jul 07 18:28:42.762798 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.762756    2566 scope.go:117] "RemoveContainer" containerID="f4ff6ced60b3414b853c67d5f4f415b2b7edd729ebf65f42e6c34624dd2bacd3"
Jul 07 18:28:42.763021 ip-10-0-128-53 kubenswrapper[2566]: E0707 18:28:42.763003    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4ff6ced60b3414b853c67d5f4f415b2b7edd729ebf65f42e6c34624dd2bacd3\": container with ID starting with f4ff6ced60b3414b853c67d5f4f415b2b7edd729ebf65f42e6c34624dd2bacd3 not found: ID does not exist" containerID="f4ff6ced60b3414b853c67d5f4f415b2b7edd729ebf65f42e6c34624dd2bacd3"
Jul 07 18:28:42.763059 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.763028    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4ff6ced60b3414b853c67d5f4f415b2b7edd729ebf65f42e6c34624dd2bacd3"} err="failed to get container status \"f4ff6ced60b3414b853c67d5f4f415b2b7edd729ebf65f42e6c34624dd2bacd3\": rpc error: code = NotFound desc = could not find container \"f4ff6ced60b3414b853c67d5f4f415b2b7edd729ebf65f42e6c34624dd2bacd3\": container with ID starting with f4ff6ced60b3414b853c67d5f4f415b2b7edd729ebf65f42e6c34624dd2bacd3 not found: ID does not exist"
Jul 07 18:28:42.810663 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.810618    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-credential-socket\") pod \"68111cec-f06c-4de2-9000-f1aee2579792\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") "
Jul 07 18:28:42.810871 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.810676    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-istio-data\") pod \"68111cec-f06c-4de2-9000-f1aee2579792\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") "
Jul 07 18:28:42.810871 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.810706    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-workload-socket\") pod \"68111cec-f06c-4de2-9000-f1aee2579792\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") "
Jul 07 18:28:42.810871 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.810728    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-istio-envoy\") pod \"68111cec-f06c-4de2-9000-f1aee2579792\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") "
Jul 07 18:28:42.810871 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.810754    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68111cec-f06c-4de2-9000-f1aee2579792-istiod-ca-cert\") pod \"68111cec-f06c-4de2-9000-f1aee2579792\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") "
Jul 07 18:28:42.810871 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.810775    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68111cec-f06c-4de2-9000-f1aee2579792-istio-token\") pod \"68111cec-f06c-4de2-9000-f1aee2579792\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") "
Jul 07 18:28:42.811138 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.810882    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68111cec-f06c-4de2-9000-f1aee2579792-istio-podinfo\") pod \"68111cec-f06c-4de2-9000-f1aee2579792\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") "
Jul 07 18:28:42.811138 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.810909    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trd2q\" (UniqueName: \"kubernetes.io/projected/68111cec-f06c-4de2-9000-f1aee2579792-kube-api-access-trd2q\") pod \"68111cec-f06c-4de2-9000-f1aee2579792\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") "
Jul 07 18:28:42.811138 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.810943    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-workload-certs\") pod \"68111cec-f06c-4de2-9000-f1aee2579792\" (UID: \"68111cec-f06c-4de2-9000-f1aee2579792\") "
Jul 07 18:28:42.811138 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.810987    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "68111cec-f06c-4de2-9000-f1aee2579792" (UID: "68111cec-f06c-4de2-9000-f1aee2579792"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:28:42.811138 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.811065    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "68111cec-f06c-4de2-9000-f1aee2579792" (UID: "68111cec-f06c-4de2-9000-f1aee2579792"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:28:42.811429 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.811262    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-credential-socket\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:28:42.811429 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.811282    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-workload-socket\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:28:42.811429 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.811284    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "68111cec-f06c-4de2-9000-f1aee2579792" (UID: "68111cec-f06c-4de2-9000-f1aee2579792"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:28:42.811429 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.811347    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68111cec-f06c-4de2-9000-f1aee2579792-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "68111cec-f06c-4de2-9000-f1aee2579792" (UID: "68111cec-f06c-4de2-9000-f1aee2579792"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:28:42.811743 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.811674    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-istio-data" (OuterVolumeSpecName: "istio-data") pod "68111cec-f06c-4de2-9000-f1aee2579792" (UID: "68111cec-f06c-4de2-9000-f1aee2579792"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:28:42.813267 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.813240    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "68111cec-f06c-4de2-9000-f1aee2579792" (UID: "68111cec-f06c-4de2-9000-f1aee2579792"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:28:42.813372 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.813352    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68111cec-f06c-4de2-9000-f1aee2579792-istio-token" (OuterVolumeSpecName: "istio-token") pod "68111cec-f06c-4de2-9000-f1aee2579792" (UID: "68111cec-f06c-4de2-9000-f1aee2579792"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:28:42.813920 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.813898    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/68111cec-f06c-4de2-9000-f1aee2579792-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "68111cec-f06c-4de2-9000-f1aee2579792" (UID: "68111cec-f06c-4de2-9000-f1aee2579792"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:28:42.813920 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.813902    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68111cec-f06c-4de2-9000-f1aee2579792-kube-api-access-trd2q" (OuterVolumeSpecName: "kube-api-access-trd2q") pod "68111cec-f06c-4de2-9000-f1aee2579792" (UID: "68111cec-f06c-4de2-9000-f1aee2579792"). InnerVolumeSpecName "kube-api-access-trd2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:28:42.912516 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.912481    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-istio-data\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:28:42.912516 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.912509    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-istio-envoy\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:28:42.912516 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.912518    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68111cec-f06c-4de2-9000-f1aee2579792-istiod-ca-cert\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:28:42.912516 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.912527    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68111cec-f06c-4de2-9000-f1aee2579792-istio-token\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:28:42.912776 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.912535    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68111cec-f06c-4de2-9000-f1aee2579792-istio-podinfo\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:28:42.912776 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.912542    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trd2q\" (UniqueName: \"kubernetes.io/projected/68111cec-f06c-4de2-9000-f1aee2579792-kube-api-access-trd2q\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:28:42.912776 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:42.912552    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68111cec-f06c-4de2-9000-f1aee2579792-workload-certs\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:28:43.067592 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:43.067556    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"]
Jul 07 18:28:43.071834 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:43.071789    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-c0421f-openshift-default-657c5bc5bf-dstm9"]
Jul 07 18:28:43.801002 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:43.800969    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68111cec-f06c-4de2-9000-f1aee2579792" path="/var/lib/kubelet/pods/68111cec-f06c-4de2-9000-f1aee2579792/volumes"
Jul 07 18:28:55.733527 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:55.733486    2566 patch_prober.go:28] interesting pod/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 07 18:28:55.733963 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:55.733557    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng" podUID="846c0923-1b5a-471d-9d50-133cb1ea60ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 07 18:28:55.812290 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:55.812254    2566 generic.go:356] "Generic (PLEG): container finished" podID="846c0923-1b5a-471d-9d50-133cb1ea60ab" containerID="063a6602c2c4868465e38d2c52b835ebd866f1acb45d38efd3c2f48f5c1025e0" exitCode=0
Jul 07 18:28:55.812458 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:55.812327    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng" event={"ID":"846c0923-1b5a-471d-9d50-133cb1ea60ab","Type":"ContainerDied","Data":"063a6602c2c4868465e38d2c52b835ebd866f1acb45d38efd3c2f48f5c1025e0"}
Jul 07 18:28:55.812689 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:55.812674    2566 scope.go:117] "RemoveContainer" containerID="063a6602c2c4868465e38d2c52b835ebd866f1acb45d38efd3c2f48f5c1025e0"
Jul 07 18:28:55.813637 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:55.813607    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 18:28:55.813684 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:55.813675    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 18:28:55.813724 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:55.813706    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 18:28:56.819879 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:56.819849    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng" event={"ID":"846c0923-1b5a-471d-9d50-133cb1ea60ab","Type":"ContainerStarted","Data":"749c84922579689de5af597690573860a324dfa95ff35c1bd20a592f061dd4b8"}
Jul 07 18:28:57.756796 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:57.756753    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:28:57.757078 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:57.756904    2566 patch_prober.go:28] interesting pod/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 07 18:28:57.757078 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:57.756945    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng" podUID="846c0923-1b5a-471d-9d50-133cb1ea60ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 07 18:28:58.755961 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:58.755915    2566 patch_prober.go:28] interesting pod/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 07 18:28:58.756473 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:58.755985    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng" podUID="846c0923-1b5a-471d-9d50-133cb1ea60ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 07 18:28:59.439563 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.439529    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"]
Jul 07 18:28:59.439887 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.439874    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68111cec-f06c-4de2-9000-f1aee2579792" containerName="istio-proxy"
Jul 07 18:28:59.439944 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.439889    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="68111cec-f06c-4de2-9000-f1aee2579792" containerName="istio-proxy"
Jul 07 18:28:59.439944 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.439904    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68111cec-f06c-4de2-9000-f1aee2579792" containerName="istio-proxy"
Jul 07 18:28:59.439944 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.439911    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="68111cec-f06c-4de2-9000-f1aee2579792" containerName="istio-proxy"
Jul 07 18:28:59.440037 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.439966    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="68111cec-f06c-4de2-9000-f1aee2579792" containerName="istio-proxy"
Jul 07 18:28:59.440037 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.439973    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="68111cec-f06c-4de2-9000-f1aee2579792" containerName="istio-proxy"
Jul 07 18:28:59.460854 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.458618    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"
Jul 07 18:28:59.466947 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.464567    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"]
Jul 07 18:28:59.466947 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.465085    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a6b471\"/\"default-dockercfg-h6t2x\""
Jul 07 18:28:59.466947 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.465365    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a6b471\"/\"kube-root-ca.crt\""
Jul 07 18:28:59.466947 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.465552    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a6b471\"/\"openshift-service-ca.crt\""
Jul 07 18:28:59.468852 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.467743    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a6b471\"/\"auth-test-model-a6b471-kserve-self-signed-certs\""
Jul 07 18:28:59.565480 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.565423    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb8gt\" (UniqueName: \"kubernetes.io/projected/5dd62f70-52e6-4c56-9363-9fda39161747-kube-api-access-zb8gt\") pod \"auth-test-model-a6b471-kserve-645d674cd7-j5rcw\" (UID: \"5dd62f70-52e6-4c56-9363-9fda39161747\") " pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"
Jul 07 18:28:59.565703 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.565537    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dd62f70-52e6-4c56-9363-9fda39161747-tls-certs\") pod \"auth-test-model-a6b471-kserve-645d674cd7-j5rcw\" (UID: \"5dd62f70-52e6-4c56-9363-9fda39161747\") " pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"
Jul 07 18:28:59.565703 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.565586    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dd62f70-52e6-4c56-9363-9fda39161747-home\") pod \"auth-test-model-a6b471-kserve-645d674cd7-j5rcw\" (UID: \"5dd62f70-52e6-4c56-9363-9fda39161747\") " pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"
Jul 07 18:28:59.565703 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.565615    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dd62f70-52e6-4c56-9363-9fda39161747-model-cache\") pod \"auth-test-model-a6b471-kserve-645d674cd7-j5rcw\" (UID: \"5dd62f70-52e6-4c56-9363-9fda39161747\") " pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"
Jul 07 18:28:59.565703 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.565653    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dd62f70-52e6-4c56-9363-9fda39161747-dshm\") pod \"auth-test-model-a6b471-kserve-645d674cd7-j5rcw\" (UID: \"5dd62f70-52e6-4c56-9363-9fda39161747\") " pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"
Jul 07 18:28:59.565703 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.565698    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dd62f70-52e6-4c56-9363-9fda39161747-tmp-dir\") pod \"auth-test-model-a6b471-kserve-645d674cd7-j5rcw\" (UID: \"5dd62f70-52e6-4c56-9363-9fda39161747\") " pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"
Jul 07 18:28:59.667100 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.667060    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb8gt\" (UniqueName: \"kubernetes.io/projected/5dd62f70-52e6-4c56-9363-9fda39161747-kube-api-access-zb8gt\") pod \"auth-test-model-a6b471-kserve-645d674cd7-j5rcw\" (UID: \"5dd62f70-52e6-4c56-9363-9fda39161747\") " pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"
Jul 07 18:28:59.667100 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.667113    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dd62f70-52e6-4c56-9363-9fda39161747-tls-certs\") pod \"auth-test-model-a6b471-kserve-645d674cd7-j5rcw\" (UID: \"5dd62f70-52e6-4c56-9363-9fda39161747\") " pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"
Jul 07 18:28:59.667328 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.667139    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dd62f70-52e6-4c56-9363-9fda39161747-home\") pod \"auth-test-model-a6b471-kserve-645d674cd7-j5rcw\" (UID: \"5dd62f70-52e6-4c56-9363-9fda39161747\") " pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"
Jul 07 18:28:59.667328 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.667158    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dd62f70-52e6-4c56-9363-9fda39161747-model-cache\") pod \"auth-test-model-a6b471-kserve-645d674cd7-j5rcw\" (UID: \"5dd62f70-52e6-4c56-9363-9fda39161747\") " pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"
Jul 07 18:28:59.667328 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.667182    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dd62f70-52e6-4c56-9363-9fda39161747-dshm\") pod \"auth-test-model-a6b471-kserve-645d674cd7-j5rcw\" (UID: \"5dd62f70-52e6-4c56-9363-9fda39161747\") " pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"
Jul 07 18:28:59.667328 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.667206    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dd62f70-52e6-4c56-9363-9fda39161747-tmp-dir\") pod \"auth-test-model-a6b471-kserve-645d674cd7-j5rcw\" (UID: \"5dd62f70-52e6-4c56-9363-9fda39161747\") " pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"
Jul 07 18:28:59.668036 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.667546    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dd62f70-52e6-4c56-9363-9fda39161747-tmp-dir\") pod \"auth-test-model-a6b471-kserve-645d674cd7-j5rcw\" (UID: \"5dd62f70-52e6-4c56-9363-9fda39161747\") " pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"
Jul 07 18:28:59.668036 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.667720    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dd62f70-52e6-4c56-9363-9fda39161747-home\") pod \"auth-test-model-a6b471-kserve-645d674cd7-j5rcw\" (UID: \"5dd62f70-52e6-4c56-9363-9fda39161747\") " pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"
Jul 07 18:28:59.668036 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.667747    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dd62f70-52e6-4c56-9363-9fda39161747-model-cache\") pod \"auth-test-model-a6b471-kserve-645d674cd7-j5rcw\" (UID: \"5dd62f70-52e6-4c56-9363-9fda39161747\") " pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"
Jul 07 18:28:59.670185 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.670162    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dd62f70-52e6-4c56-9363-9fda39161747-dshm\") pod \"auth-test-model-a6b471-kserve-645d674cd7-j5rcw\" (UID: \"5dd62f70-52e6-4c56-9363-9fda39161747\") " pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"
Jul 07 18:28:59.670767 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.670748    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dd62f70-52e6-4c56-9363-9fda39161747-tls-certs\") pod \"auth-test-model-a6b471-kserve-645d674cd7-j5rcw\" (UID: \"5dd62f70-52e6-4c56-9363-9fda39161747\") " pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"
Jul 07 18:28:59.678077 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.678051    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb8gt\" (UniqueName: \"kubernetes.io/projected/5dd62f70-52e6-4c56-9363-9fda39161747-kube-api-access-zb8gt\") pod \"auth-test-model-a6b471-kserve-645d674cd7-j5rcw\" (UID: \"5dd62f70-52e6-4c56-9363-9fda39161747\") " pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"
Jul 07 18:28:59.756363 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.756323    2566 patch_prober.go:28] interesting pod/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 07 18:28:59.756990 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.756957    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng" podUID="846c0923-1b5a-471d-9d50-133cb1ea60ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 07 18:28:59.776372 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.776340    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"
Jul 07 18:28:59.966968 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:28:59.966932    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"]
Jul 07 18:28:59.968174 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:28:59.968146    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5dd62f70_52e6_4c56_9363_9fda39161747.slice/crio-2ef42cac48668b8da0865a84565525b87e18bdbf2f4c4b0a54904d6e498f23a2 WatchSource:0}: Error finding container 2ef42cac48668b8da0865a84565525b87e18bdbf2f4c4b0a54904d6e498f23a2: Status 404 returned error can't find the container with id 2ef42cac48668b8da0865a84565525b87e18bdbf2f4c4b0a54904d6e498f23a2
Jul 07 18:29:00.756353 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:00.756310    2566 patch_prober.go:28] interesting pod/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 07 18:29:00.756580 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:00.756387    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng" podUID="846c0923-1b5a-471d-9d50-133cb1ea60ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 07 18:29:00.840279 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:00.840240    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw" event={"ID":"5dd62f70-52e6-4c56-9363-9fda39161747","Type":"ContainerStarted","Data":"94eebe2d4104cdec51bae2d27114e727c96a2d2e7fb7bcbb90ede0209251efdc"}
Jul 07 18:29:00.840279 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:00.840282    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw" event={"ID":"5dd62f70-52e6-4c56-9363-9fda39161747","Type":"ContainerStarted","Data":"2ef42cac48668b8da0865a84565525b87e18bdbf2f4c4b0a54904d6e498f23a2"}
Jul 07 18:29:00.862595 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:00.862510    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw" podStartSLOduration=1.862488156 podStartE2EDuration="1.862488156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:28:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:29:00.860357677 +0000 UTC m=+2131.617918554" watchObservedRunningTime="2026-07-07 18:29:00.862488156 +0000 UTC m=+2131.620049030"
Jul 07 18:29:01.760413 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:01.760385    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:29:01.760795 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:01.760729    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:29:01.761580 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:01.761563    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:29:09.776887 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:09.776851    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"
Jul 07 18:29:09.777364 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:09.776908    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"
Jul 07 18:29:09.789625 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:09.789600    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"
Jul 07 18:29:09.894264 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:09.894236    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"
Jul 07 18:29:39.653416 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:39.653379    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"]
Jul 07 18:29:39.656516 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:39.656499    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"
Jul 07 18:29:39.660929 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:39.660902    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-89d0f3\"/\"kube-root-ca.crt\""
Jul 07 18:29:39.661075 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:39.660945    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-89d0f3\"/\"auth-test-model-89d0f3-kserve-self-signed-certs\""
Jul 07 18:29:39.661075 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:39.661003    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-89d0f3\"/\"openshift-service-ca.crt\""
Jul 07 18:29:39.661075 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:39.661060    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-89d0f3\"/\"default-dockercfg-86524\""
Jul 07 18:29:39.673755 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:39.673724    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"]
Jul 07 18:29:39.696162 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:39.696135    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6281fa6-700e-4020-b6e8-9850e1d713db-tmp-dir\") pod \"auth-test-model-89d0f3-kserve-789d66795f-7kvq7\" (UID: \"c6281fa6-700e-4020-b6e8-9850e1d713db\") " pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"
Jul 07 18:29:39.696284 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:39.696182    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6281fa6-700e-4020-b6e8-9850e1d713db-home\") pod \"auth-test-model-89d0f3-kserve-789d66795f-7kvq7\" (UID: \"c6281fa6-700e-4020-b6e8-9850e1d713db\") " pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"
Jul 07 18:29:39.696284 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:39.696225    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6281fa6-700e-4020-b6e8-9850e1d713db-tls-certs\") pod \"auth-test-model-89d0f3-kserve-789d66795f-7kvq7\" (UID: \"c6281fa6-700e-4020-b6e8-9850e1d713db\") " pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"
Jul 07 18:29:39.696284 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:39.696258    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6281fa6-700e-4020-b6e8-9850e1d713db-dshm\") pod \"auth-test-model-89d0f3-kserve-789d66795f-7kvq7\" (UID: \"c6281fa6-700e-4020-b6e8-9850e1d713db\") " pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"
Jul 07 18:29:39.696395 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:39.696284    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6281fa6-700e-4020-b6e8-9850e1d713db-model-cache\") pod \"auth-test-model-89d0f3-kserve-789d66795f-7kvq7\" (UID: \"c6281fa6-700e-4020-b6e8-9850e1d713db\") " pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"
Jul 07 18:29:39.696395 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:39.696312    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8bm8\" (UniqueName: \"kubernetes.io/projected/c6281fa6-700e-4020-b6e8-9850e1d713db-kube-api-access-x8bm8\") pod \"auth-test-model-89d0f3-kserve-789d66795f-7kvq7\" (UID: \"c6281fa6-700e-4020-b6e8-9850e1d713db\") " pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"
Jul 07 18:29:39.797419 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:39.797383    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6281fa6-700e-4020-b6e8-9850e1d713db-home\") pod \"auth-test-model-89d0f3-kserve-789d66795f-7kvq7\" (UID: \"c6281fa6-700e-4020-b6e8-9850e1d713db\") " pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"
Jul 07 18:29:39.797591 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:39.797441    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6281fa6-700e-4020-b6e8-9850e1d713db-tls-certs\") pod \"auth-test-model-89d0f3-kserve-789d66795f-7kvq7\" (UID: \"c6281fa6-700e-4020-b6e8-9850e1d713db\") " pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"
Jul 07 18:29:39.797591 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:39.797473    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6281fa6-700e-4020-b6e8-9850e1d713db-dshm\") pod \"auth-test-model-89d0f3-kserve-789d66795f-7kvq7\" (UID: \"c6281fa6-700e-4020-b6e8-9850e1d713db\") " pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"
Jul 07 18:29:39.797697 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:39.797610    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6281fa6-700e-4020-b6e8-9850e1d713db-model-cache\") pod \"auth-test-model-89d0f3-kserve-789d66795f-7kvq7\" (UID: \"c6281fa6-700e-4020-b6e8-9850e1d713db\") " pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"
Jul 07 18:29:39.797697 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:39.797677    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8bm8\" (UniqueName: \"kubernetes.io/projected/c6281fa6-700e-4020-b6e8-9850e1d713db-kube-api-access-x8bm8\") pod \"auth-test-model-89d0f3-kserve-789d66795f-7kvq7\" (UID: \"c6281fa6-700e-4020-b6e8-9850e1d713db\") " pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"
Jul 07 18:29:39.797800 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:39.797758    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6281fa6-700e-4020-b6e8-9850e1d713db-tmp-dir\") pod \"auth-test-model-89d0f3-kserve-789d66795f-7kvq7\" (UID: \"c6281fa6-700e-4020-b6e8-9850e1d713db\") " pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"
Jul 07 18:29:39.797877 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:39.797817    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6281fa6-700e-4020-b6e8-9850e1d713db-home\") pod \"auth-test-model-89d0f3-kserve-789d66795f-7kvq7\" (UID: \"c6281fa6-700e-4020-b6e8-9850e1d713db\") " pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"
Jul 07 18:29:39.797964 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:39.797944    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6281fa6-700e-4020-b6e8-9850e1d713db-model-cache\") pod \"auth-test-model-89d0f3-kserve-789d66795f-7kvq7\" (UID: \"c6281fa6-700e-4020-b6e8-9850e1d713db\") " pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"
Jul 07 18:29:39.798102 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:39.798082    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6281fa6-700e-4020-b6e8-9850e1d713db-tmp-dir\") pod \"auth-test-model-89d0f3-kserve-789d66795f-7kvq7\" (UID: \"c6281fa6-700e-4020-b6e8-9850e1d713db\") " pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"
Jul 07 18:29:39.800487 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:39.800462    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6281fa6-700e-4020-b6e8-9850e1d713db-dshm\") pod \"auth-test-model-89d0f3-kserve-789d66795f-7kvq7\" (UID: \"c6281fa6-700e-4020-b6e8-9850e1d713db\") " pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"
Jul 07 18:29:39.800638 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:39.800622    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6281fa6-700e-4020-b6e8-9850e1d713db-tls-certs\") pod \"auth-test-model-89d0f3-kserve-789d66795f-7kvq7\" (UID: \"c6281fa6-700e-4020-b6e8-9850e1d713db\") " pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"
Jul 07 18:29:39.810318 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:39.810294    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8bm8\" (UniqueName: \"kubernetes.io/projected/c6281fa6-700e-4020-b6e8-9850e1d713db-kube-api-access-x8bm8\") pod \"auth-test-model-89d0f3-kserve-789d66795f-7kvq7\" (UID: \"c6281fa6-700e-4020-b6e8-9850e1d713db\") " pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"
Jul 07 18:29:39.965554 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:39.965514    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"
Jul 07 18:29:40.118840 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:40.118777    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"]
Jul 07 18:29:40.121030 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:29:40.121001    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6281fa6_700e_4020_b6e8_9850e1d713db.slice/crio-c139d71e9a1acc89104e58c1fd4227cc356d16e5c3742a57823b1dcbfa50b378 WatchSource:0}: Error finding container c139d71e9a1acc89104e58c1fd4227cc356d16e5c3742a57823b1dcbfa50b378: Status 404 returned error can't find the container with id c139d71e9a1acc89104e58c1fd4227cc356d16e5c3742a57823b1dcbfa50b378
Jul 07 18:29:41.038927 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:41.038882    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7" event={"ID":"c6281fa6-700e-4020-b6e8-9850e1d713db","Type":"ContainerStarted","Data":"59b6f3502dee900b02b9a083c86a912a1ab69fe24edee4c931cc2fb49b95b365"}
Jul 07 18:29:41.038927 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:41.038932    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7" event={"ID":"c6281fa6-700e-4020-b6e8-9850e1d713db","Type":"ContainerStarted","Data":"c139d71e9a1acc89104e58c1fd4227cc356d16e5c3742a57823b1dcbfa50b378"}
Jul 07 18:29:41.084271 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:41.084217    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7" podStartSLOduration=2.084199651 podStartE2EDuration="2.084199651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:29:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:29:41.081740839 +0000 UTC m=+2171.839301710" watchObservedRunningTime="2026-07-07 18:29:41.084199651 +0000 UTC m=+2171.841760522"
Jul 07 18:29:49.966194 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:49.966154    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"
Jul 07 18:29:49.966771 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:49.966220    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"
Jul 07 18:29:49.978625 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:49.978604    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"
Jul 07 18:29:50.093012 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:29:50.092986    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"
Jul 07 18:30:00.148280 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:00.148245    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-a6b471-29724150-7d9fp"]
Jul 07 18:30:00.152809 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:00.152785    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-89d0f3-29724150-lctt9"]
Jul 07 18:30:00.152964 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:00.152911    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-a6b471-29724150-7d9fp"
Jul 07 18:30:00.155852 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:00.155813    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-89d0f3-29724150-lctt9"
Jul 07 18:30:00.156061 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:00.156042    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-9jzgv\""
Jul 07 18:30:00.162279 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:00.162254    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-a6b471-29724150-7d9fp"]
Jul 07 18:30:00.165682 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:00.165657    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-89d0f3-29724150-lctt9"]
Jul 07 18:30:00.267578 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:00.267540    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w2qx\" (UniqueName: \"kubernetes.io/projected/2203d818-662a-42ee-8d0d-2a3540f3b607-kube-api-access-5w2qx\") pod \"maas-api-key-cleanup-e2e-shared-b-89d0f3-29724150-lctt9\" (UID: \"2203d818-662a-42ee-8d0d-2a3540f3b607\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-89d0f3-29724150-lctt9"
Jul 07 18:30:00.267578 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:00.267576    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzgfw\" (UniqueName: \"kubernetes.io/projected/34fb884e-5337-4ecf-9e5f-96f31241fa79-kube-api-access-lzgfw\") pod \"maas-api-key-cleanup-e2e-shared-a-a6b471-29724150-7d9fp\" (UID: \"34fb884e-5337-4ecf-9e5f-96f31241fa79\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-a6b471-29724150-7d9fp"
Jul 07 18:30:00.368700 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:00.368650    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w2qx\" (UniqueName: \"kubernetes.io/projected/2203d818-662a-42ee-8d0d-2a3540f3b607-kube-api-access-5w2qx\") pod \"maas-api-key-cleanup-e2e-shared-b-89d0f3-29724150-lctt9\" (UID: \"2203d818-662a-42ee-8d0d-2a3540f3b607\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-89d0f3-29724150-lctt9"
Jul 07 18:30:00.368700 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:00.368700    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzgfw\" (UniqueName: \"kubernetes.io/projected/34fb884e-5337-4ecf-9e5f-96f31241fa79-kube-api-access-lzgfw\") pod \"maas-api-key-cleanup-e2e-shared-a-a6b471-29724150-7d9fp\" (UID: \"34fb884e-5337-4ecf-9e5f-96f31241fa79\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-a6b471-29724150-7d9fp"
Jul 07 18:30:00.378167 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:00.378136    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w2qx\" (UniqueName: \"kubernetes.io/projected/2203d818-662a-42ee-8d0d-2a3540f3b607-kube-api-access-5w2qx\") pod \"maas-api-key-cleanup-e2e-shared-b-89d0f3-29724150-lctt9\" (UID: \"2203d818-662a-42ee-8d0d-2a3540f3b607\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-89d0f3-29724150-lctt9"
Jul 07 18:30:00.378167 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:00.378160    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzgfw\" (UniqueName: \"kubernetes.io/projected/34fb884e-5337-4ecf-9e5f-96f31241fa79-kube-api-access-lzgfw\") pod \"maas-api-key-cleanup-e2e-shared-a-a6b471-29724150-7d9fp\" (UID: \"34fb884e-5337-4ecf-9e5f-96f31241fa79\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-a6b471-29724150-7d9fp"
Jul 07 18:30:00.466602 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:00.466574    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-a6b471-29724150-7d9fp"
Jul 07 18:30:00.475660 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:00.475630    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-89d0f3-29724150-lctt9"
Jul 07 18:30:00.615963 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:00.615930    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-a6b471-29724150-7d9fp"]
Jul 07 18:30:00.617409 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:30:00.617371    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34fb884e_5337_4ecf_9e5f_96f31241fa79.slice/crio-d3945685dfd39aa6c0e3137a444b1a2bb5131f4ca88f5ac0bfd771d5dd3aa481 WatchSource:0}: Error finding container d3945685dfd39aa6c0e3137a444b1a2bb5131f4ca88f5ac0bfd771d5dd3aa481: Status 404 returned error can't find the container with id d3945685dfd39aa6c0e3137a444b1a2bb5131f4ca88f5ac0bfd771d5dd3aa481
Jul 07 18:30:00.844274 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:00.844246    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-89d0f3-29724150-lctt9"]
Jul 07 18:30:00.846416 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:30:00.846379    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2203d818_662a_42ee_8d0d_2a3540f3b607.slice/crio-a3bc9824d9f3ccf679ccb8d172734356bccf88a99caa8d74c4fab7283902b795 WatchSource:0}: Error finding container a3bc9824d9f3ccf679ccb8d172734356bccf88a99caa8d74c4fab7283902b795: Status 404 returned error can't find the container with id a3bc9824d9f3ccf679ccb8d172734356bccf88a99caa8d74c4fab7283902b795
Jul 07 18:30:01.135359 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:01.135243    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-a6b471-29724150-7d9fp" event={"ID":"34fb884e-5337-4ecf-9e5f-96f31241fa79","Type":"ContainerStarted","Data":"7bfc309501663edb86c49d0b2ff4f21d00fcfc2e1a122469caced645c97db89f"}
Jul 07 18:30:01.135359 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:01.135309    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-a6b471-29724150-7d9fp" event={"ID":"34fb884e-5337-4ecf-9e5f-96f31241fa79","Type":"ContainerStarted","Data":"d3945685dfd39aa6c0e3137a444b1a2bb5131f4ca88f5ac0bfd771d5dd3aa481"}
Jul 07 18:30:01.136465 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:01.136444    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-89d0f3-29724150-lctt9" event={"ID":"2203d818-662a-42ee-8d0d-2a3540f3b607","Type":"ContainerStarted","Data":"a3bc9824d9f3ccf679ccb8d172734356bccf88a99caa8d74c4fab7283902b795"}
Jul 07 18:30:01.153204 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:01.152799    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-a6b471-29724150-7d9fp" podStartSLOduration=1.152777989 podStartE2EDuration="1.152777989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:30:01.151767045 +0000 UTC m=+2191.909327941" watchObservedRunningTime="2026-07-07 18:30:01.152777989 +0000 UTC m=+2191.910338861"
Jul 07 18:30:02.142909 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:02.142875    2566 generic.go:356] "Generic (PLEG): container finished" podID="34fb884e-5337-4ecf-9e5f-96f31241fa79" containerID="7bfc309501663edb86c49d0b2ff4f21d00fcfc2e1a122469caced645c97db89f" exitCode=0
Jul 07 18:30:02.143147 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:02.142962    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-a6b471-29724150-7d9fp" event={"ID":"34fb884e-5337-4ecf-9e5f-96f31241fa79","Type":"ContainerDied","Data":"7bfc309501663edb86c49d0b2ff4f21d00fcfc2e1a122469caced645c97db89f"}
Jul 07 18:30:02.144501 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:02.144480    2566 generic.go:356] "Generic (PLEG): container finished" podID="2203d818-662a-42ee-8d0d-2a3540f3b607" containerID="1882c19aa4a8b1cbd6a4f2f189f8eea3af0987de0ed63c9bf0884c3ec258b435" exitCode=0
Jul 07 18:30:02.144553 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:02.144511    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-89d0f3-29724150-lctt9" event={"ID":"2203d818-662a-42ee-8d0d-2a3540f3b607","Type":"ContainerDied","Data":"1882c19aa4a8b1cbd6a4f2f189f8eea3af0987de0ed63c9bf0884c3ec258b435"}
Jul 07 18:30:03.320680 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:03.320656    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-a6b471-29724150-7d9fp"
Jul 07 18:30:03.323641 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:03.323623    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-89d0f3-29724150-lctt9"
Jul 07 18:30:03.495490 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:03.495461    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5w2qx\" (UniqueName: \"kubernetes.io/projected/2203d818-662a-42ee-8d0d-2a3540f3b607-kube-api-access-5w2qx\") pod \"2203d818-662a-42ee-8d0d-2a3540f3b607\" (UID: \"2203d818-662a-42ee-8d0d-2a3540f3b607\") "
Jul 07 18:30:03.495693 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:03.495501    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzgfw\" (UniqueName: \"kubernetes.io/projected/34fb884e-5337-4ecf-9e5f-96f31241fa79-kube-api-access-lzgfw\") pod \"34fb884e-5337-4ecf-9e5f-96f31241fa79\" (UID: \"34fb884e-5337-4ecf-9e5f-96f31241fa79\") "
Jul 07 18:30:03.497867 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:03.497836    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2203d818-662a-42ee-8d0d-2a3540f3b607-kube-api-access-5w2qx" (OuterVolumeSpecName: "kube-api-access-5w2qx") pod "2203d818-662a-42ee-8d0d-2a3540f3b607" (UID: "2203d818-662a-42ee-8d0d-2a3540f3b607"). InnerVolumeSpecName "kube-api-access-5w2qx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:30:03.497981 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:03.497876    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34fb884e-5337-4ecf-9e5f-96f31241fa79-kube-api-access-lzgfw" (OuterVolumeSpecName: "kube-api-access-lzgfw") pod "34fb884e-5337-4ecf-9e5f-96f31241fa79" (UID: "34fb884e-5337-4ecf-9e5f-96f31241fa79"). InnerVolumeSpecName "kube-api-access-lzgfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:30:03.596474 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:03.596437    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5w2qx\" (UniqueName: \"kubernetes.io/projected/2203d818-662a-42ee-8d0d-2a3540f3b607-kube-api-access-5w2qx\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:30:03.596474 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:03.596469    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzgfw\" (UniqueName: \"kubernetes.io/projected/34fb884e-5337-4ecf-9e5f-96f31241fa79-kube-api-access-lzgfw\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:30:04.156365 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:04.156273    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-a6b471-29724150-7d9fp"
Jul 07 18:30:04.156365 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:04.156278    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-a6b471-29724150-7d9fp" event={"ID":"34fb884e-5337-4ecf-9e5f-96f31241fa79","Type":"ContainerDied","Data":"d3945685dfd39aa6c0e3137a444b1a2bb5131f4ca88f5ac0bfd771d5dd3aa481"}
Jul 07 18:30:04.156582 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:04.156428    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d3945685dfd39aa6c0e3137a444b1a2bb5131f4ca88f5ac0bfd771d5dd3aa481"
Jul 07 18:30:04.157492 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:04.157467    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-89d0f3-29724150-lctt9" event={"ID":"2203d818-662a-42ee-8d0d-2a3540f3b607","Type":"ContainerDied","Data":"a3bc9824d9f3ccf679ccb8d172734356bccf88a99caa8d74c4fab7283902b795"}
Jul 07 18:30:04.157492 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:04.157489    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-89d0f3-29724150-lctt9"
Jul 07 18:30:04.157655 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:30:04.157506    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3bc9824d9f3ccf679ccb8d172734356bccf88a99caa8d74c4fab7283902b795"
Jul 07 18:31:48.231304 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:48.231270    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"]
Jul 07 18:31:49.125206 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:49.125167    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"]
Jul 07 18:31:54.539342 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.539306    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"]
Jul 07 18:31:54.539767 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.539635    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2203d818-662a-42ee-8d0d-2a3540f3b607" containerName="cleanup"
Jul 07 18:31:54.539767 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.539646    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2203d818-662a-42ee-8d0d-2a3540f3b607" containerName="cleanup"
Jul 07 18:31:54.539767 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.539658    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34fb884e-5337-4ecf-9e5f-96f31241fa79" containerName="cleanup"
Jul 07 18:31:54.539767 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.539663    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="34fb884e-5337-4ecf-9e5f-96f31241fa79" containerName="cleanup"
Jul 07 18:31:54.539767 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.539712    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="34fb884e-5337-4ecf-9e5f-96f31241fa79" containerName="cleanup"
Jul 07 18:31:54.539767 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.539722    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="2203d818-662a-42ee-8d0d-2a3540f3b607" containerName="cleanup"
Jul 07 18:31:54.542535 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.542518    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"
Jul 07 18:31:54.545626 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.545603    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a6b471\"/\"sub-test-model-a6b471-kserve-self-signed-certs\""
Jul 07 18:31:54.552195 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.552173    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"]
Jul 07 18:31:54.634363 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.634332    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c2d18a7-01ac-4d67-8055-7802cf790dda-tmp-dir\") pod \"sub-test-model-a6b471-kserve-5444d57cb5-8vrzv\" (UID: \"3c2d18a7-01ac-4d67-8055-7802cf790dda\") " pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"
Jul 07 18:31:54.634363 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.634364    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c2d18a7-01ac-4d67-8055-7802cf790dda-tls-certs\") pod \"sub-test-model-a6b471-kserve-5444d57cb5-8vrzv\" (UID: \"3c2d18a7-01ac-4d67-8055-7802cf790dda\") " pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"
Jul 07 18:31:54.634568 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.634403    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c2d18a7-01ac-4d67-8055-7802cf790dda-dshm\") pod \"sub-test-model-a6b471-kserve-5444d57cb5-8vrzv\" (UID: \"3c2d18a7-01ac-4d67-8055-7802cf790dda\") " pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"
Jul 07 18:31:54.634568 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.634420    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c2d18a7-01ac-4d67-8055-7802cf790dda-model-cache\") pod \"sub-test-model-a6b471-kserve-5444d57cb5-8vrzv\" (UID: \"3c2d18a7-01ac-4d67-8055-7802cf790dda\") " pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"
Jul 07 18:31:54.634568 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.634451    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c2d18a7-01ac-4d67-8055-7802cf790dda-home\") pod \"sub-test-model-a6b471-kserve-5444d57cb5-8vrzv\" (UID: \"3c2d18a7-01ac-4d67-8055-7802cf790dda\") " pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"
Jul 07 18:31:54.634568 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.634508    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvzlx\" (UniqueName: \"kubernetes.io/projected/3c2d18a7-01ac-4d67-8055-7802cf790dda-kube-api-access-fvzlx\") pod \"sub-test-model-a6b471-kserve-5444d57cb5-8vrzv\" (UID: \"3c2d18a7-01ac-4d67-8055-7802cf790dda\") " pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"
Jul 07 18:31:54.735919 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.735891    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c2d18a7-01ac-4d67-8055-7802cf790dda-tmp-dir\") pod \"sub-test-model-a6b471-kserve-5444d57cb5-8vrzv\" (UID: \"3c2d18a7-01ac-4d67-8055-7802cf790dda\") " pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"
Jul 07 18:31:54.735919 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.735921    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c2d18a7-01ac-4d67-8055-7802cf790dda-tls-certs\") pod \"sub-test-model-a6b471-kserve-5444d57cb5-8vrzv\" (UID: \"3c2d18a7-01ac-4d67-8055-7802cf790dda\") " pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"
Jul 07 18:31:54.736159 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.735966    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c2d18a7-01ac-4d67-8055-7802cf790dda-dshm\") pod \"sub-test-model-a6b471-kserve-5444d57cb5-8vrzv\" (UID: \"3c2d18a7-01ac-4d67-8055-7802cf790dda\") " pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"
Jul 07 18:31:54.736159 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.735990    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c2d18a7-01ac-4d67-8055-7802cf790dda-model-cache\") pod \"sub-test-model-a6b471-kserve-5444d57cb5-8vrzv\" (UID: \"3c2d18a7-01ac-4d67-8055-7802cf790dda\") " pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"
Jul 07 18:31:54.736159 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.736031    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c2d18a7-01ac-4d67-8055-7802cf790dda-home\") pod \"sub-test-model-a6b471-kserve-5444d57cb5-8vrzv\" (UID: \"3c2d18a7-01ac-4d67-8055-7802cf790dda\") " pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"
Jul 07 18:31:54.736159 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.736100    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvzlx\" (UniqueName: \"kubernetes.io/projected/3c2d18a7-01ac-4d67-8055-7802cf790dda-kube-api-access-fvzlx\") pod \"sub-test-model-a6b471-kserve-5444d57cb5-8vrzv\" (UID: \"3c2d18a7-01ac-4d67-8055-7802cf790dda\") " pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"
Jul 07 18:31:54.736383 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.736361    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c2d18a7-01ac-4d67-8055-7802cf790dda-tmp-dir\") pod \"sub-test-model-a6b471-kserve-5444d57cb5-8vrzv\" (UID: \"3c2d18a7-01ac-4d67-8055-7802cf790dda\") " pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"
Jul 07 18:31:54.736470 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.736450    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c2d18a7-01ac-4d67-8055-7802cf790dda-home\") pod \"sub-test-model-a6b471-kserve-5444d57cb5-8vrzv\" (UID: \"3c2d18a7-01ac-4d67-8055-7802cf790dda\") " pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"
Jul 07 18:31:54.736531 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.736487    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c2d18a7-01ac-4d67-8055-7802cf790dda-model-cache\") pod \"sub-test-model-a6b471-kserve-5444d57cb5-8vrzv\" (UID: \"3c2d18a7-01ac-4d67-8055-7802cf790dda\") " pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"
Jul 07 18:31:54.738406 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.738379    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c2d18a7-01ac-4d67-8055-7802cf790dda-dshm\") pod \"sub-test-model-a6b471-kserve-5444d57cb5-8vrzv\" (UID: \"3c2d18a7-01ac-4d67-8055-7802cf790dda\") " pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"
Jul 07 18:31:54.738575 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.738556    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c2d18a7-01ac-4d67-8055-7802cf790dda-tls-certs\") pod \"sub-test-model-a6b471-kserve-5444d57cb5-8vrzv\" (UID: \"3c2d18a7-01ac-4d67-8055-7802cf790dda\") " pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"
Jul 07 18:31:54.745558 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.745530    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvzlx\" (UniqueName: \"kubernetes.io/projected/3c2d18a7-01ac-4d67-8055-7802cf790dda-kube-api-access-fvzlx\") pod \"sub-test-model-a6b471-kserve-5444d57cb5-8vrzv\" (UID: \"3c2d18a7-01ac-4d67-8055-7802cf790dda\") " pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"
Jul 07 18:31:54.852928 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.852810    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"
Jul 07 18:31:54.984226 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:54.984202    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"]
Jul 07 18:31:54.986563 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:31:54.986539    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c2d18a7_01ac_4d67_8055_7802cf790dda.slice/crio-426c9d9bfe9132ffdd5c3f845277b9e483eae959e1994c3583038118ecb0b71e WatchSource:0}: Error finding container 426c9d9bfe9132ffdd5c3f845277b9e483eae959e1994c3583038118ecb0b71e: Status 404 returned error can't find the container with id 426c9d9bfe9132ffdd5c3f845277b9e483eae959e1994c3583038118ecb0b71e
Jul 07 18:31:55.721906 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:55.721868    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv" event={"ID":"3c2d18a7-01ac-4d67-8055-7802cf790dda","Type":"ContainerStarted","Data":"6c8d9d7345bdc9dfb1ca3a0105ff723b0dfac1ecf586fc786fe66641af5931ed"}
Jul 07 18:31:55.722304 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:55.721914    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv" event={"ID":"3c2d18a7-01ac-4d67-8055-7802cf790dda","Type":"ContainerStarted","Data":"426c9d9bfe9132ffdd5c3f845277b9e483eae959e1994c3583038118ecb0b71e"}
Jul 07 18:31:55.742539 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:31:55.742487    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv" podStartSLOduration=1.7424703400000001 podStartE2EDuration="1.74247034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:31:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:31:55.740218594 +0000 UTC m=+2306.497779466" watchObservedRunningTime="2026-07-07 18:31:55.74247034 +0000 UTC m=+2306.500031211"
Jul 07 18:32:03.251346 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.251285    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw" podUID="5dd62f70-52e6-4c56-9363-9fda39161747" containerName="main" containerID="cri-o://94eebe2d4104cdec51bae2d27114e727c96a2d2e7fb7bcbb90ede0209251efdc" gracePeriod=45
Jul 07 18:32:03.511091 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.511021    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"
Jul 07 18:32:03.607538 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.607508    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dd62f70-52e6-4c56-9363-9fda39161747-tmp-dir\") pod \"5dd62f70-52e6-4c56-9363-9fda39161747\" (UID: \"5dd62f70-52e6-4c56-9363-9fda39161747\") "
Jul 07 18:32:03.607725 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.607560    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dd62f70-52e6-4c56-9363-9fda39161747-tls-certs\") pod \"5dd62f70-52e6-4c56-9363-9fda39161747\" (UID: \"5dd62f70-52e6-4c56-9363-9fda39161747\") "
Jul 07 18:32:03.607725 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.607615    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dd62f70-52e6-4c56-9363-9fda39161747-model-cache\") pod \"5dd62f70-52e6-4c56-9363-9fda39161747\" (UID: \"5dd62f70-52e6-4c56-9363-9fda39161747\") "
Jul 07 18:32:03.607725 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.607636    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dd62f70-52e6-4c56-9363-9fda39161747-home\") pod \"5dd62f70-52e6-4c56-9363-9fda39161747\" (UID: \"5dd62f70-52e6-4c56-9363-9fda39161747\") "
Jul 07 18:32:03.607725 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.607669    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dd62f70-52e6-4c56-9363-9fda39161747-dshm\") pod \"5dd62f70-52e6-4c56-9363-9fda39161747\" (UID: \"5dd62f70-52e6-4c56-9363-9fda39161747\") "
Jul 07 18:32:03.607725 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.607694    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zb8gt\" (UniqueName: \"kubernetes.io/projected/5dd62f70-52e6-4c56-9363-9fda39161747-kube-api-access-zb8gt\") pod \"5dd62f70-52e6-4c56-9363-9fda39161747\" (UID: \"5dd62f70-52e6-4c56-9363-9fda39161747\") "
Jul 07 18:32:03.608026 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.607815    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dd62f70-52e6-4c56-9363-9fda39161747-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5dd62f70-52e6-4c56-9363-9fda39161747" (UID: "5dd62f70-52e6-4c56-9363-9fda39161747"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:32:03.608026 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.607922    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dd62f70-52e6-4c56-9363-9fda39161747-model-cache" (OuterVolumeSpecName: "model-cache") pod "5dd62f70-52e6-4c56-9363-9fda39161747" (UID: "5dd62f70-52e6-4c56-9363-9fda39161747"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:32:03.608026 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.607968    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dd62f70-52e6-4c56-9363-9fda39161747-home" (OuterVolumeSpecName: "home") pod "5dd62f70-52e6-4c56-9363-9fda39161747" (UID: "5dd62f70-52e6-4c56-9363-9fda39161747"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:32:03.608026 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.608014    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dd62f70-52e6-4c56-9363-9fda39161747-model-cache\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:32:03.608155 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.608030    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dd62f70-52e6-4c56-9363-9fda39161747-tmp-dir\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:32:03.610061 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.610024    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dd62f70-52e6-4c56-9363-9fda39161747-dshm" (OuterVolumeSpecName: "dshm") pod "5dd62f70-52e6-4c56-9363-9fda39161747" (UID: "5dd62f70-52e6-4c56-9363-9fda39161747"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:32:03.610431 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.610406    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dd62f70-52e6-4c56-9363-9fda39161747-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5dd62f70-52e6-4c56-9363-9fda39161747" (UID: "5dd62f70-52e6-4c56-9363-9fda39161747"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:32:03.610523 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.610429    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dd62f70-52e6-4c56-9363-9fda39161747-kube-api-access-zb8gt" (OuterVolumeSpecName: "kube-api-access-zb8gt") pod "5dd62f70-52e6-4c56-9363-9fda39161747" (UID: "5dd62f70-52e6-4c56-9363-9fda39161747"). InnerVolumeSpecName "kube-api-access-zb8gt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:32:03.708432 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.708398    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dd62f70-52e6-4c56-9363-9fda39161747-home\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:32:03.708432 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.708424    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dd62f70-52e6-4c56-9363-9fda39161747-dshm\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:32:03.708432 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.708434    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zb8gt\" (UniqueName: \"kubernetes.io/projected/5dd62f70-52e6-4c56-9363-9fda39161747-kube-api-access-zb8gt\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:32:03.708432 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.708446    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dd62f70-52e6-4c56-9363-9fda39161747-tls-certs\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:32:03.767782 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.767694    2566 generic.go:356] "Generic (PLEG): container finished" podID="5dd62f70-52e6-4c56-9363-9fda39161747" containerID="94eebe2d4104cdec51bae2d27114e727c96a2d2e7fb7bcbb90ede0209251efdc" exitCode=0
Jul 07 18:32:03.767782 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.767751    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"
Jul 07 18:32:03.768041 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.767756    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw" event={"ID":"5dd62f70-52e6-4c56-9363-9fda39161747","Type":"ContainerDied","Data":"94eebe2d4104cdec51bae2d27114e727c96a2d2e7fb7bcbb90ede0209251efdc"}
Jul 07 18:32:03.768041 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.767876    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw" event={"ID":"5dd62f70-52e6-4c56-9363-9fda39161747","Type":"ContainerDied","Data":"2ef42cac48668b8da0865a84565525b87e18bdbf2f4c4b0a54904d6e498f23a2"}
Jul 07 18:32:03.768041 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.767907    2566 scope.go:117] "RemoveContainer" containerID="94eebe2d4104cdec51bae2d27114e727c96a2d2e7fb7bcbb90ede0209251efdc"
Jul 07 18:32:03.777174 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.777158    2566 scope.go:117] "RemoveContainer" containerID="94eebe2d4104cdec51bae2d27114e727c96a2d2e7fb7bcbb90ede0209251efdc"
Jul 07 18:32:03.777435 ip-10-0-128-53 kubenswrapper[2566]: E0707 18:32:03.777417    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94eebe2d4104cdec51bae2d27114e727c96a2d2e7fb7bcbb90ede0209251efdc\": container with ID starting with 94eebe2d4104cdec51bae2d27114e727c96a2d2e7fb7bcbb90ede0209251efdc not found: ID does not exist" containerID="94eebe2d4104cdec51bae2d27114e727c96a2d2e7fb7bcbb90ede0209251efdc"
Jul 07 18:32:03.777498 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.777444    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94eebe2d4104cdec51bae2d27114e727c96a2d2e7fb7bcbb90ede0209251efdc"} err="failed to get container status \"94eebe2d4104cdec51bae2d27114e727c96a2d2e7fb7bcbb90ede0209251efdc\": rpc error: code = NotFound desc = could not find container \"94eebe2d4104cdec51bae2d27114e727c96a2d2e7fb7bcbb90ede0209251efdc\": container with ID starting with 94eebe2d4104cdec51bae2d27114e727c96a2d2e7fb7bcbb90ede0209251efdc not found: ID does not exist"
Jul 07 18:32:03.793630 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.793600    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"]
Jul 07 18:32:03.806524 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:03.806502    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a6b471/auth-test-model-a6b471-kserve-645d674cd7-j5rcw"]
Jul 07 18:32:04.145189 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.145094    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7" podUID="c6281fa6-700e-4020-b6e8-9850e1d713db" containerName="main" containerID="cri-o://59b6f3502dee900b02b9a083c86a912a1ab69fe24edee4c931cc2fb49b95b365" gracePeriod=45
Jul 07 18:32:04.400763 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.400702    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"
Jul 07 18:32:04.516269 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.516239    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6281fa6-700e-4020-b6e8-9850e1d713db-tmp-dir\") pod \"c6281fa6-700e-4020-b6e8-9850e1d713db\" (UID: \"c6281fa6-700e-4020-b6e8-9850e1d713db\") "
Jul 07 18:32:04.516481 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.516288    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6281fa6-700e-4020-b6e8-9850e1d713db-dshm\") pod \"c6281fa6-700e-4020-b6e8-9850e1d713db\" (UID: \"c6281fa6-700e-4020-b6e8-9850e1d713db\") "
Jul 07 18:32:04.516481 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.516338    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6281fa6-700e-4020-b6e8-9850e1d713db-home\") pod \"c6281fa6-700e-4020-b6e8-9850e1d713db\" (UID: \"c6281fa6-700e-4020-b6e8-9850e1d713db\") "
Jul 07 18:32:04.516481 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.516355    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6281fa6-700e-4020-b6e8-9850e1d713db-tls-certs\") pod \"c6281fa6-700e-4020-b6e8-9850e1d713db\" (UID: \"c6281fa6-700e-4020-b6e8-9850e1d713db\") "
Jul 07 18:32:04.516481 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.516378    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6281fa6-700e-4020-b6e8-9850e1d713db-model-cache\") pod \"c6281fa6-700e-4020-b6e8-9850e1d713db\" (UID: \"c6281fa6-700e-4020-b6e8-9850e1d713db\") "
Jul 07 18:32:04.516481 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.516414    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8bm8\" (UniqueName: \"kubernetes.io/projected/c6281fa6-700e-4020-b6e8-9850e1d713db-kube-api-access-x8bm8\") pod \"c6281fa6-700e-4020-b6e8-9850e1d713db\" (UID: \"c6281fa6-700e-4020-b6e8-9850e1d713db\") "
Jul 07 18:32:04.516734 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.516603    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6281fa6-700e-4020-b6e8-9850e1d713db-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c6281fa6-700e-4020-b6e8-9850e1d713db" (UID: "c6281fa6-700e-4020-b6e8-9850e1d713db"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:32:04.516734 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.516662    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6281fa6-700e-4020-b6e8-9850e1d713db-home" (OuterVolumeSpecName: "home") pod "c6281fa6-700e-4020-b6e8-9850e1d713db" (UID: "c6281fa6-700e-4020-b6e8-9850e1d713db"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:32:04.516734 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.516686    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6281fa6-700e-4020-b6e8-9850e1d713db-model-cache" (OuterVolumeSpecName: "model-cache") pod "c6281fa6-700e-4020-b6e8-9850e1d713db" (UID: "c6281fa6-700e-4020-b6e8-9850e1d713db"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:32:04.516869 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.516768    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6281fa6-700e-4020-b6e8-9850e1d713db-home\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:32:04.516869 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.516787    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6281fa6-700e-4020-b6e8-9850e1d713db-model-cache\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:32:04.516869 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.516855    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6281fa6-700e-4020-b6e8-9850e1d713db-tmp-dir\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:32:04.518912 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.518875    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6281fa6-700e-4020-b6e8-9850e1d713db-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c6281fa6-700e-4020-b6e8-9850e1d713db" (UID: "c6281fa6-700e-4020-b6e8-9850e1d713db"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:32:04.519016 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.518923    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6281fa6-700e-4020-b6e8-9850e1d713db-kube-api-access-x8bm8" (OuterVolumeSpecName: "kube-api-access-x8bm8") pod "c6281fa6-700e-4020-b6e8-9850e1d713db" (UID: "c6281fa6-700e-4020-b6e8-9850e1d713db"). InnerVolumeSpecName "kube-api-access-x8bm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:32:04.519016 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.518954    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6281fa6-700e-4020-b6e8-9850e1d713db-dshm" (OuterVolumeSpecName: "dshm") pod "c6281fa6-700e-4020-b6e8-9850e1d713db" (UID: "c6281fa6-700e-4020-b6e8-9850e1d713db"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:32:04.617772 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.617730    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6281fa6-700e-4020-b6e8-9850e1d713db-tls-certs\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:32:04.617772 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.617766    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8bm8\" (UniqueName: \"kubernetes.io/projected/c6281fa6-700e-4020-b6e8-9850e1d713db-kube-api-access-x8bm8\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:32:04.617996 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.617779    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6281fa6-700e-4020-b6e8-9850e1d713db-dshm\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:32:04.775474 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.775440    2566 generic.go:356] "Generic (PLEG): container finished" podID="c6281fa6-700e-4020-b6e8-9850e1d713db" containerID="59b6f3502dee900b02b9a083c86a912a1ab69fe24edee4c931cc2fb49b95b365" exitCode=0
Jul 07 18:32:04.775652 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.775486    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"
Jul 07 18:32:04.775652 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.775508    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7" event={"ID":"c6281fa6-700e-4020-b6e8-9850e1d713db","Type":"ContainerDied","Data":"59b6f3502dee900b02b9a083c86a912a1ab69fe24edee4c931cc2fb49b95b365"}
Jul 07 18:32:04.775652 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.775539    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7" event={"ID":"c6281fa6-700e-4020-b6e8-9850e1d713db","Type":"ContainerDied","Data":"c139d71e9a1acc89104e58c1fd4227cc356d16e5c3742a57823b1dcbfa50b378"}
Jul 07 18:32:04.775652 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.775557    2566 scope.go:117] "RemoveContainer" containerID="59b6f3502dee900b02b9a083c86a912a1ab69fe24edee4c931cc2fb49b95b365"
Jul 07 18:32:04.784781 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.784762    2566 scope.go:117] "RemoveContainer" containerID="59b6f3502dee900b02b9a083c86a912a1ab69fe24edee4c931cc2fb49b95b365"
Jul 07 18:32:04.785073 ip-10-0-128-53 kubenswrapper[2566]: E0707 18:32:04.785047    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59b6f3502dee900b02b9a083c86a912a1ab69fe24edee4c931cc2fb49b95b365\": container with ID starting with 59b6f3502dee900b02b9a083c86a912a1ab69fe24edee4c931cc2fb49b95b365 not found: ID does not exist" containerID="59b6f3502dee900b02b9a083c86a912a1ab69fe24edee4c931cc2fb49b95b365"
Jul 07 18:32:04.785153 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.785085    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59b6f3502dee900b02b9a083c86a912a1ab69fe24edee4c931cc2fb49b95b365"} err="failed to get container status \"59b6f3502dee900b02b9a083c86a912a1ab69fe24edee4c931cc2fb49b95b365\": rpc error: code = NotFound desc = could not find container \"59b6f3502dee900b02b9a083c86a912a1ab69fe24edee4c931cc2fb49b95b365\": container with ID starting with 59b6f3502dee900b02b9a083c86a912a1ab69fe24edee4c931cc2fb49b95b365 not found: ID does not exist"
Jul 07 18:32:04.798244 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.798218    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"]
Jul 07 18:32:04.801685 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.801657    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-89d0f3/auth-test-model-89d0f3-kserve-789d66795f-7kvq7"]
Jul 07 18:32:04.853877 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.853841    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"
Jul 07 18:32:04.854017 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.853888    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"
Jul 07 18:32:04.866396 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:04.866366    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"
Jul 07 18:32:05.793164 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:05.793138    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"
Jul 07 18:32:05.800586 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:05.800560    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dd62f70-52e6-4c56-9363-9fda39161747" path="/var/lib/kubelet/pods/5dd62f70-52e6-4c56-9363-9fda39161747/volumes"
Jul 07 18:32:05.801027 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:05.800988    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6281fa6-700e-4020-b6e8-9850e1d713db" path="/var/lib/kubelet/pods/c6281fa6-700e-4020-b6e8-9850e1d713db/volumes"
Jul 07 18:32:28.639939 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.639854    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"]
Jul 07 18:32:28.640368 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.640163    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6281fa6-700e-4020-b6e8-9850e1d713db" containerName="main"
Jul 07 18:32:28.640368 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.640174    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6281fa6-700e-4020-b6e8-9850e1d713db" containerName="main"
Jul 07 18:32:28.640368 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.640195    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dd62f70-52e6-4c56-9363-9fda39161747" containerName="main"
Jul 07 18:32:28.640368 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.640201    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dd62f70-52e6-4c56-9363-9fda39161747" containerName="main"
Jul 07 18:32:28.640368 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.640257    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dd62f70-52e6-4c56-9363-9fda39161747" containerName="main"
Jul 07 18:32:28.640368 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.640265    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6281fa6-700e-4020-b6e8-9850e1d713db" containerName="main"
Jul 07 18:32:28.644712 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.644696    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"
Jul 07 18:32:28.649304 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.649073    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-89d0f3\"/\"openshift-service-ca.crt\""
Jul 07 18:32:28.649304 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.649248    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-89d0f3\"/\"default-dockercfg-86524\""
Jul 07 18:32:28.649851 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.649335    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-89d0f3\"/\"kube-root-ca.crt\""
Jul 07 18:32:28.649851 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.649477    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-89d0f3\"/\"sub-test-model-89d0f3-kserve-self-signed-certs\""
Jul 07 18:32:28.653333 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.653307    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"]
Jul 07 18:32:28.720180 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.720150    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-home\") pod \"sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk\" (UID: \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\") " pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"
Jul 07 18:32:28.720342 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.720203    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-dshm\") pod \"sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk\" (UID: \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\") " pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"
Jul 07 18:32:28.720342 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.720237    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-tmp-dir\") pod \"sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk\" (UID: \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\") " pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"
Jul 07 18:32:28.720342 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.720267    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6622\" (UniqueName: \"kubernetes.io/projected/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-kube-api-access-c6622\") pod \"sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk\" (UID: \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\") " pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"
Jul 07 18:32:28.720342 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.720300    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-model-cache\") pod \"sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk\" (UID: \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\") " pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"
Jul 07 18:32:28.720542 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.720379    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-tls-certs\") pod \"sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk\" (UID: \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\") " pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"
Jul 07 18:32:28.821471 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.821436    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-home\") pod \"sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk\" (UID: \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\") " pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"
Jul 07 18:32:28.821666 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.821492    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-dshm\") pod \"sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk\" (UID: \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\") " pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"
Jul 07 18:32:28.821666 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.821516    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-tmp-dir\") pod \"sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk\" (UID: \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\") " pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"
Jul 07 18:32:28.821666 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.821552    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6622\" (UniqueName: \"kubernetes.io/projected/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-kube-api-access-c6622\") pod \"sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk\" (UID: \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\") " pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"
Jul 07 18:32:28.821666 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.821595    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-model-cache\") pod \"sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk\" (UID: \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\") " pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"
Jul 07 18:32:28.821666 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.821634    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-tls-certs\") pod \"sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk\" (UID: \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\") " pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"
Jul 07 18:32:28.821975 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.821919    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-home\") pod \"sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk\" (UID: \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\") " pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"
Jul 07 18:32:28.822018 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.821971    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-tmp-dir\") pod \"sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk\" (UID: \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\") " pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"
Jul 07 18:32:28.822018 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.822011    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-model-cache\") pod \"sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk\" (UID: \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\") " pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"
Jul 07 18:32:28.824036 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.824017    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-dshm\") pod \"sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk\" (UID: \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\") " pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"
Jul 07 18:32:28.824301 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.824281    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-tls-certs\") pod \"sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk\" (UID: \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\") " pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"
Jul 07 18:32:28.830223 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.830200    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6622\" (UniqueName: \"kubernetes.io/projected/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-kube-api-access-c6622\") pod \"sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk\" (UID: \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\") " pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"
Jul 07 18:32:28.954856 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:28.954739    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"
Jul 07 18:32:29.092501 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:29.092476    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"]
Jul 07 18:32:29.094388 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:32:29.094365    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8cd428ff_3b61_4ad4_a22f_0b853bfebd73.slice/crio-440055b029697c8335dc564d48c3a8351597dac742b40e07c758f3caed302c8a WatchSource:0}: Error finding container 440055b029697c8335dc564d48c3a8351597dac742b40e07c758f3caed302c8a: Status 404 returned error can't find the container with id 440055b029697c8335dc564d48c3a8351597dac742b40e07c758f3caed302c8a
Jul 07 18:32:29.902485 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:29.902446    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk" event={"ID":"8cd428ff-3b61-4ad4-a22f-0b853bfebd73","Type":"ContainerStarted","Data":"670867039bb5d871f3b30b1b2ae162bf3ded4c39667cc02fa58f80e1da2dce8b"}
Jul 07 18:32:29.902870 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:29.902492    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk" event={"ID":"8cd428ff-3b61-4ad4-a22f-0b853bfebd73","Type":"ContainerStarted","Data":"440055b029697c8335dc564d48c3a8351597dac742b40e07c758f3caed302c8a"}
Jul 07 18:32:29.923231 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:29.923175    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk" podStartSLOduration=1.923158517 podStartE2EDuration="1.923158517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:32:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:32:29.920954336 +0000 UTC m=+2340.678515205" watchObservedRunningTime="2026-07-07 18:32:29.923158517 +0000 UTC m=+2340.680719388"
Jul 07 18:32:38.955648 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:38.955608    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"
Jul 07 18:32:38.956076 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:38.955667    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"
Jul 07 18:32:38.967907 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:38.967880    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"
Jul 07 18:32:39.963644 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:32:39.963612    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"
Jul 07 18:33:08.777228 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:08.777187    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"]
Jul 07 18:33:09.624728 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:09.624695    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"]
Jul 07 18:33:11.933031 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:11.932995    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"]
Jul 07 18:33:11.936366 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:11.936348    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"
Jul 07 18:33:11.939471 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:11.939449    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a6b471\"/\"rate-test-model-a6b471-kserve-self-signed-certs\""
Jul 07 18:33:11.947787 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:11.947761    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"]
Jul 07 18:33:12.004876 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:12.004839    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/356b12ab-fb33-4e5e-aa96-d99961ff5b32-home\") pod \"rate-test-model-a6b471-kserve-b4cc785ff-xjfdc\" (UID: \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\") " pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"
Jul 07 18:33:12.005074 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:12.004894    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/356b12ab-fb33-4e5e-aa96-d99961ff5b32-dshm\") pod \"rate-test-model-a6b471-kserve-b4cc785ff-xjfdc\" (UID: \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\") " pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"
Jul 07 18:33:12.005074 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:12.004921    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhdlh\" (UniqueName: \"kubernetes.io/projected/356b12ab-fb33-4e5e-aa96-d99961ff5b32-kube-api-access-bhdlh\") pod \"rate-test-model-a6b471-kserve-b4cc785ff-xjfdc\" (UID: \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\") " pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"
Jul 07 18:33:12.005074 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:12.004951    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/356b12ab-fb33-4e5e-aa96-d99961ff5b32-model-cache\") pod \"rate-test-model-a6b471-kserve-b4cc785ff-xjfdc\" (UID: \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\") " pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"
Jul 07 18:33:12.005210 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:12.005080    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/356b12ab-fb33-4e5e-aa96-d99961ff5b32-tmp-dir\") pod \"rate-test-model-a6b471-kserve-b4cc785ff-xjfdc\" (UID: \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\") " pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"
Jul 07 18:33:12.005210 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:12.005118    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/356b12ab-fb33-4e5e-aa96-d99961ff5b32-tls-certs\") pod \"rate-test-model-a6b471-kserve-b4cc785ff-xjfdc\" (UID: \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\") " pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"
Jul 07 18:33:12.106101 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:12.106063    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/356b12ab-fb33-4e5e-aa96-d99961ff5b32-dshm\") pod \"rate-test-model-a6b471-kserve-b4cc785ff-xjfdc\" (UID: \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\") " pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"
Jul 07 18:33:12.106287 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:12.106103    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhdlh\" (UniqueName: \"kubernetes.io/projected/356b12ab-fb33-4e5e-aa96-d99961ff5b32-kube-api-access-bhdlh\") pod \"rate-test-model-a6b471-kserve-b4cc785ff-xjfdc\" (UID: \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\") " pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"
Jul 07 18:33:12.106287 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:12.106130    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/356b12ab-fb33-4e5e-aa96-d99961ff5b32-model-cache\") pod \"rate-test-model-a6b471-kserve-b4cc785ff-xjfdc\" (UID: \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\") " pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"
Jul 07 18:33:12.106287 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:12.106202    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/356b12ab-fb33-4e5e-aa96-d99961ff5b32-tmp-dir\") pod \"rate-test-model-a6b471-kserve-b4cc785ff-xjfdc\" (UID: \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\") " pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"
Jul 07 18:33:12.106287 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:12.106225    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/356b12ab-fb33-4e5e-aa96-d99961ff5b32-tls-certs\") pod \"rate-test-model-a6b471-kserve-b4cc785ff-xjfdc\" (UID: \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\") " pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"
Jul 07 18:33:12.106287 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:12.106270    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/356b12ab-fb33-4e5e-aa96-d99961ff5b32-home\") pod \"rate-test-model-a6b471-kserve-b4cc785ff-xjfdc\" (UID: \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\") " pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"
Jul 07 18:33:12.106632 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:12.106610    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/356b12ab-fb33-4e5e-aa96-d99961ff5b32-model-cache\") pod \"rate-test-model-a6b471-kserve-b4cc785ff-xjfdc\" (UID: \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\") " pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"
Jul 07 18:33:12.106705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:12.106648    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/356b12ab-fb33-4e5e-aa96-d99961ff5b32-tmp-dir\") pod \"rate-test-model-a6b471-kserve-b4cc785ff-xjfdc\" (UID: \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\") " pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"
Jul 07 18:33:12.106705 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:12.106688    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/356b12ab-fb33-4e5e-aa96-d99961ff5b32-home\") pod \"rate-test-model-a6b471-kserve-b4cc785ff-xjfdc\" (UID: \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\") " pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"
Jul 07 18:33:12.108621 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:12.108598    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/356b12ab-fb33-4e5e-aa96-d99961ff5b32-dshm\") pod \"rate-test-model-a6b471-kserve-b4cc785ff-xjfdc\" (UID: \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\") " pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"
Jul 07 18:33:12.108891 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:12.108872    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/356b12ab-fb33-4e5e-aa96-d99961ff5b32-tls-certs\") pod \"rate-test-model-a6b471-kserve-b4cc785ff-xjfdc\" (UID: \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\") " pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"
Jul 07 18:33:12.115408 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:12.115385    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhdlh\" (UniqueName: \"kubernetes.io/projected/356b12ab-fb33-4e5e-aa96-d99961ff5b32-kube-api-access-bhdlh\") pod \"rate-test-model-a6b471-kserve-b4cc785ff-xjfdc\" (UID: \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\") " pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"
Jul 07 18:33:12.245929 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:12.245869    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"
Jul 07 18:33:12.390766 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:12.390735    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"]
Jul 07 18:33:12.392244 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:33:12.392216    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod356b12ab_fb33_4e5e_aa96_d99961ff5b32.slice/crio-ea20b11cdb95a344b27ba7bf7fe69bed703bda1cc66a95c0cb5cec089b69cce2 WatchSource:0}: Error finding container ea20b11cdb95a344b27ba7bf7fe69bed703bda1cc66a95c0cb5cec089b69cce2: Status 404 returned error can't find the container with id ea20b11cdb95a344b27ba7bf7fe69bed703bda1cc66a95c0cb5cec089b69cce2
Jul 07 18:33:13.117248 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:13.117208    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc" event={"ID":"356b12ab-fb33-4e5e-aa96-d99961ff5b32","Type":"ContainerStarted","Data":"74ef915eba250201d2d1bc3475b72f37a0c5834e1eebc31bba30fe01676cf6f6"}
Jul 07 18:33:13.117248 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:13.117251    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc" event={"ID":"356b12ab-fb33-4e5e-aa96-d99961ff5b32","Type":"ContainerStarted","Data":"ea20b11cdb95a344b27ba7bf7fe69bed703bda1cc66a95c0cb5cec089b69cce2"}
Jul 07 18:33:13.139668 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:13.139618    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc" podStartSLOduration=2.139602798 podStartE2EDuration="2.139602798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:33:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:33:13.136806905 +0000 UTC m=+2383.894367776" watchObservedRunningTime="2026-07-07 18:33:13.139602798 +0000 UTC m=+2383.897163668"
Jul 07 18:33:22.246382 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:22.246336    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"
Jul 07 18:33:22.246382 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:22.246395    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"
Jul 07 18:33:22.259315 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:22.259287    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"
Jul 07 18:33:23.185450 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:23.185413    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"
Jul 07 18:33:23.797645 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:23.797608    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv" podUID="3c2d18a7-01ac-4d67-8055-7802cf790dda" containerName="main" containerID="cri-o://6c8d9d7345bdc9dfb1ca3a0105ff723b0dfac1ecf586fc786fe66641af5931ed" gracePeriod=45
Jul 07 18:33:24.059962 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.059904    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"
Jul 07 18:33:24.105158 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.105132    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c2d18a7-01ac-4d67-8055-7802cf790dda-model-cache\") pod \"3c2d18a7-01ac-4d67-8055-7802cf790dda\" (UID: \"3c2d18a7-01ac-4d67-8055-7802cf790dda\") "
Jul 07 18:33:24.105335 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.105207    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c2d18a7-01ac-4d67-8055-7802cf790dda-tmp-dir\") pod \"3c2d18a7-01ac-4d67-8055-7802cf790dda\" (UID: \"3c2d18a7-01ac-4d67-8055-7802cf790dda\") "
Jul 07 18:33:24.105335 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.105235    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c2d18a7-01ac-4d67-8055-7802cf790dda-home\") pod \"3c2d18a7-01ac-4d67-8055-7802cf790dda\" (UID: \"3c2d18a7-01ac-4d67-8055-7802cf790dda\") "
Jul 07 18:33:24.105335 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.105258    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c2d18a7-01ac-4d67-8055-7802cf790dda-tls-certs\") pod \"3c2d18a7-01ac-4d67-8055-7802cf790dda\" (UID: \"3c2d18a7-01ac-4d67-8055-7802cf790dda\") "
Jul 07 18:33:24.105335 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.105282    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c2d18a7-01ac-4d67-8055-7802cf790dda-dshm\") pod \"3c2d18a7-01ac-4d67-8055-7802cf790dda\" (UID: \"3c2d18a7-01ac-4d67-8055-7802cf790dda\") "
Jul 07 18:33:24.105335 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.105300    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvzlx\" (UniqueName: \"kubernetes.io/projected/3c2d18a7-01ac-4d67-8055-7802cf790dda-kube-api-access-fvzlx\") pod \"3c2d18a7-01ac-4d67-8055-7802cf790dda\" (UID: \"3c2d18a7-01ac-4d67-8055-7802cf790dda\") "
Jul 07 18:33:24.105610 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.105469    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c2d18a7-01ac-4d67-8055-7802cf790dda-model-cache" (OuterVolumeSpecName: "model-cache") pod "3c2d18a7-01ac-4d67-8055-7802cf790dda" (UID: "3c2d18a7-01ac-4d67-8055-7802cf790dda"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:33:24.105610 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.105509    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c2d18a7-01ac-4d67-8055-7802cf790dda-home" (OuterVolumeSpecName: "home") pod "3c2d18a7-01ac-4d67-8055-7802cf790dda" (UID: "3c2d18a7-01ac-4d67-8055-7802cf790dda"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:33:24.105610 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.105519    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c2d18a7-01ac-4d67-8055-7802cf790dda-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3c2d18a7-01ac-4d67-8055-7802cf790dda" (UID: "3c2d18a7-01ac-4d67-8055-7802cf790dda"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:33:24.107528 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.107498    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c2d18a7-01ac-4d67-8055-7802cf790dda-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3c2d18a7-01ac-4d67-8055-7802cf790dda" (UID: "3c2d18a7-01ac-4d67-8055-7802cf790dda"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:33:24.107626 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.107584    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c2d18a7-01ac-4d67-8055-7802cf790dda-dshm" (OuterVolumeSpecName: "dshm") pod "3c2d18a7-01ac-4d67-8055-7802cf790dda" (UID: "3c2d18a7-01ac-4d67-8055-7802cf790dda"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:33:24.107668 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.107653    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c2d18a7-01ac-4d67-8055-7802cf790dda-kube-api-access-fvzlx" (OuterVolumeSpecName: "kube-api-access-fvzlx") pod "3c2d18a7-01ac-4d67-8055-7802cf790dda" (UID: "3c2d18a7-01ac-4d67-8055-7802cf790dda"). InnerVolumeSpecName "kube-api-access-fvzlx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:33:24.180422 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.180386    2566 generic.go:356] "Generic (PLEG): container finished" podID="3c2d18a7-01ac-4d67-8055-7802cf790dda" containerID="6c8d9d7345bdc9dfb1ca3a0105ff723b0dfac1ecf586fc786fe66641af5931ed" exitCode=0
Jul 07 18:33:24.180602 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.180429    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"
Jul 07 18:33:24.180602 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.180460    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv" event={"ID":"3c2d18a7-01ac-4d67-8055-7802cf790dda","Type":"ContainerDied","Data":"6c8d9d7345bdc9dfb1ca3a0105ff723b0dfac1ecf586fc786fe66641af5931ed"}
Jul 07 18:33:24.180602 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.180491    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv" event={"ID":"3c2d18a7-01ac-4d67-8055-7802cf790dda","Type":"ContainerDied","Data":"426c9d9bfe9132ffdd5c3f845277b9e483eae959e1994c3583038118ecb0b71e"}
Jul 07 18:33:24.180602 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.180507    2566 scope.go:117] "RemoveContainer" containerID="6c8d9d7345bdc9dfb1ca3a0105ff723b0dfac1ecf586fc786fe66641af5931ed"
Jul 07 18:33:24.189517 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.189498    2566 scope.go:117] "RemoveContainer" containerID="6c8d9d7345bdc9dfb1ca3a0105ff723b0dfac1ecf586fc786fe66641af5931ed"
Jul 07 18:33:24.189818 ip-10-0-128-53 kubenswrapper[2566]: E0707 18:33:24.189799    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c8d9d7345bdc9dfb1ca3a0105ff723b0dfac1ecf586fc786fe66641af5931ed\": container with ID starting with 6c8d9d7345bdc9dfb1ca3a0105ff723b0dfac1ecf586fc786fe66641af5931ed not found: ID does not exist" containerID="6c8d9d7345bdc9dfb1ca3a0105ff723b0dfac1ecf586fc786fe66641af5931ed"
Jul 07 18:33:24.189948 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.189857    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c8d9d7345bdc9dfb1ca3a0105ff723b0dfac1ecf586fc786fe66641af5931ed"} err="failed to get container status \"6c8d9d7345bdc9dfb1ca3a0105ff723b0dfac1ecf586fc786fe66641af5931ed\": rpc error: code = NotFound desc = could not find container \"6c8d9d7345bdc9dfb1ca3a0105ff723b0dfac1ecf586fc786fe66641af5931ed\": container with ID starting with 6c8d9d7345bdc9dfb1ca3a0105ff723b0dfac1ecf586fc786fe66641af5931ed not found: ID does not exist"
Jul 07 18:33:24.204600 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.204570    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"]
Jul 07 18:33:24.206388 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.206361    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c2d18a7-01ac-4d67-8055-7802cf790dda-dshm\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:33:24.206388 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.206386    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvzlx\" (UniqueName: \"kubernetes.io/projected/3c2d18a7-01ac-4d67-8055-7802cf790dda-kube-api-access-fvzlx\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:33:24.206544 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.206395    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c2d18a7-01ac-4d67-8055-7802cf790dda-model-cache\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:33:24.206544 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.206406    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c2d18a7-01ac-4d67-8055-7802cf790dda-tmp-dir\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:33:24.206544 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.206414    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c2d18a7-01ac-4d67-8055-7802cf790dda-home\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:33:24.206544 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.206421    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c2d18a7-01ac-4d67-8055-7802cf790dda-tls-certs\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:33:24.208455 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.208433    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a6b471/sub-test-model-a6b471-kserve-5444d57cb5-8vrzv"]
Jul 07 18:33:24.644673 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.644606    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk" podUID="8cd428ff-3b61-4ad4-a22f-0b853bfebd73" containerName="main" containerID="cri-o://670867039bb5d871f3b30b1b2ae162bf3ded4c39667cc02fa58f80e1da2dce8b" gracePeriod=45
Jul 07 18:33:24.901707 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:24.901623    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"
Jul 07 18:33:25.013214 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.013182    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6622\" (UniqueName: \"kubernetes.io/projected/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-kube-api-access-c6622\") pod \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\" (UID: \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\") "
Jul 07 18:33:25.013407 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.013224    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-home\") pod \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\" (UID: \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\") "
Jul 07 18:33:25.013407 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.013251    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-model-cache\") pod \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\" (UID: \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\") "
Jul 07 18:33:25.013407 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.013374    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-tls-certs\") pod \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\" (UID: \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\") "
Jul 07 18:33:25.013585 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.013424    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-dshm\") pod \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\" (UID: \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\") "
Jul 07 18:33:25.013585 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.013477    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-tmp-dir\") pod \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\" (UID: \"8cd428ff-3b61-4ad4-a22f-0b853bfebd73\") "
Jul 07 18:33:25.013585 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.013502    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-home" (OuterVolumeSpecName: "home") pod "8cd428ff-3b61-4ad4-a22f-0b853bfebd73" (UID: "8cd428ff-3b61-4ad4-a22f-0b853bfebd73"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:33:25.013585 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.013576    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-model-cache" (OuterVolumeSpecName: "model-cache") pod "8cd428ff-3b61-4ad4-a22f-0b853bfebd73" (UID: "8cd428ff-3b61-4ad4-a22f-0b853bfebd73"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:33:25.013783 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.013719    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8cd428ff-3b61-4ad4-a22f-0b853bfebd73" (UID: "8cd428ff-3b61-4ad4-a22f-0b853bfebd73"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:33:25.013870 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.013785    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-tmp-dir\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:33:25.013870 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.013805    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-home\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:33:25.013870 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.013819    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-model-cache\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:33:25.015752 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.015724    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-dshm" (OuterVolumeSpecName: "dshm") pod "8cd428ff-3b61-4ad4-a22f-0b853bfebd73" (UID: "8cd428ff-3b61-4ad4-a22f-0b853bfebd73"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:33:25.016082 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.016061    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8cd428ff-3b61-4ad4-a22f-0b853bfebd73" (UID: "8cd428ff-3b61-4ad4-a22f-0b853bfebd73"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:33:25.016082 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.016066    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-kube-api-access-c6622" (OuterVolumeSpecName: "kube-api-access-c6622") pod "8cd428ff-3b61-4ad4-a22f-0b853bfebd73" (UID: "8cd428ff-3b61-4ad4-a22f-0b853bfebd73"). InnerVolumeSpecName "kube-api-access-c6622". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:33:25.114382 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.114346    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6622\" (UniqueName: \"kubernetes.io/projected/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-kube-api-access-c6622\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:33:25.114382 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.114379    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-tls-certs\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:33:25.114382 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.114394    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8cd428ff-3b61-4ad4-a22f-0b853bfebd73-dshm\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:33:25.187580 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.187487    2566 generic.go:356] "Generic (PLEG): container finished" podID="8cd428ff-3b61-4ad4-a22f-0b853bfebd73" containerID="670867039bb5d871f3b30b1b2ae162bf3ded4c39667cc02fa58f80e1da2dce8b" exitCode=0
Jul 07 18:33:25.187580 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.187532    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"
Jul 07 18:33:25.187781 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.187579    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk" event={"ID":"8cd428ff-3b61-4ad4-a22f-0b853bfebd73","Type":"ContainerDied","Data":"670867039bb5d871f3b30b1b2ae162bf3ded4c39667cc02fa58f80e1da2dce8b"}
Jul 07 18:33:25.187781 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.187616    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk" event={"ID":"8cd428ff-3b61-4ad4-a22f-0b853bfebd73","Type":"ContainerDied","Data":"440055b029697c8335dc564d48c3a8351597dac742b40e07c758f3caed302c8a"}
Jul 07 18:33:25.187781 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.187634    2566 scope.go:117] "RemoveContainer" containerID="670867039bb5d871f3b30b1b2ae162bf3ded4c39667cc02fa58f80e1da2dce8b"
Jul 07 18:33:25.197089 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.197069    2566 scope.go:117] "RemoveContainer" containerID="670867039bb5d871f3b30b1b2ae162bf3ded4c39667cc02fa58f80e1da2dce8b"
Jul 07 18:33:25.197399 ip-10-0-128-53 kubenswrapper[2566]: E0707 18:33:25.197377    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"670867039bb5d871f3b30b1b2ae162bf3ded4c39667cc02fa58f80e1da2dce8b\": container with ID starting with 670867039bb5d871f3b30b1b2ae162bf3ded4c39667cc02fa58f80e1da2dce8b not found: ID does not exist" containerID="670867039bb5d871f3b30b1b2ae162bf3ded4c39667cc02fa58f80e1da2dce8b"
Jul 07 18:33:25.197467 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.197411    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"670867039bb5d871f3b30b1b2ae162bf3ded4c39667cc02fa58f80e1da2dce8b"} err="failed to get container status \"670867039bb5d871f3b30b1b2ae162bf3ded4c39667cc02fa58f80e1da2dce8b\": rpc error: code = NotFound desc = could not find container \"670867039bb5d871f3b30b1b2ae162bf3ded4c39667cc02fa58f80e1da2dce8b\": container with ID starting with 670867039bb5d871f3b30b1b2ae162bf3ded4c39667cc02fa58f80e1da2dce8b not found: ID does not exist"
Jul 07 18:33:25.209372 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.209337    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"]
Jul 07 18:33:25.213283 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.213256    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-89d0f3/sub-test-model-89d0f3-kserve-7fd7fb8bc9-4g5kk"]
Jul 07 18:33:25.800399 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.800361    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c2d18a7-01ac-4d67-8055-7802cf790dda" path="/var/lib/kubelet/pods/3c2d18a7-01ac-4d67-8055-7802cf790dda/volumes"
Jul 07 18:33:25.800764 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:25.800751    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cd428ff-3b61-4ad4-a22f-0b853bfebd73" path="/var/lib/kubelet/pods/8cd428ff-3b61-4ad4-a22f-0b853bfebd73/volumes"
Jul 07 18:33:29.910455 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:29.910425    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lcfnl_9bc45238-7341-43fe-a75f-231dbf7a3704/console-operator/1.log"
Jul 07 18:33:29.917314 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:29.917289    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lcfnl_9bc45238-7341-43fe-a75f-231dbf7a3704/console-operator/1.log"
Jul 07 18:33:55.845471 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:55.845439    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"]
Jul 07 18:33:55.847862 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:55.845790    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c2d18a7-01ac-4d67-8055-7802cf790dda" containerName="main"
Jul 07 18:33:55.847862 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:55.845801    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c2d18a7-01ac-4d67-8055-7802cf790dda" containerName="main"
Jul 07 18:33:55.847862 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:55.845815    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd428ff-3b61-4ad4-a22f-0b853bfebd73" containerName="main"
Jul 07 18:33:55.847862 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:55.845839    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd428ff-3b61-4ad4-a22f-0b853bfebd73" containerName="main"
Jul 07 18:33:55.847862 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:55.845898    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cd428ff-3b61-4ad4-a22f-0b853bfebd73" containerName="main"
Jul 07 18:33:55.847862 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:55.845907    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c2d18a7-01ac-4d67-8055-7802cf790dda" containerName="main"
Jul 07 18:33:55.848776 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:55.848759    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"
Jul 07 18:33:55.851986 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:55.851965    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-89d0f3\"/\"openshift-service-ca.crt\""
Jul 07 18:33:55.853125 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:55.853105    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-89d0f3\"/\"kube-root-ca.crt\""
Jul 07 18:33:55.853240 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:55.853171    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-89d0f3\"/\"default-dockercfg-86524\""
Jul 07 18:33:55.853353 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:55.853267    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-89d0f3\"/\"rate-test-model-89d0f3-kserve-self-signed-certs\""
Jul 07 18:33:55.863287 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:55.863206    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"]
Jul 07 18:33:55.979487 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:55.979449    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a31fd83c-a374-4beb-bdf6-fd240c236001-model-cache\") pod \"rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7\" (UID: \"a31fd83c-a374-4beb-bdf6-fd240c236001\") " pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"
Jul 07 18:33:55.979487 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:55.979489    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a31fd83c-a374-4beb-bdf6-fd240c236001-tmp-dir\") pod \"rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7\" (UID: \"a31fd83c-a374-4beb-bdf6-fd240c236001\") " pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"
Jul 07 18:33:55.979701 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:55.979526    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a31fd83c-a374-4beb-bdf6-fd240c236001-dshm\") pod \"rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7\" (UID: \"a31fd83c-a374-4beb-bdf6-fd240c236001\") " pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"
Jul 07 18:33:55.979701 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:55.979617    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhcks\" (UniqueName: \"kubernetes.io/projected/a31fd83c-a374-4beb-bdf6-fd240c236001-kube-api-access-bhcks\") pod \"rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7\" (UID: \"a31fd83c-a374-4beb-bdf6-fd240c236001\") " pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"
Jul 07 18:33:55.979701 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:55.979654    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a31fd83c-a374-4beb-bdf6-fd240c236001-tls-certs\") pod \"rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7\" (UID: \"a31fd83c-a374-4beb-bdf6-fd240c236001\") " pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"
Jul 07 18:33:55.979701 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:55.979680    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a31fd83c-a374-4beb-bdf6-fd240c236001-home\") pod \"rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7\" (UID: \"a31fd83c-a374-4beb-bdf6-fd240c236001\") " pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"
Jul 07 18:33:56.080771 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:56.080733    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhcks\" (UniqueName: \"kubernetes.io/projected/a31fd83c-a374-4beb-bdf6-fd240c236001-kube-api-access-bhcks\") pod \"rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7\" (UID: \"a31fd83c-a374-4beb-bdf6-fd240c236001\") " pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"
Jul 07 18:33:56.080771 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:56.080774    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a31fd83c-a374-4beb-bdf6-fd240c236001-tls-certs\") pod \"rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7\" (UID: \"a31fd83c-a374-4beb-bdf6-fd240c236001\") " pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"
Jul 07 18:33:56.081037 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:56.080795    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a31fd83c-a374-4beb-bdf6-fd240c236001-home\") pod \"rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7\" (UID: \"a31fd83c-a374-4beb-bdf6-fd240c236001\") " pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"
Jul 07 18:33:56.081037 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:56.080872    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a31fd83c-a374-4beb-bdf6-fd240c236001-model-cache\") pod \"rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7\" (UID: \"a31fd83c-a374-4beb-bdf6-fd240c236001\") " pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"
Jul 07 18:33:56.081037 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:56.080888    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a31fd83c-a374-4beb-bdf6-fd240c236001-tmp-dir\") pod \"rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7\" (UID: \"a31fd83c-a374-4beb-bdf6-fd240c236001\") " pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"
Jul 07 18:33:56.081037 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:56.080936    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a31fd83c-a374-4beb-bdf6-fd240c236001-dshm\") pod \"rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7\" (UID: \"a31fd83c-a374-4beb-bdf6-fd240c236001\") " pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"
Jul 07 18:33:56.081374 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:56.081348    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a31fd83c-a374-4beb-bdf6-fd240c236001-tmp-dir\") pod \"rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7\" (UID: \"a31fd83c-a374-4beb-bdf6-fd240c236001\") " pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"
Jul 07 18:33:56.081441 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:56.081400    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a31fd83c-a374-4beb-bdf6-fd240c236001-home\") pod \"rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7\" (UID: \"a31fd83c-a374-4beb-bdf6-fd240c236001\") " pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"
Jul 07 18:33:56.081481 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:56.081453    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a31fd83c-a374-4beb-bdf6-fd240c236001-model-cache\") pod \"rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7\" (UID: \"a31fd83c-a374-4beb-bdf6-fd240c236001\") " pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"
Jul 07 18:33:56.083299 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:56.083276    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a31fd83c-a374-4beb-bdf6-fd240c236001-dshm\") pod \"rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7\" (UID: \"a31fd83c-a374-4beb-bdf6-fd240c236001\") " pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"
Jul 07 18:33:56.083502 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:56.083483    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a31fd83c-a374-4beb-bdf6-fd240c236001-tls-certs\") pod \"rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7\" (UID: \"a31fd83c-a374-4beb-bdf6-fd240c236001\") " pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"
Jul 07 18:33:56.091954 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:56.091931    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhcks\" (UniqueName: \"kubernetes.io/projected/a31fd83c-a374-4beb-bdf6-fd240c236001-kube-api-access-bhcks\") pod \"rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7\" (UID: \"a31fd83c-a374-4beb-bdf6-fd240c236001\") " pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"
Jul 07 18:33:56.160253 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:56.160162    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"
Jul 07 18:33:56.299323 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:56.299291    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"]
Jul 07 18:33:56.300906 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:33:56.300877    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda31fd83c_a374_4beb_bdf6_fd240c236001.slice/crio-22a4defb5cbcef554a3419fd26cd4cbed10ddf547db4d7768d2fb959aa557145 WatchSource:0}: Error finding container 22a4defb5cbcef554a3419fd26cd4cbed10ddf547db4d7768d2fb959aa557145: Status 404 returned error can't find the container with id 22a4defb5cbcef554a3419fd26cd4cbed10ddf547db4d7768d2fb959aa557145
Jul 07 18:33:56.348004 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:56.347965    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7" event={"ID":"a31fd83c-a374-4beb-bdf6-fd240c236001","Type":"ContainerStarted","Data":"22a4defb5cbcef554a3419fd26cd4cbed10ddf547db4d7768d2fb959aa557145"}
Jul 07 18:33:57.354712 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:57.354671    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7" event={"ID":"a31fd83c-a374-4beb-bdf6-fd240c236001","Type":"ContainerStarted","Data":"ac7a7b5c7565ef21c5255bffe5affcfce9144a7e5cc432f09aed60ad7ad9a045"}
Jul 07 18:33:57.374688 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:33:57.374637    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7" podStartSLOduration=2.374620791 podStartE2EDuration="2.374620791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:33:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:33:57.372657937 +0000 UTC m=+2428.130218801" watchObservedRunningTime="2026-07-07 18:33:57.374620791 +0000 UTC m=+2428.132181662"
Jul 07 18:34:06.160616 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:06.160574    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"
Jul 07 18:34:06.160616 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:06.160627    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"
Jul 07 18:34:06.173408 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:06.173382    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"
Jul 07 18:34:06.414339 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:06.414248    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"
Jul 07 18:34:39.757432 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:39.757399    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"]
Jul 07 18:34:40.566923 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:40.566884    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"]
Jul 07 18:34:42.937296 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:42.937259    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-a6b471-29724150-7d9fp"]
Jul 07 18:34:42.941676 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:42.941653    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-a6b471-29724150-7d9fp"]
Jul 07 18:34:43.800499 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:43.800461    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34fb884e-5337-4ecf-9e5f-96f31241fa79" path="/var/lib/kubelet/pods/34fb884e-5337-4ecf-9e5f-96f31241fa79/volumes"
Jul 07 18:34:54.777133 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:54.777085    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc" podUID="356b12ab-fb33-4e5e-aa96-d99961ff5b32" containerName="main" containerID="cri-o://74ef915eba250201d2d1bc3475b72f37a0c5834e1eebc31bba30fe01676cf6f6" gracePeriod=45
Jul 07 18:34:55.026597 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.026574    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"
Jul 07 18:34:55.106400 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.106320    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/356b12ab-fb33-4e5e-aa96-d99961ff5b32-tmp-dir\") pod \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\" (UID: \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\") "
Jul 07 18:34:55.106569 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.106402    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhdlh\" (UniqueName: \"kubernetes.io/projected/356b12ab-fb33-4e5e-aa96-d99961ff5b32-kube-api-access-bhdlh\") pod \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\" (UID: \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\") "
Jul 07 18:34:55.106569 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.106446    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/356b12ab-fb33-4e5e-aa96-d99961ff5b32-home\") pod \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\" (UID: \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\") "
Jul 07 18:34:55.106569 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.106463    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/356b12ab-fb33-4e5e-aa96-d99961ff5b32-model-cache\") pod \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\" (UID: \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\") "
Jul 07 18:34:55.106569 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.106480    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/356b12ab-fb33-4e5e-aa96-d99961ff5b32-tls-certs\") pod \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\" (UID: \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\") "
Jul 07 18:34:55.106569 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.106505    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/356b12ab-fb33-4e5e-aa96-d99961ff5b32-dshm\") pod \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\" (UID: \"356b12ab-fb33-4e5e-aa96-d99961ff5b32\") "
Jul 07 18:34:55.106847 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.106579    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/356b12ab-fb33-4e5e-aa96-d99961ff5b32-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "356b12ab-fb33-4e5e-aa96-d99961ff5b32" (UID: "356b12ab-fb33-4e5e-aa96-d99961ff5b32"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:34:55.106847 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.106710    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/356b12ab-fb33-4e5e-aa96-d99961ff5b32-tmp-dir\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:34:55.106847 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.106749    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/356b12ab-fb33-4e5e-aa96-d99961ff5b32-home" (OuterVolumeSpecName: "home") pod "356b12ab-fb33-4e5e-aa96-d99961ff5b32" (UID: "356b12ab-fb33-4e5e-aa96-d99961ff5b32"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:34:55.106847 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.106757    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/356b12ab-fb33-4e5e-aa96-d99961ff5b32-model-cache" (OuterVolumeSpecName: "model-cache") pod "356b12ab-fb33-4e5e-aa96-d99961ff5b32" (UID: "356b12ab-fb33-4e5e-aa96-d99961ff5b32"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:34:55.108621 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.108590    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/356b12ab-fb33-4e5e-aa96-d99961ff5b32-kube-api-access-bhdlh" (OuterVolumeSpecName: "kube-api-access-bhdlh") pod "356b12ab-fb33-4e5e-aa96-d99961ff5b32" (UID: "356b12ab-fb33-4e5e-aa96-d99961ff5b32"). InnerVolumeSpecName "kube-api-access-bhdlh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:34:55.108715 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.108627    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/356b12ab-fb33-4e5e-aa96-d99961ff5b32-dshm" (OuterVolumeSpecName: "dshm") pod "356b12ab-fb33-4e5e-aa96-d99961ff5b32" (UID: "356b12ab-fb33-4e5e-aa96-d99961ff5b32"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:34:55.108715 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.108687    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/356b12ab-fb33-4e5e-aa96-d99961ff5b32-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "356b12ab-fb33-4e5e-aa96-d99961ff5b32" (UID: "356b12ab-fb33-4e5e-aa96-d99961ff5b32"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:34:55.207138 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.207108    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/356b12ab-fb33-4e5e-aa96-d99961ff5b32-dshm\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:34:55.207138 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.207132    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhdlh\" (UniqueName: \"kubernetes.io/projected/356b12ab-fb33-4e5e-aa96-d99961ff5b32-kube-api-access-bhdlh\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:34:55.207138 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.207143    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/356b12ab-fb33-4e5e-aa96-d99961ff5b32-home\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:34:55.207330 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.207153    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/356b12ab-fb33-4e5e-aa96-d99961ff5b32-model-cache\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:34:55.207330 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.207162    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/356b12ab-fb33-4e5e-aa96-d99961ff5b32-tls-certs\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:34:55.587255 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.587207    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7" podUID="a31fd83c-a374-4beb-bdf6-fd240c236001" containerName="main" containerID="cri-o://ac7a7b5c7565ef21c5255bffe5affcfce9144a7e5cc432f09aed60ad7ad9a045" gracePeriod=45
Jul 07 18:34:55.654244 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.654209    2566 generic.go:356] "Generic (PLEG): container finished" podID="356b12ab-fb33-4e5e-aa96-d99961ff5b32" containerID="74ef915eba250201d2d1bc3475b72f37a0c5834e1eebc31bba30fe01676cf6f6" exitCode=0
Jul 07 18:34:55.654378 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.654251    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"
Jul 07 18:34:55.654378 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.654293    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc" event={"ID":"356b12ab-fb33-4e5e-aa96-d99961ff5b32","Type":"ContainerDied","Data":"74ef915eba250201d2d1bc3475b72f37a0c5834e1eebc31bba30fe01676cf6f6"}
Jul 07 18:34:55.654378 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.654337    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc" event={"ID":"356b12ab-fb33-4e5e-aa96-d99961ff5b32","Type":"ContainerDied","Data":"ea20b11cdb95a344b27ba7bf7fe69bed703bda1cc66a95c0cb5cec089b69cce2"}
Jul 07 18:34:55.654378 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.654354    2566 scope.go:117] "RemoveContainer" containerID="74ef915eba250201d2d1bc3475b72f37a0c5834e1eebc31bba30fe01676cf6f6"
Jul 07 18:34:55.677090 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.677068    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"]
Jul 07 18:34:55.680944 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.680921    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a6b471/rate-test-model-a6b471-kserve-b4cc785ff-xjfdc"]
Jul 07 18:34:55.698414 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.698393    2566 scope.go:117] "RemoveContainer" containerID="74ef915eba250201d2d1bc3475b72f37a0c5834e1eebc31bba30fe01676cf6f6"
Jul 07 18:34:55.698705 ip-10-0-128-53 kubenswrapper[2566]: E0707 18:34:55.698685    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74ef915eba250201d2d1bc3475b72f37a0c5834e1eebc31bba30fe01676cf6f6\": container with ID starting with 74ef915eba250201d2d1bc3475b72f37a0c5834e1eebc31bba30fe01676cf6f6 not found: ID does not exist" containerID="74ef915eba250201d2d1bc3475b72f37a0c5834e1eebc31bba30fe01676cf6f6"
Jul 07 18:34:55.698774 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.698719    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74ef915eba250201d2d1bc3475b72f37a0c5834e1eebc31bba30fe01676cf6f6"} err="failed to get container status \"74ef915eba250201d2d1bc3475b72f37a0c5834e1eebc31bba30fe01676cf6f6\": rpc error: code = NotFound desc = could not find container \"74ef915eba250201d2d1bc3475b72f37a0c5834e1eebc31bba30fe01676cf6f6\": container with ID starting with 74ef915eba250201d2d1bc3475b72f37a0c5834e1eebc31bba30fe01676cf6f6 not found: ID does not exist"
Jul 07 18:34:55.800781 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.800743    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="356b12ab-fb33-4e5e-aa96-d99961ff5b32" path="/var/lib/kubelet/pods/356b12ab-fb33-4e5e-aa96-d99961ff5b32/volumes"
Jul 07 18:34:55.835494 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.835473    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"
Jul 07 18:34:55.912992 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.912913    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a31fd83c-a374-4beb-bdf6-fd240c236001-tmp-dir\") pod \"a31fd83c-a374-4beb-bdf6-fd240c236001\" (UID: \"a31fd83c-a374-4beb-bdf6-fd240c236001\") "
Jul 07 18:34:55.912992 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.912961    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a31fd83c-a374-4beb-bdf6-fd240c236001-home\") pod \"a31fd83c-a374-4beb-bdf6-fd240c236001\" (UID: \"a31fd83c-a374-4beb-bdf6-fd240c236001\") "
Jul 07 18:34:55.913162 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.913019    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhcks\" (UniqueName: \"kubernetes.io/projected/a31fd83c-a374-4beb-bdf6-fd240c236001-kube-api-access-bhcks\") pod \"a31fd83c-a374-4beb-bdf6-fd240c236001\" (UID: \"a31fd83c-a374-4beb-bdf6-fd240c236001\") "
Jul 07 18:34:55.913162 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.913034    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a31fd83c-a374-4beb-bdf6-fd240c236001-tls-certs\") pod \"a31fd83c-a374-4beb-bdf6-fd240c236001\" (UID: \"a31fd83c-a374-4beb-bdf6-fd240c236001\") "
Jul 07 18:34:55.913162 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.913066    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a31fd83c-a374-4beb-bdf6-fd240c236001-dshm\") pod \"a31fd83c-a374-4beb-bdf6-fd240c236001\" (UID: \"a31fd83c-a374-4beb-bdf6-fd240c236001\") "
Jul 07 18:34:55.913162 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.913102    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a31fd83c-a374-4beb-bdf6-fd240c236001-model-cache\") pod \"a31fd83c-a374-4beb-bdf6-fd240c236001\" (UID: \"a31fd83c-a374-4beb-bdf6-fd240c236001\") "
Jul 07 18:34:55.913372 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.913197    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a31fd83c-a374-4beb-bdf6-fd240c236001-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a31fd83c-a374-4beb-bdf6-fd240c236001" (UID: "a31fd83c-a374-4beb-bdf6-fd240c236001"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:34:55.913372 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.913299    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a31fd83c-a374-4beb-bdf6-fd240c236001-home" (OuterVolumeSpecName: "home") pod "a31fd83c-a374-4beb-bdf6-fd240c236001" (UID: "a31fd83c-a374-4beb-bdf6-fd240c236001"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:34:55.913470 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.913421    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a31fd83c-a374-4beb-bdf6-fd240c236001-model-cache" (OuterVolumeSpecName: "model-cache") pod "a31fd83c-a374-4beb-bdf6-fd240c236001" (UID: "a31fd83c-a374-4beb-bdf6-fd240c236001"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:34:55.913470 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.913444    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a31fd83c-a374-4beb-bdf6-fd240c236001-tmp-dir\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:34:55.913470 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.913459    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a31fd83c-a374-4beb-bdf6-fd240c236001-home\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:34:55.915230 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.915202    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a31fd83c-a374-4beb-bdf6-fd240c236001-dshm" (OuterVolumeSpecName: "dshm") pod "a31fd83c-a374-4beb-bdf6-fd240c236001" (UID: "a31fd83c-a374-4beb-bdf6-fd240c236001"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:34:55.915319 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.915268    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a31fd83c-a374-4beb-bdf6-fd240c236001-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a31fd83c-a374-4beb-bdf6-fd240c236001" (UID: "a31fd83c-a374-4beb-bdf6-fd240c236001"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:34:55.915319 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:55.915279    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a31fd83c-a374-4beb-bdf6-fd240c236001-kube-api-access-bhcks" (OuterVolumeSpecName: "kube-api-access-bhcks") pod "a31fd83c-a374-4beb-bdf6-fd240c236001" (UID: "a31fd83c-a374-4beb-bdf6-fd240c236001"). InnerVolumeSpecName "kube-api-access-bhcks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:34:56.014136 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:56.014097    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhcks\" (UniqueName: \"kubernetes.io/projected/a31fd83c-a374-4beb-bdf6-fd240c236001-kube-api-access-bhcks\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:34:56.014136 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:56.014132    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a31fd83c-a374-4beb-bdf6-fd240c236001-tls-certs\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:34:56.014136 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:56.014142    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a31fd83c-a374-4beb-bdf6-fd240c236001-dshm\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:34:56.014136 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:56.014150    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a31fd83c-a374-4beb-bdf6-fd240c236001-model-cache\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:34:56.661008 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:56.660972    2566 generic.go:356] "Generic (PLEG): container finished" podID="a31fd83c-a374-4beb-bdf6-fd240c236001" containerID="ac7a7b5c7565ef21c5255bffe5affcfce9144a7e5cc432f09aed60ad7ad9a045" exitCode=0
Jul 07 18:34:56.661008 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:56.661010    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"
Jul 07 18:34:56.661230 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:56.661027    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7" event={"ID":"a31fd83c-a374-4beb-bdf6-fd240c236001","Type":"ContainerDied","Data":"ac7a7b5c7565ef21c5255bffe5affcfce9144a7e5cc432f09aed60ad7ad9a045"}
Jul 07 18:34:56.661230 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:56.661072    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7" event={"ID":"a31fd83c-a374-4beb-bdf6-fd240c236001","Type":"ContainerDied","Data":"22a4defb5cbcef554a3419fd26cd4cbed10ddf547db4d7768d2fb959aa557145"}
Jul 07 18:34:56.661230 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:56.661092    2566 scope.go:117] "RemoveContainer" containerID="ac7a7b5c7565ef21c5255bffe5affcfce9144a7e5cc432f09aed60ad7ad9a045"
Jul 07 18:34:56.670584 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:56.670566    2566 scope.go:117] "RemoveContainer" containerID="ac7a7b5c7565ef21c5255bffe5affcfce9144a7e5cc432f09aed60ad7ad9a045"
Jul 07 18:34:56.670802 ip-10-0-128-53 kubenswrapper[2566]: E0707 18:34:56.670785    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac7a7b5c7565ef21c5255bffe5affcfce9144a7e5cc432f09aed60ad7ad9a045\": container with ID starting with ac7a7b5c7565ef21c5255bffe5affcfce9144a7e5cc432f09aed60ad7ad9a045 not found: ID does not exist" containerID="ac7a7b5c7565ef21c5255bffe5affcfce9144a7e5cc432f09aed60ad7ad9a045"
Jul 07 18:34:56.670926 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:56.670812    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac7a7b5c7565ef21c5255bffe5affcfce9144a7e5cc432f09aed60ad7ad9a045"} err="failed to get container status \"ac7a7b5c7565ef21c5255bffe5affcfce9144a7e5cc432f09aed60ad7ad9a045\": rpc error: code = NotFound desc = could not find container \"ac7a7b5c7565ef21c5255bffe5affcfce9144a7e5cc432f09aed60ad7ad9a045\": container with ID starting with ac7a7b5c7565ef21c5255bffe5affcfce9144a7e5cc432f09aed60ad7ad9a045 not found: ID does not exist"
Jul 07 18:34:56.685476 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:56.685449    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"]
Jul 07 18:34:56.690152 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:56.690132    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-89d0f3/rate-test-model-89d0f3-kserve-648bb6b7dc-sqmb7"]
Jul 07 18:34:57.800840 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:34:57.800777    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a31fd83c-a374-4beb-bdf6-fd240c236001" path="/var/lib/kubelet/pods/a31fd83c-a374-4beb-bdf6-fd240c236001/volumes"
Jul 07 18:35:21.560365 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:21.560280    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"]
Jul 07 18:35:21.560866 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:21.560533    2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng" podUID="846c0923-1b5a-471d-9d50-133cb1ea60ab" containerName="istio-proxy" containerID="cri-o://749c84922579689de5af597690573860a324dfa95ff35c1bd20a592f061dd4b8" gracePeriod=30
Jul 07 18:35:23.001386 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:23.001344    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-89d0f3-29724150-lctt9"]
Jul 07 18:35:23.017137 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:23.017108    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-89d0f3-29724150-lctt9"]
Jul 07 18:35:23.799657 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:23.799625    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2203d818-662a-42ee-8d0d-2a3540f3b607" path="/var/lib/kubelet/pods/2203d818-662a-42ee-8d0d-2a3540f3b607/volumes"
Jul 07 18:35:26.809173 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:26.809136    2566 generic.go:356] "Generic (PLEG): container finished" podID="846c0923-1b5a-471d-9d50-133cb1ea60ab" containerID="749c84922579689de5af597690573860a324dfa95ff35c1bd20a592f061dd4b8" exitCode=0
Jul 07 18:35:26.809514 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:26.809205    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng" event={"ID":"846c0923-1b5a-471d-9d50-133cb1ea60ab","Type":"ContainerDied","Data":"749c84922579689de5af597690573860a324dfa95ff35c1bd20a592f061dd4b8"}
Jul 07 18:35:26.809514 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:26.809262    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng" event={"ID":"846c0923-1b5a-471d-9d50-133cb1ea60ab","Type":"ContainerDied","Data":"ce2a1ad4e70849b063bbb8ce938cdb05ff09a069134d8129eba4c6fda4abb0c7"}
Jul 07 18:35:26.809514 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:26.809278    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce2a1ad4e70849b063bbb8ce938cdb05ff09a069134d8129eba4c6fda4abb0c7"
Jul 07 18:35:26.809514 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:26.809291    2566 scope.go:117] "RemoveContainer" containerID="063a6602c2c4868465e38d2c52b835ebd866f1acb45d38efd3c2f48f5c1025e0"
Jul 07 18:35:26.813836 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:26.813804    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:35:26.974740 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:26.974707    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/846c0923-1b5a-471d-9d50-133cb1ea60ab-istiod-ca-cert\") pod \"846c0923-1b5a-471d-9d50-133cb1ea60ab\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") "
Jul 07 18:35:26.974934 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:26.974752    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-workload-socket\") pod \"846c0923-1b5a-471d-9d50-133cb1ea60ab\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") "
Jul 07 18:35:26.974934 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:26.974794    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-istio-envoy\") pod \"846c0923-1b5a-471d-9d50-133cb1ea60ab\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") "
Jul 07 18:35:26.974934 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:26.974889    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/846c0923-1b5a-471d-9d50-133cb1ea60ab-istio-token\") pod \"846c0923-1b5a-471d-9d50-133cb1ea60ab\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") "
Jul 07 18:35:26.974934 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:26.974924    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-credential-socket\") pod \"846c0923-1b5a-471d-9d50-133cb1ea60ab\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") "
Jul 07 18:35:26.975096 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:26.974949    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/846c0923-1b5a-471d-9d50-133cb1ea60ab-istio-podinfo\") pod \"846c0923-1b5a-471d-9d50-133cb1ea60ab\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") "
Jul 07 18:35:26.975096 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:26.974977    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv4k5\" (UniqueName: \"kubernetes.io/projected/846c0923-1b5a-471d-9d50-133cb1ea60ab-kube-api-access-mv4k5\") pod \"846c0923-1b5a-471d-9d50-133cb1ea60ab\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") "
Jul 07 18:35:26.975096 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:26.975030    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-istio-data\") pod \"846c0923-1b5a-471d-9d50-133cb1ea60ab\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") "
Jul 07 18:35:26.975096 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:26.975067    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-workload-certs\") pod \"846c0923-1b5a-471d-9d50-133cb1ea60ab\" (UID: \"846c0923-1b5a-471d-9d50-133cb1ea60ab\") "
Jul 07 18:35:26.975285 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:26.975143    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "846c0923-1b5a-471d-9d50-133cb1ea60ab" (UID: "846c0923-1b5a-471d-9d50-133cb1ea60ab"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:35:26.975285 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:26.975266    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "846c0923-1b5a-471d-9d50-133cb1ea60ab" (UID: "846c0923-1b5a-471d-9d50-133cb1ea60ab"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:35:26.975392 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:26.975284    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/846c0923-1b5a-471d-9d50-133cb1ea60ab-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "846c0923-1b5a-471d-9d50-133cb1ea60ab" (UID: "846c0923-1b5a-471d-9d50-133cb1ea60ab"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:35:26.975392 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:26.975369    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "846c0923-1b5a-471d-9d50-133cb1ea60ab" (UID: "846c0923-1b5a-471d-9d50-133cb1ea60ab"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:35:26.975504 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:26.975389    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-workload-socket\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:35:26.976078 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:26.976058    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-istio-data" (OuterVolumeSpecName: "istio-data") pod "846c0923-1b5a-471d-9d50-133cb1ea60ab" (UID: "846c0923-1b5a-471d-9d50-133cb1ea60ab"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:35:26.977260 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:26.977235    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/846c0923-1b5a-471d-9d50-133cb1ea60ab-kube-api-access-mv4k5" (OuterVolumeSpecName: "kube-api-access-mv4k5") pod "846c0923-1b5a-471d-9d50-133cb1ea60ab" (UID: "846c0923-1b5a-471d-9d50-133cb1ea60ab"). InnerVolumeSpecName "kube-api-access-mv4k5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:35:26.977346 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:26.977265    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "846c0923-1b5a-471d-9d50-133cb1ea60ab" (UID: "846c0923-1b5a-471d-9d50-133cb1ea60ab"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:35:26.977701 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:26.977682    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/846c0923-1b5a-471d-9d50-133cb1ea60ab-istio-token" (OuterVolumeSpecName: "istio-token") pod "846c0923-1b5a-471d-9d50-133cb1ea60ab" (UID: "846c0923-1b5a-471d-9d50-133cb1ea60ab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:35:26.977701 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:26.977691    2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/846c0923-1b5a-471d-9d50-133cb1ea60ab-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "846c0923-1b5a-471d-9d50-133cb1ea60ab" (UID: "846c0923-1b5a-471d-9d50-133cb1ea60ab"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:35:27.076101 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:27.076074    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/846c0923-1b5a-471d-9d50-133cb1ea60ab-istio-token\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:35:27.076101 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:27.076102    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-credential-socket\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:35:27.076101 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:27.076115    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/846c0923-1b5a-471d-9d50-133cb1ea60ab-istio-podinfo\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:35:27.076324 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:27.076128    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv4k5\" (UniqueName: \"kubernetes.io/projected/846c0923-1b5a-471d-9d50-133cb1ea60ab-kube-api-access-mv4k5\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:35:27.076324 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:27.076139    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-istio-data\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:35:27.076324 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:27.076151    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-workload-certs\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:35:27.076324 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:27.076161    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/846c0923-1b5a-471d-9d50-133cb1ea60ab-istiod-ca-cert\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:35:27.076324 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:27.076171    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/846c0923-1b5a-471d-9d50-133cb1ea60ab-istio-envoy\") on node \"ip-10-0-128-53.ec2.internal\" DevicePath \"\""
Jul 07 18:35:27.814283 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:27.814250    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"
Jul 07 18:35:27.855433 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:27.855403    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"]
Jul 07 18:35:27.860050 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:27.860023    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-a6b471-openshift-default-564885d44c-8trng"]
Jul 07 18:35:29.801909 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:29.801880    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="846c0923-1b5a-471d-9d50-133cb1ea60ab" path="/var/lib/kubelet/pods/846c0923-1b5a-471d-9d50-133cb1ea60ab/volumes"
Jul 07 18:35:30.005546 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:30.005506    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7b8b6fd7c8-9lkzk_633006b0-5ab9-4e1a-b365-381fba1043c7/authorino/0.log"
Jul 07 18:35:30.007470 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:30.007444    2566 scope.go:117] "RemoveContainer" containerID="749c84922579689de5af597690573860a324dfa95ff35c1bd20a592f061dd4b8"
Jul 07 18:35:35.742143 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:35.742112    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724135-qcbqz_f435401c-28a9-4a57-b84f-9c1fc5e55cdf/cleanup/0.log"
Jul 07 18:35:36.028745 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:36.028665    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-889554864-vtnkt_04ff5f7b-2f0d-4fa7-8d94-74bc3d170d43/manager/0.log"
Jul 07 18:35:36.181331 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:36.181297    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-btmch_3a27f97e-b598-43be-8426-636cffc1f30a/server/0.log"
Jul 07 18:35:36.325581 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:36.325493    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9f9gs_e79f47de-5ed8-43ea-a814-96da6d4d3181/manager/0.log"
Jul 07 18:35:36.613571 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:36.613485    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fcb7f7967-pcp5m_39fdfc6b-613f-4bf3-80ca-67486c0fd30e/copy-manifests/0.log"
Jul 07 18:35:36.625552 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:36.625523    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fcb7f7967-pcp5m_39fdfc6b-613f-4bf3-80ca-67486c0fd30e/manager/0.log"
Jul 07 18:35:37.814743 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:37.814715    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm_b794b63e-9f2c-4094-a758-40914a1dfbb5/util/0.log"
Jul 07 18:35:37.828912 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:37.828890    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm_b794b63e-9f2c-4094-a758-40914a1dfbb5/pull/0.log"
Jul 07 18:35:37.851208 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:37.851186    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm_b794b63e-9f2c-4094-a758-40914a1dfbb5/extract/0.log"
Jul 07 18:35:37.973527 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:37.973500    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp_4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d/util/0.log"
Jul 07 18:35:37.983269 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:37.983244    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp_4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d/pull/0.log"
Jul 07 18:35:37.991673 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:37.991659    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp_4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d/extract/0.log"
Jul 07 18:35:38.122812 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:38.122726    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl_e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf/pull/0.log"
Jul 07 18:35:38.132090 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:38.132066    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl_e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf/extract/0.log"
Jul 07 18:35:38.139953 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:38.139933    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl_e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf/util/0.log"
Jul 07 18:35:38.264973 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:38.264938    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm_09d43bcd-7935-40d2-9f42-f11b714d7f31/extract/0.log"
Jul 07 18:35:38.275776 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:38.275748    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm_09d43bcd-7935-40d2-9f42-f11b714d7f31/util/0.log"
Jul 07 18:35:38.289033 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:38.289009    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm_09d43bcd-7935-40d2-9f42-f11b714d7f31/pull/0.log"
Jul 07 18:35:38.420419 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:38.420333    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7b8b6fd7c8-9lkzk_633006b0-5ab9-4e1a-b365-381fba1043c7/authorino/0.log"
Jul 07 18:35:38.804473 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:38.804444    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-gvnxk_cb076d7d-d224-4d92-bb5c-88a4d16a73e3/kuadrant-console-plugin/0.log"
Jul 07 18:35:40.115160 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:40.115126    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bdc88f569-d7dp4_561c33c4-fcf6-4317-9324-b7fc8e196b17/kube-auth-proxy/0.log"
Jul 07 18:35:40.367449 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:40.367367    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-zqd2b_c129d715-41a9-4d84-9b23-626d20b017c5/payload-pre-processing/0.log"
Jul 07 18:35:40.615773 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:40.615741    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f68b6fb67-nhtkt_31f23e0b-1ec1-47af-a692-c6b0da751108/router/0.log"
Jul 07 18:35:41.109907 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:41.109877    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-2sldq_146477be-d746-4745-a113-bcf1617f05f1/main/0.log"
Jul 07 18:35:46.586695 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:46.586656    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wg5s4/must-gather-d877b"]
Jul 07 18:35:46.587083 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:46.586994    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="846c0923-1b5a-471d-9d50-133cb1ea60ab" containerName="istio-proxy"
Jul 07 18:35:46.587083 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:46.587005    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="846c0923-1b5a-471d-9d50-133cb1ea60ab" containerName="istio-proxy"
Jul 07 18:35:46.587083 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:46.587013    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="846c0923-1b5a-471d-9d50-133cb1ea60ab" containerName="istio-proxy"
Jul 07 18:35:46.587083 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:46.587018    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="846c0923-1b5a-471d-9d50-133cb1ea60ab" containerName="istio-proxy"
Jul 07 18:35:46.587083 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:46.587038    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="356b12ab-fb33-4e5e-aa96-d99961ff5b32" containerName="main"
Jul 07 18:35:46.587083 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:46.587044    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="356b12ab-fb33-4e5e-aa96-d99961ff5b32" containerName="main"
Jul 07 18:35:46.587083 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:46.587061    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a31fd83c-a374-4beb-bdf6-fd240c236001" containerName="main"
Jul 07 18:35:46.587083 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:46.587066    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a31fd83c-a374-4beb-bdf6-fd240c236001" containerName="main"
Jul 07 18:35:46.587353 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:46.587114    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a31fd83c-a374-4beb-bdf6-fd240c236001" containerName="main"
Jul 07 18:35:46.587353 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:46.587122    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="846c0923-1b5a-471d-9d50-133cb1ea60ab" containerName="istio-proxy"
Jul 07 18:35:46.587353 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:46.587129    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="846c0923-1b5a-471d-9d50-133cb1ea60ab" containerName="istio-proxy"
Jul 07 18:35:46.587353 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:46.587136    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="356b12ab-fb33-4e5e-aa96-d99961ff5b32" containerName="main"
Jul 07 18:35:46.590212 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:46.590194    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wg5s4/must-gather-d877b"
Jul 07 18:35:46.593973 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:46.593952    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wg5s4\"/\"kube-root-ca.crt\""
Jul 07 18:35:46.594660 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:46.594636    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wg5s4\"/\"default-dockercfg-8779w\""
Jul 07 18:35:46.594764 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:46.594636    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wg5s4\"/\"openshift-service-ca.crt\""
Jul 07 18:35:46.601101 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:46.601081    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wg5s4/must-gather-d877b"]
Jul 07 18:35:46.630511 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:46.630485    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/815c9d68-3136-450e-afb4-8427690df895-must-gather-output\") pod \"must-gather-d877b\" (UID: \"815c9d68-3136-450e-afb4-8427690df895\") " pod="openshift-must-gather-wg5s4/must-gather-d877b"
Jul 07 18:35:46.630623 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:46.630553    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn952\" (UniqueName: \"kubernetes.io/projected/815c9d68-3136-450e-afb4-8427690df895-kube-api-access-bn952\") pod \"must-gather-d877b\" (UID: \"815c9d68-3136-450e-afb4-8427690df895\") " pod="openshift-must-gather-wg5s4/must-gather-d877b"
Jul 07 18:35:46.731347 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:46.731314    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/815c9d68-3136-450e-afb4-8427690df895-must-gather-output\") pod \"must-gather-d877b\" (UID: \"815c9d68-3136-450e-afb4-8427690df895\") " pod="openshift-must-gather-wg5s4/must-gather-d877b"
Jul 07 18:35:46.731522 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:46.731357    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn952\" (UniqueName: \"kubernetes.io/projected/815c9d68-3136-450e-afb4-8427690df895-kube-api-access-bn952\") pod \"must-gather-d877b\" (UID: \"815c9d68-3136-450e-afb4-8427690df895\") " pod="openshift-must-gather-wg5s4/must-gather-d877b"
Jul 07 18:35:46.731697 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:46.731678    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/815c9d68-3136-450e-afb4-8427690df895-must-gather-output\") pod \"must-gather-d877b\" (UID: \"815c9d68-3136-450e-afb4-8427690df895\") " pod="openshift-must-gather-wg5s4/must-gather-d877b"
Jul 07 18:35:46.756646 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:46.756609    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn952\" (UniqueName: \"kubernetes.io/projected/815c9d68-3136-450e-afb4-8427690df895-kube-api-access-bn952\") pod \"must-gather-d877b\" (UID: \"815c9d68-3136-450e-afb4-8427690df895\") " pod="openshift-must-gather-wg5s4/must-gather-d877b"
Jul 07 18:35:46.898844 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:46.898729    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wg5s4/must-gather-d877b"
Jul 07 18:35:47.058006 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:47.057978    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wg5s4/must-gather-d877b"]
Jul 07 18:35:47.059056 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:35:47.059035    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod815c9d68_3136_450e_afb4_8427690df895.slice/crio-b4dec8d45ebf5629d3634fd27282602b3c74f1d21e42bc6fa1238905da032f30 WatchSource:0}: Error finding container b4dec8d45ebf5629d3634fd27282602b3c74f1d21e42bc6fa1238905da032f30: Status 404 returned error can't find the container with id b4dec8d45ebf5629d3634fd27282602b3c74f1d21e42bc6fa1238905da032f30
Jul 07 18:35:47.061084 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:47.061068    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 18:35:47.907548 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:47.907500    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wg5s4/must-gather-d877b" event={"ID":"815c9d68-3136-450e-afb4-8427690df895","Type":"ContainerStarted","Data":"b4dec8d45ebf5629d3634fd27282602b3c74f1d21e42bc6fa1238905da032f30"}
Jul 07 18:35:48.917659 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:48.917611    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wg5s4/must-gather-d877b" event={"ID":"815c9d68-3136-450e-afb4-8427690df895","Type":"ContainerStarted","Data":"76888ff31305f9076fd1163e81378a548ca34afa215b26866cbeb574a6a9b163"}
Jul 07 18:35:48.918157 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:48.917673    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wg5s4/must-gather-d877b" event={"ID":"815c9d68-3136-450e-afb4-8427690df895","Type":"ContainerStarted","Data":"bf4cbdd16c0d4b25b6ce3c977f6caa6daf7c21bd965a617a3d62985d3bd5cad8"}
Jul 07 18:35:48.942839 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:48.942776    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wg5s4/must-gather-d877b" podStartSLOduration=1.861582539 podStartE2EDuration="2.942758714s" totalImagesPullingTime="1.081176175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:35:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:35:48.94253914 +0000 UTC m=+2539.700100011" watchObservedRunningTime="2026-07-07 18:35:48.942758714 +0000 UTC m=+2539.700319584"
Jul 07 18:35:49.910239 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:49.910158    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9qmtf_5ca929e8-fe5f-4713-ae87-fcfdd2816546/global-pull-secret-syncer/0.log"
Jul 07 18:35:50.132029 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:50.131998    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-txjw6_d69a68be-0a86-46c6-b598-0e6bbc0d3b4d/konnectivity-agent/0.log"
Jul 07 18:35:50.192844 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:50.192752    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-53.ec2.internal_6da60c6aa145a773b0c59de51f12d9f6/haproxy/0.log"
Jul 07 18:35:54.374504 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:54.374476    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm_b794b63e-9f2c-4094-a758-40914a1dfbb5/extract/0.log"
Jul 07 18:35:54.428506 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:54.428423    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm_b794b63e-9f2c-4094-a758-40914a1dfbb5/util/0.log"
Jul 07 18:35:54.468540 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:54.468513    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rmwnm_b794b63e-9f2c-4094-a758-40914a1dfbb5/pull/0.log"
Jul 07 18:35:54.505277 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:54.505231    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp_4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d/extract/0.log"
Jul 07 18:35:54.546162 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:54.546126    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp_4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d/util/0.log"
Jul 07 18:35:54.579908 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:54.579868    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rrgqp_4a93fe2d-5f3f-45ea-8e8f-edbcc224a98d/pull/0.log"
Jul 07 18:35:54.630462 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:54.630392    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl_e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf/extract/0.log"
Jul 07 18:35:54.672907 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:54.672879    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl_e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf/util/0.log"
Jul 07 18:35:54.713332 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:54.713297    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qx9jl_e80f5f2b-a8aa-4eb0-8fd9-5e08a67fadbf/pull/0.log"
Jul 07 18:35:54.746334 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:54.746299    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm_09d43bcd-7935-40d2-9f42-f11b714d7f31/extract/0.log"
Jul 07 18:35:54.779767 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:54.779743    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm_09d43bcd-7935-40d2-9f42-f11b714d7f31/util/0.log"
Jul 07 18:35:54.835402 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:54.835337    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t2xjm_09d43bcd-7935-40d2-9f42-f11b714d7f31/pull/0.log"
Jul 07 18:35:55.222846 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:55.220629    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7b8b6fd7c8-9lkzk_633006b0-5ab9-4e1a-b365-381fba1043c7/authorino/0.log"
Jul 07 18:35:55.365305 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:55.365272    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-gvnxk_cb076d7d-d224-4d92-bb5c-88a4d16a73e3/kuadrant-console-plugin/0.log"
Jul 07 18:35:58.094480 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:58.094417    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s7tln_74e34a16-af05-4016-81d9-1d0f44f68fc5/node-exporter/0.log"
Jul 07 18:35:58.119008 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:58.118978    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s7tln_74e34a16-af05-4016-81d9-1d0f44f68fc5/kube-rbac-proxy/0.log"
Jul 07 18:35:58.170184 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:58.170156    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s7tln_74e34a16-af05-4016-81d9-1d0f44f68fc5/init-textfile/0.log"
Jul 07 18:35:59.561504 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:59.561459    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wg5s4/perf-node-gather-daemonset-9csh5"]
Jul 07 18:35:59.566866 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:59.566840    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-9csh5"
Jul 07 18:35:59.576589 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:59.576559    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wg5s4/perf-node-gather-daemonset-9csh5"]
Jul 07 18:35:59.656003 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:59.655659    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eadab7d2-d883-4ff2-bed9-b12c175b3700-proc\") pod \"perf-node-gather-daemonset-9csh5\" (UID: \"eadab7d2-d883-4ff2-bed9-b12c175b3700\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-9csh5"
Jul 07 18:35:59.656003 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:59.655732    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n922h\" (UniqueName: \"kubernetes.io/projected/eadab7d2-d883-4ff2-bed9-b12c175b3700-kube-api-access-n922h\") pod \"perf-node-gather-daemonset-9csh5\" (UID: \"eadab7d2-d883-4ff2-bed9-b12c175b3700\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-9csh5"
Jul 07 18:35:59.656003 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:59.655768    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eadab7d2-d883-4ff2-bed9-b12c175b3700-podres\") pod \"perf-node-gather-daemonset-9csh5\" (UID: \"eadab7d2-d883-4ff2-bed9-b12c175b3700\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-9csh5"
Jul 07 18:35:59.656003 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:59.655853    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eadab7d2-d883-4ff2-bed9-b12c175b3700-lib-modules\") pod \"perf-node-gather-daemonset-9csh5\" (UID: \"eadab7d2-d883-4ff2-bed9-b12c175b3700\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-9csh5"
Jul 07 18:35:59.656003 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:59.655919    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eadab7d2-d883-4ff2-bed9-b12c175b3700-sys\") pod \"perf-node-gather-daemonset-9csh5\" (UID: \"eadab7d2-d883-4ff2-bed9-b12c175b3700\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-9csh5"
Jul 07 18:35:59.756555 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:59.756519    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eadab7d2-d883-4ff2-bed9-b12c175b3700-sys\") pod \"perf-node-gather-daemonset-9csh5\" (UID: \"eadab7d2-d883-4ff2-bed9-b12c175b3700\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-9csh5"
Jul 07 18:35:59.756799 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:59.756762    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eadab7d2-d883-4ff2-bed9-b12c175b3700-sys\") pod \"perf-node-gather-daemonset-9csh5\" (UID: \"eadab7d2-d883-4ff2-bed9-b12c175b3700\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-9csh5"
Jul 07 18:35:59.756979 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:59.756955    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eadab7d2-d883-4ff2-bed9-b12c175b3700-proc\") pod \"perf-node-gather-daemonset-9csh5\" (UID: \"eadab7d2-d883-4ff2-bed9-b12c175b3700\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-9csh5"
Jul 07 18:35:59.757050 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:59.756956    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eadab7d2-d883-4ff2-bed9-b12c175b3700-proc\") pod \"perf-node-gather-daemonset-9csh5\" (UID: \"eadab7d2-d883-4ff2-bed9-b12c175b3700\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-9csh5"
Jul 07 18:35:59.757124 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:59.757048    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n922h\" (UniqueName: \"kubernetes.io/projected/eadab7d2-d883-4ff2-bed9-b12c175b3700-kube-api-access-n922h\") pod \"perf-node-gather-daemonset-9csh5\" (UID: \"eadab7d2-d883-4ff2-bed9-b12c175b3700\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-9csh5"
Jul 07 18:35:59.757124 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:59.757095    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eadab7d2-d883-4ff2-bed9-b12c175b3700-podres\") pod \"perf-node-gather-daemonset-9csh5\" (UID: \"eadab7d2-d883-4ff2-bed9-b12c175b3700\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-9csh5"
Jul 07 18:35:59.757267 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:59.757187    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eadab7d2-d883-4ff2-bed9-b12c175b3700-lib-modules\") pod \"perf-node-gather-daemonset-9csh5\" (UID: \"eadab7d2-d883-4ff2-bed9-b12c175b3700\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-9csh5"
Jul 07 18:35:59.757385 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:59.757361    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eadab7d2-d883-4ff2-bed9-b12c175b3700-podres\") pod \"perf-node-gather-daemonset-9csh5\" (UID: \"eadab7d2-d883-4ff2-bed9-b12c175b3700\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-9csh5"
Jul 07 18:35:59.757444 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:59.757370    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eadab7d2-d883-4ff2-bed9-b12c175b3700-lib-modules\") pod \"perf-node-gather-daemonset-9csh5\" (UID: \"eadab7d2-d883-4ff2-bed9-b12c175b3700\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-9csh5"
Jul 07 18:35:59.767491 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:59.767462    2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n922h\" (UniqueName: \"kubernetes.io/projected/eadab7d2-d883-4ff2-bed9-b12c175b3700-kube-api-access-n922h\") pod \"perf-node-gather-daemonset-9csh5\" (UID: \"eadab7d2-d883-4ff2-bed9-b12c175b3700\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-9csh5"
Jul 07 18:35:59.882048 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:35:59.881960    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-9csh5"
Jul 07 18:36:00.079019 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:00.078971    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wg5s4/perf-node-gather-daemonset-9csh5"]
Jul 07 18:36:00.081393 ip-10-0-128-53 kubenswrapper[2566]: W0707 18:36:00.081363    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podeadab7d2_d883_4ff2_bed9_b12c175b3700.slice/crio-88384f5a7a16aa7dec36ee49c2f18d1c49454a24d9d576d5ef591e675876af1b WatchSource:0}: Error finding container 88384f5a7a16aa7dec36ee49c2f18d1c49454a24d9d576d5ef591e675876af1b: Status 404 returned error can't find the container with id 88384f5a7a16aa7dec36ee49c2f18d1c49454a24d9d576d5ef591e675876af1b
Jul 07 18:36:00.759022 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:00.758986    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lcfnl_9bc45238-7341-43fe-a75f-231dbf7a3704/console-operator/1.log"
Jul 07 18:36:00.765186 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:00.765155    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-lcfnl_9bc45238-7341-43fe-a75f-231dbf7a3704/console-operator/2.log"
Jul 07 18:36:01.009111 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:01.009007    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-9csh5" event={"ID":"eadab7d2-d883-4ff2-bed9-b12c175b3700","Type":"ContainerStarted","Data":"3bfe2abeed8ded8941a63ff5b4e00b05c0481ca19f42339948d00da5eeb01599"}
Jul 07 18:36:01.009111 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:01.009074    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-9csh5" event={"ID":"eadab7d2-d883-4ff2-bed9-b12c175b3700","Type":"ContainerStarted","Data":"88384f5a7a16aa7dec36ee49c2f18d1c49454a24d9d576d5ef591e675876af1b"}
Jul 07 18:36:01.009111 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:01.009104    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-9csh5"
Jul 07 18:36:01.033621 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:01.033567    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-9csh5" podStartSLOduration=2.033547095 podStartE2EDuration="2.033547095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:35:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:36:01.031601606 +0000 UTC m=+2551.789162478" watchObservedRunningTime="2026-07-07 18:36:01.033547095 +0000 UTC m=+2551.791107966"
Jul 07 18:36:03.181924 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:03.181880    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vsbcs_3adf617f-d40a-4d88-bfb2-4409d1298149/dns/0.log"
Jul 07 18:36:03.220463 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:03.220432    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vsbcs_3adf617f-d40a-4d88-bfb2-4409d1298149/kube-rbac-proxy/0.log"
Jul 07 18:36:03.291020 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:03.290992    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pxsv8_1ca7075b-0176-4929-809b-3efa67cb7d5d/dns-node-resolver/0.log"
Jul 07 18:36:04.173360 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:04.173325    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t7czl_ad3b117b-52a4-49fa-8b26-e225f8cb3837/node-ca/0.log"
Jul 07 18:36:05.478195 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:05.478160    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bdc88f569-d7dp4_561c33c4-fcf6-4317-9324-b7fc8e196b17/kube-auth-proxy/0.log"
Jul 07 18:36:05.613005 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:05.612973    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-zqd2b_c129d715-41a9-4d84-9b23-626d20b017c5/payload-pre-processing/0.log"
Jul 07 18:36:05.816879 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:05.816781    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f68b6fb67-nhtkt_31f23e0b-1ec1-47af-a692-c6b0da751108/router/0.log"
Jul 07 18:36:06.634432 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:06.634397    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c6ss5_c59bceb7-2ee5-4f47-b279-31b1ff19937a/serve-healthcheck-canary/0.log"
Jul 07 18:36:07.026186 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:07.026160    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-9csh5"
Jul 07 18:36:07.361000 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:07.360912    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-t7nj9_ca3d9186-62d8-45f5-a84c-18fc318bfa08/insights-operator/0.log"
Jul 07 18:36:07.361662 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:07.361644    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-t7nj9_ca3d9186-62d8-45f5-a84c-18fc318bfa08/insights-operator/1.log"
Jul 07 18:36:07.389083 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:07.389046    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2tslh_7c71e9bc-6539-4eb1-9961-dfb0928d5c56/kube-rbac-proxy/0.log"
Jul 07 18:36:07.423078 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:07.423054    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2tslh_7c71e9bc-6539-4eb1-9961-dfb0928d5c56/exporter/0.log"
Jul 07 18:36:07.476473 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:07.476446    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2tslh_7c71e9bc-6539-4eb1-9961-dfb0928d5c56/extractor/0.log"
Jul 07 18:36:10.568898 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:10.568867    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724135-qcbqz_f435401c-28a9-4a57-b84f-9c1fc5e55cdf/cleanup/0.log"
Jul 07 18:36:10.726458 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:10.726411    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bdc88f569-d7dp4_561c33c4-fcf6-4317-9324-b7fc8e196b17/kube-auth-proxy/0.log"
Jul 07 18:36:10.735051 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:10.735023    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-889554864-vtnkt_04ff5f7b-2f0d-4fa7-8d94-74bc3d170d43/manager/0.log"
Jul 07 18:36:10.778847 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:10.778800    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-btmch_3a27f97e-b598-43be-8426-636cffc1f30a/server/0.log"
Jul 07 18:36:10.822315 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:10.822228    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-zqd2b_c129d715-41a9-4d84-9b23-626d20b017c5/payload-pre-processing/0.log"
Jul 07 18:36:10.891816 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:10.891783    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9f9gs_e79f47de-5ed8-43ea-a814-96da6d4d3181/manager/0.log"
Jul 07 18:36:10.911801 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:10.911774    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f68b6fb67-nhtkt_31f23e0b-1ec1-47af-a692-c6b0da751108/router/0.log"
Jul 07 18:36:11.088717 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:11.088614    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fcb7f7967-pcp5m_39fdfc6b-613f-4bf3-80ca-67486c0fd30e/manager/0.log"
Jul 07 18:36:11.158694 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:11.158664    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fcb7f7967-pcp5m_39fdfc6b-613f-4bf3-80ca-67486c0fd30e/copy-manifests/0.log"
Jul 07 18:36:12.316506 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:12.316475    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bdc88f569-d7dp4_561c33c4-fcf6-4317-9324-b7fc8e196b17/kube-auth-proxy/0.log"
Jul 07 18:36:12.413988 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:12.413957    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-zqd2b_c129d715-41a9-4d84-9b23-626d20b017c5/payload-pre-processing/0.log"
Jul 07 18:36:12.497714 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:12.497679    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f68b6fb67-nhtkt_31f23e0b-1ec1-47af-a692-c6b0da751108/router/0.log"
Jul 07 18:36:12.804284 ip-10-0-128-53 kubenswrapper[2566]: I0707 18:36:12.804236    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-694995b85-hms5c_3e2412a1-99a3-4da9-8bb3-794f93bf1e48/manager/0.log"